-- Logs begin at Tue 2022-08-30 11:18:40 UTC, end at Tue 2022-08-30 12:13:34 UTC. -- Aug 30 11:43:14.381779 dv-cinder-839768-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 30 11:43:14.392102 dv-cinder-839768-2-smb devstack@keystone.service[81538]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 30 11:43:14.394130 dv-cinder-839768-2-smb devstack@keystone.service[81538]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 11:43:14 2022] *** Aug 30 11:43:14.394130 dv-cinder-839768-2-smb devstack@keystone.service[81538]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 11:43:14.394130 dv-cinder-839768-2-smb devstack@keystone.service[81538]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 11:43:14.394130 dv-cinder-839768-2-smb devstack@keystone.service[81538]: nodename: dv-cinder-839768-2-smb Aug 30 11:43:14.394130 dv-cinder-839768-2-smb devstack@keystone.service[81538]: machine: x86_64 Aug 30 11:43:14.394130 dv-cinder-839768-2-smb devstack@keystone.service[81538]: clock source: unix Aug 30 11:43:14.394130 dv-cinder-839768-2-smb devstack@keystone.service[81538]: pcre jit disabled Aug 30 11:43:14.394130 dv-cinder-839768-2-smb devstack@keystone.service[81538]: detected number of CPU cores: 4 Aug 30 11:43:14.394130 dv-cinder-839768-2-smb devstack@keystone.service[81538]: current working directory: / Aug 30 11:43:14.394130 dv-cinder-839768-2-smb devstack@keystone.service[81538]: detected binary path: /usr/bin/uwsgi-core Aug 30 11:43:14.394130 dv-cinder-839768-2-smb devstack@keystone.service[81538]: your processes number limit is 47680 Aug 30 11:43:14.394703 dv-cinder-839768-2-smb devstack@keystone.service[81538]: your memory page size is 4096 bytes Aug 30 11:43:14.394703 dv-cinder-839768-2-smb devstack@keystone.service[81538]: detected max file descriptor number: 2048 Aug 30 11:43:14.394703 dv-cinder-839768-2-smb devstack@keystone.service[81538]: lock engine: pthread robust mutexes Aug 30 11:43:14.394703 dv-cinder-839768-2-smb devstack@keystone.service[81538]: thunder lock: enabled Aug 30 11:43:14.394703 dv-cinder-839768-2-smb devstack@keystone.service[81538]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 30 11:43:14.394703 dv-cinder-839768-2-smb devstack@keystone.service[81538]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 11:43:14.432534 dv-cinder-839768-2-smb devstack@keystone.service[81538]: Python main interpreter initialized at 0x560153c1d9c0 Aug 30 11:43:14.432534 dv-cinder-839768-2-smb devstack@keystone.service[81538]: python threads support enabled Aug 30 11:43:14.432534 dv-cinder-839768-2-smb devstack@keystone.service[81538]: your server socket listen backlog is limited to 100 connections Aug 30 11:43:14.432534 dv-cinder-839768-2-smb devstack@keystone.service[81538]: your mercy for graceful operations on workers is 90 seconds Aug 30 11:43:14.432918 dv-cinder-839768-2-smb devstack@keystone.service[81538]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 11:43:14.432996 dv-cinder-839768-2-smb devstack@keystone.service[81538]: *** Operational MODE: preforking *** Aug 30 11:43:14.433218 dv-cinder-839768-2-smb devstack@keystone.service[81538]: *** uWSGI is running in multiple interpreter mode *** Aug 30 11:43:14.433218 dv-cinder-839768-2-smb devstack@keystone.service[81538]: spawned uWSGI master process (pid: 81538) Aug 30 11:43:14.433551 dv-cinder-839768-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 30 11:43:14.438239 dv-cinder-839768-2-smb devstack@keystone.service[81538]: spawned uWSGI worker 1 (pid: 81553, cores: 1) Aug 30 11:43:14.438239 dv-cinder-839768-2-smb devstack@keystone.service[81538]: spawned uWSGI worker 2 (pid: 81554, cores: 1) Aug 30 11:43:14.438239 dv-cinder-839768-2-smb devstack@keystone.service[81538]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 11:43:18.659961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 11:43:18.659961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: from cryptography.utils import int_from_bytes Aug 30 11:43:18.660828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 11:43:18.660828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: from cryptography.utils import int_from_bytes Aug 30 11:43:18.661252 dv-cinder-839768-2-smb devstack@keystone.service[81554]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 11:43:18.661252 dv-cinder-839768-2-smb devstack@keystone.service[81554]: from cryptography.utils import int_from_bytes Aug 30 11:43:18.661376 dv-cinder-839768-2-smb devstack@keystone.service[81553]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 11:43:18.661376 dv-cinder-839768-2-smb devstack@keystone.service[81553]: from cryptography.utils import int_from_bytes Aug 30 11:43:18.709524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 11:43:18.709726 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 11:43:18.709822 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 11:43:18.709907 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] command line args: [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 11:43:18.709985 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 11:43:18.710067 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] command line args: [] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 11:43:18.710135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 11:43:18.710313 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ================================================================================ {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 11:43:18.710457 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 11:43:18.710457 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ================================================================================ {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 11:43:18.710594 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] admin_token = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.710719 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] admin_token = **** {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.710811 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] config_dir = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.710996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.711129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] config_dir = [] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.711211 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] config_source = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.711290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.711398 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] debug = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.711497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] config_source = [] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.711497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] debug = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.711623 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.711866 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.711963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.712025 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.712082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.712138 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.712195 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.712257 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.712460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.712569 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.712645 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.712706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] list_limit = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.712849 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_config_append = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.712970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] log_config_append = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.713050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.713111 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.713174 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_dir = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.713238 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] log_dir = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.713296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_file = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.713717 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] log_file = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.713872 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.713980 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.714133 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.714286 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.714430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.714510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.714638 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.714716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.714783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.714885 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.714962 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.715033 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.715200 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.715385 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.715484 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.715623 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.715710 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.715840 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.715917 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.716104 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.716272 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.716370 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.716453 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.716538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.716612 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.716734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.716810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.717031 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.717214 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.717311 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.717517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.717664 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] publish_errors = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.717746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.717912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.718036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] publish_errors = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.718124 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.718498 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.718587 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.718661 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.718784 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.718861 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.718997 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.719119 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.719201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] standard_threads = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.719274 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.719351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.719450 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] standard_threads = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.719538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.719612 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.719683 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.719797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.719871 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] use_journal = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.719949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.720073 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] use_json = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.720149 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] use_journal = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.720218 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] use_stderr = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.720339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] use_json = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.720415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] use_syslog = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.720526 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] use_stderr = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.720610 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.720682 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] use_syslog = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.720753 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.720822 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:43:18.720891 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.720961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.721124 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.721258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.721339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.721419 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.721571 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.721708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.721857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.721944 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.722031 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.722105 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.722250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.722375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.722473 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.722549 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.722704 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.722829 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.722907 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.722988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.723160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.723285 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.723395 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.723473 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.723618 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.723718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.723854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.723938 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.724087 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.724169 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.724318 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.724408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.724545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.724627 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.724796 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.724879 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.725031 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.725194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.725270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.725341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.725481 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.725563 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.725728 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.725819 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.725971 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.726053 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.726214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.726296 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.726437 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.726527 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.726662 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.726751 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.726889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.726971 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.727114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.727204 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.727341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.727465 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.727591 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.727670 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.727814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.727903 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.728049 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.728127 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.728279 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.728356 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.728519 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.728604 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.728755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.728847 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.728983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.729066 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.729209 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.729294 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.729438 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.729516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.729665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.729741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.729886 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.729974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.730109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.730186 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.730331 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.730407 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.730635 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.730784 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.730861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.730932 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.731099 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.731175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.731326 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.731447 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.731582 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.731660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.731808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.731887 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.732032 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.732117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.732259 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.732336 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.732488 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.732564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.732713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.732798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.732946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.733022 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.733179 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.733256 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.733408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.733496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.733636 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.733714 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.733860 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.733969 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.734075 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.734170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.734292 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.734392 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.734523 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.734624 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.734754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.734879 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.734961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.735045 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.735203 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.735290 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.735530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.735615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.735707 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.735782 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.735898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.735980 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.736107 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.736193 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.736355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.736435 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.736591 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.736680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.736832 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.736913 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.737073 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.737153 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.737304 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.737385 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.737532 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.737613 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.737758 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.737840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.737985 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.738063 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.738217 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.738296 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.738448 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.738529 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.738682 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.738760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.738909 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.738986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.739138 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.739220 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.739381 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.739462 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.739621 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.739700 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.739853 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.739933 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.740078 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.740158 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.740305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.740379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.740537 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.740618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.740777 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.740855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.741014 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.741090 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.741246 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.741325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.741479 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.741561 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.741711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.741788 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.741942 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.742018 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.742156 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.742242 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.742385 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.742472 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.742608 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.742695 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.742831 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.742909 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.743060 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.743144 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.743290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.743402 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.743545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.743624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.743772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.743852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.744001 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.744087 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.744231 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.744309 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.744464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.744541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.744692 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.744779 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.744943 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.745033 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.745177 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.745262 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.745406 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.external = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.745506 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.745632 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.745724 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] auth.external = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.745856 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.745934 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.746163 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.746247 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.746391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.password = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.746480 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.746621 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.token = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.746701 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] auth.password = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.746892 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] auth.token = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.746978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.747129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.747220 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.747412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.747498 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.747627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.747706 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.747856 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.747946 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.748096 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.748181 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.748325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.748404 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.748550 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.748638 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.748785 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] credential.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.748865 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.749025 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.749106 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.749265 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.749352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.749505 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.749593 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.749740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.749818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.749970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.750056 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.750201 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.750278 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.750443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.750522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.750677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.750765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.750915 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.750993 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.751162 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.751241 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.751439 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.751533 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.751690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.751768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.751925 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.752015 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.752171 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.752257 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.752399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.752478 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.752632 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.752711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] federation.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.752861 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.752952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.753103 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.753183 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.753325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.753403 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.753554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.753634 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.753786 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.753864 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.754013 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.754091 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.754249 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.754328 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.754477 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.754554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.754714 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.754791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.754944 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.755024 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.755175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.755252 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.755425 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.755505 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.755659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.755735 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.755885 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.755964 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.756114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.756193 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.756341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.756421 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.756567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.756645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.756795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.756873 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.757029 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.757110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.757271 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.757349 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.757498 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.757578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.757724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.757805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.757947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.758025 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.758174 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.758253 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.758413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.758493 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.758654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.758732 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.758896 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.758977 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.759134 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.759214 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.759389 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.759470 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.759643 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.759721 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.759878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.759959 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.760105 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.760184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.760332 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.760411 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.760555 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.760634 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.760778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.760892 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.761006 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.761084 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.761232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.761313 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.761466 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.761545 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.761750 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.761892 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.761978 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.762052 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.762206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.762286 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.762446 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.762532 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.762673 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.762752 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.762913 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.762992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.763137 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.763227 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.763384 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.763464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.763612 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.763691 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.763833 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.763924 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.764065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.764143 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.764295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.764373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.764523 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.764609 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.764751 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.764829 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.764984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.765063 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.765221 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.765307 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.765447 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.765527 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.765673 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.765752 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.765899 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.765987 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.766143 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.766221 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.766375 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.766454 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.766603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.766693 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.766832 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.766910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.767058 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.767137 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.767280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.767385 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.767540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.767621 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.767771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.767848 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.768011 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.768101 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.768247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.768325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.768484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.768563 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.768712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.768799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.768937 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.769016 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.769159 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.769236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.769385 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.769471 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.769615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.769694 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.769852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.769950 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.770059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.770151 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.770297 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.770378 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.770533 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.770656 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.770770 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.770857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.771004 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.771082 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.771231 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.771309 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.771475 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.771570 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.771722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.771807 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.771954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.772032 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.772183 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.772271 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.772413 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.772491 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.772645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.772724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.772888 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.772974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.773119 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.773199 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.773351 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.773428 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.773582 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.773668 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.773817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.773895 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.774046 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.774124 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.774276 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.774363 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.774505 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.774583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.774733 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.774851 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.775076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.775164 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.775304 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.775399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.775558 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.775636 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.775793 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.775885 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.776037 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.776115 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] resource.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.776282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.776362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.776516 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.776604 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.776746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.776825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.776993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.777072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.777224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.777310 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.777485 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.777564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.777718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.777970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.777970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.778194 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.778267 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.778338 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] role.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.778409 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] role.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.778474 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] role.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.778620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.778700 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] role.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.778845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.778923 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.779090 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.779170 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.779331 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.779473 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.779597 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.779677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.779837 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.779916 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.780078 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.780158 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.780315 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.780393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.780555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.780633 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.780780 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.780859 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.781014 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.781093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.781407 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.781489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.781571 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.781645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.781724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.781797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.781940 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.782079 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.782317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.782396 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.782547 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.782624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.782794 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.782873 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.783039 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.783119 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.783279 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.783376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.783534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.783625 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.783765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.783843 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.784015 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.784093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.784248 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.784336 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.784481 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.784560 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.784710 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.784788 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.784936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.785022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.785162 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.785240 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.785409 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.785487 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.785648 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.785734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.785880 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.785960 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.786111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.786190 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.786338 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.786426 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.786561 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.786639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.786792 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.786869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] token.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.787024 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.787110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.787257 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.787335 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.787522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.787603 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.787761 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.787852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.787995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.788074 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.788225 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.788303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.788463 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.788550 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.788700 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.788778 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.788930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.789008 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.789165 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.789251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.789395 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.789473 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.789623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.789700 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.789863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.789951 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.790116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.790206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.790344 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.790433 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.790583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.790664 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.790843 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.connection = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.790973 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.791105 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.791241 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.connection = **** {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.791425 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.791551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.791679 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.791803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.791939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.792065 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.792146 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.792306 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.792432 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.792555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.792688 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.792820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.792999 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.793137 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.793261 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.793505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.793644 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.793771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.793896 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.794019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.794144 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.794274 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.794407 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.794531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.794655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.794779 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.794904 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.795041 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.795175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.795298 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.795439 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.795561 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.795683 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.795804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.795936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 11:43:18.796059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:43:18.796059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 11:43:18.823997 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:18.824276 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:18.824503 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:18.824735 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:18.824962 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:18.825190 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:18.832784 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:18.833450 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:18.860991 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:18.861218 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:18.861310 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:18.861477 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:18.913928 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:18.914088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:18.962130 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:18.962280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:18.962540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:18.962627 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.123727 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.123957 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.124156 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.124404 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.124571 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.124669 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.124792 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.124878 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.125002 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.125249 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.125431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.125679 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.147619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.147780 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.147873 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.148015 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.148150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.148221 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.148302 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.148457 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.148600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.148673 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.148755 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.148827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.148889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.149061 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.159849 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.160235 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.172373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.172506 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.172578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.172656 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.172735 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.172955 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.173080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.173150 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.173226 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.173387 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.173514 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.173584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.173645 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.173733 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 11:43:19.190212 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.190405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 11:43:19.190601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.190725 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.190794 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 11:43:19.190899 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 11:43:19.191164 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.191292 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.191467 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 11:43:19.191599 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.191748 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.191840 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.191963 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.192043 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.192161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.192361 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.201552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.201800 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.201898 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.202093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.202220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.202320 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.202398 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.202623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.209259 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.209563 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.212132 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.212418 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.212541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.212697 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.212828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.212979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.213126 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.213199 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.213274 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.213859 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.213984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.214147 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.214284 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.214423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.214546 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.214707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.214996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.215149 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.215227 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.215344 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.215441 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.215515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.237828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.237955 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.239267 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.239423 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.239562 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.239663 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.244034 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.244163 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.244301 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.244380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.244571 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.244699 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.250988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.251114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.251243 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.251327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.255151 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.255279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.255441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.255532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.255739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.255885 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.256024 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.256106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.256227 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.256305 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.258180 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.258308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.258447 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.258528 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.258728 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.258855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.273957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.274086 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.274207 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.274292 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.278026 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.278174 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.281123 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.281254 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.281420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.281547 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.285647 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.285823 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.288710 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.288838 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.291735 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.291884 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.292024 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.292105 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.292296 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.292423 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.292574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.292658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.292844 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.293040 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.293284 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.293478 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.308781 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.309071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.309339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.309609 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.309734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.310148 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.310421 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.310686 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.316385 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.317329 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.318036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.318964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.319579 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.319854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.320512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.320785 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.322441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.322729 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.323014 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.323292 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.323492 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.323606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.323743 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.323949 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.324251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.324563 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.336695 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.336987 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.337353 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.337543 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.337687 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.337840 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.337966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.338094 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.338216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.338340 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.338822 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.338953 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.339272 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.339602 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.354593 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.355224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.357727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.358645 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.360595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.361515 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.362033 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.362940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.363593 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.363905 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.364176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.364415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.364731 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.365107 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.370569 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.371574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.372162 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.373175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.375037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.375337 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.375643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.375924 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.376113 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.376401 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.376765 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.376964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.383795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.384080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.384360 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.384840 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.385132 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.385414 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.391316 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.391624 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.391902 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.392175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.392317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 11:43:19.392402 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.392614 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.392780 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.392866 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.392941 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.393156 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.393283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.393378 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.393466 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.393686 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.393814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.393911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.393994 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.394216 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.394345 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.394427 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.394501 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.394733 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.394860 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.394972 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.395230 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.395517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.395797 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 11:43:19.428310 dv-cinder-839768-2-smb devstack@keystone.service[81553]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560153c1d9c0 pid: 81553 (default app) Aug 30 11:43:19.429441 dv-cinder-839768-2-smb devstack@keystone.service[81554]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560153c1d9c0 pid: 81554 (default app) Aug 30 11:43:19.431794 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b4b27-f1ef-4d35-946f-ed5ff8e6335f None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:19.432078 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b4b27-f1ef-4d35-946f-ed5ff8e6335f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:19.432308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b4b27-f1ef-4d35-946f-ed5ff8e6335f None None] PATH_INFO: `/v3` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:19.438521 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Tue Aug 30 11:43:19 2022] GET /identity/v3/ => generated 255 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:26.046716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c2b1d-eb8d-453b-9679-b3b0a8d1d129 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:26.047268 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c2b1d-eb8d-453b-9679-b3b0a8d1d129 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:26.047268 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c2b1d-eb8d-453b-9679-b3b0a8d1d129 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:26.051610 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:26.057204 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf8758-d45e-4c30-87d7-97fabb93ebf3 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:26.057657 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf8758-d45e-4c30-87d7-97fabb93ebf3 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:26.057798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf8758-d45e-4c30-87d7-97fabb93ebf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:26.126744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: INFO dbcounter [None req-f9bf8758-d45e-4c30-87d7-97fabb93ebf3 None None] Registered counter for database keystone Aug 30 11:43:26.148026 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG oslo_db.sqlalchemy.engines [None req-f9bf8758-d45e-4c30-87d7-97fabb93ebf3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 11:43:26.160944 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writer thread running {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 11:43:26.360068 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG passlib.handlers.bcrypt [None req-f9bf8758-d45e-4c30-87d7-97fabb93ebf3 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81553) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 11:43:26.360453 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG passlib.handlers.bcrypt [None req-f9bf8758-d45e-4c30-87d7-97fabb93ebf3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81553) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 11:43:26.418922 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f9bf8758-d45e-4c30-87d7-97fabb93ebf3 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:26.420556 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f9bf8758-d45e-4c30-87d7-97fabb93ebf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:26.573895 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 518 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 30 11:43:27.072572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c2b1d-eb8d-453b-9679-b3b0a8d1d129 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:27.144200 dv-cinder-839768-2-smb devstack@keystone.service[81554]: INFO dbcounter [None req-b36c2b1d-eb8d-453b-9679-b3b0a8d1d129 None None] Registered counter for database keystone Aug 30 11:43:27.166779 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG oslo_db.sqlalchemy.engines [None req-b36c2b1d-eb8d-453b-9679-b3b0a8d1d129 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81554) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 11:43:27.178855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writer thread running {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 11:43:27.300197 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c2b1d-eb8d-453b-9679-b3b0a8d1d129 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:27.305619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0e8ca-769e-45b6-a8ff-ae8b4d3367f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:27.306255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0e8ca-769e-45b6-a8ff-ae8b4d3367f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:27.306532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0e8ca-769e-45b6-a8ff-ae8b4d3367f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:27.306804 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0e8ca-769e-45b6-a8ff-ae8b4d3367f4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:27.315936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0e8ca-769e-45b6-a8ff-ae8b4d3367f4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:27.368320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fea0e8ca-769e-45b6-a8ff-ae8b4d3367f4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 11:43:27.368602 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0e8ca-769e-45b6-a8ff-ae8b4d3367f4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:27.378863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Tue Aug 30 11:43:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 11:43:27.388777 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf8758-d45e-4c30-87d7-97fabb93ebf3 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:27.409995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf8758-d45e-4c30-87d7-97fabb93ebf3 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:27.415760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2de44b-5233-473e-9c2e-47d171cb8aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:27.416929 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2de44b-5233-473e-9c2e-47d171cb8aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:27.417207 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2de44b-5233-473e-9c2e-47d171cb8aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:27.417474 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2de44b-5233-473e-9c2e-47d171cb8aa0 admin admin] PATH_INFO: `/v3/projects/801a00d9234a4360978c5c3ff97e0dc2` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:27.419542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2de44b-5233-473e-9c2e-47d171cb8aa0 admin admin] RBAC: Authorizing `identity:get_project(project_id=801a00d9234a4360978c5c3ff97e0dc2)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:27.473612 dv-cinder-839768-2-smb devstack@keystone.service[81553]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9f2de44b-5233-473e-9c2e-47d171cb8aa0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 11:43:27.473956 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2de44b-5233-473e-9c2e-47d171cb8aa0 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:27.478655 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Tue Aug 30 11:43:27 2022] GET /identity/v3/projects/801a00d9234a4360978c5c3ff97e0dc2 => generated 344 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:29.376596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78060a-0847-4130-a9e7-3525d2991db5 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:29.377398 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78060a-0847-4130-a9e7-3525d2991db5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:29.377398 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78060a-0847-4130-a9e7-3525d2991db5 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:29.384221 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:29.390160 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e9664-a1f9-4c6b-8e10-4708c5ba51b2 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:29.390568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e9664-a1f9-4c6b-8e10-4708c5ba51b2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:29.390677 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e9664-a1f9-4c6b-8e10-4708c5ba51b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:29.412333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-050e9664-a1f9-4c6b-8e10-4708c5ba51b2 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:29.413845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-050e9664-a1f9-4c6b-8e10-4708c5ba51b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:29.422411 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 30 11:43:29.684014 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78060a-0847-4130-a9e7-3525d2991db5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:29.700351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78060a-0847-4130-a9e7-3525d2991db5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:29.705971 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ee0b9-e382-478a-b37f-846f60cbe5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:29.706582 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ee0b9-e382-478a-b37f-846f60cbe5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:29.706867 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ee0b9-e382-478a-b37f-846f60cbe5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:29.707138 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ee0b9-e382-478a-b37f-846f60cbe5b8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:29.715400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ee0b9-e382-478a-b37f-846f60cbe5b8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:29.717200 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ee0b9-e382-478a-b37f-846f60cbe5b8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:29.726254 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Tue Aug 30 11:43:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 11:43:29.734417 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e9664-a1f9-4c6b-8e10-4708c5ba51b2 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:29.743693 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e9664-a1f9-4c6b-8e10-4708c5ba51b2 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:29.749953 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273e538-e0f8-4628-b50b-7eaf9b23a102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:29.750862 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273e538-e0f8-4628-b50b-7eaf9b23a102 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:29.751250 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273e538-e0f8-4628-b50b-7eaf9b23a102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:29.751630 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273e538-e0f8-4628-b50b-7eaf9b23a102 admin admin] PATH_INFO: `/v3/users/fcaa90c0553848528e601e03ebda1656` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:29.753938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4273e538-e0f8-4628-b50b-7eaf9b23a102 admin admin] RBAC: Authorizing `identity:get_user(user_id=fcaa90c0553848528e601e03ebda1656)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:29.756942 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4273e538-e0f8-4628-b50b-7eaf9b23a102 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:29.759309 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Tue Aug 30 11:43:29 2022] GET /identity/v3/users/fcaa90c0553848528e601e03ebda1656 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:31.701260 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71464a-076c-4925-8d97-4ef4a1cc8653 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:31.701834 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71464a-076c-4925-8d97-4ef4a1cc8653 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:31.701834 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71464a-076c-4925-8d97-4ef4a1cc8653 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:31.703287 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:31.708631 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f72ccb-efe4-4f25-8b66-498fea207ad2 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:31.709065 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f72ccb-efe4-4f25-8b66-498fea207ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:31.709158 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f72ccb-efe4-4f25-8b66-498fea207ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:31.729000 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f6f72ccb-efe4-4f25-8b66-498fea207ad2 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:31.730293 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f6f72ccb-efe4-4f25-8b66-498fea207ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:31.736974 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8a09e-edc7-4570-aa0f-2ac08567ab10 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:31.737260 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8a09e-edc7-4570-aa0f-2ac08567ab10 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:31.737534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8a09e-edc7-4570-aa0f-2ac08567ab10 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:31.738862 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:31.743943 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf51b5-ab8d-44bf-8fc2-5b96e0fcd202 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:31.744226 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf51b5-ab8d-44bf-8fc2-5b96e0fcd202 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:31.744497 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf51b5-ab8d-44bf-8fc2-5b96e0fcd202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:31.786526 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG passlib.handlers.bcrypt [None req-06bf51b5-ab8d-44bf-8fc2-5b96e0fcd202 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81554) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 11:43:31.786919 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG passlib.handlers.bcrypt [None req-06bf51b5-ab8d-44bf-8fc2-5b96e0fcd202 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81554) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 11:43:31.816359 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:43:31.835551 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-06bf51b5-ab8d-44bf-8fc2-5b96e0fcd202 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:31.837127 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-06bf51b5-ab8d-44bf-8fc2-5b96e0fcd202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:31.939400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:43:32.076651 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f72ccb-efe4-4f25-8b66-498fea207ad2 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:32.102857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:32.188335 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f72ccb-efe4-4f25-8b66-498fea207ad2 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:32.202582 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf51b5-ab8d-44bf-8fc2-5b96e0fcd202 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:32.225237 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df42f07-373b-486d-8187-263ed196ba72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:32.225886 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df42f07-373b-486d-8187-263ed196ba72 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:32.226135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df42f07-373b-486d-8187-263ed196ba72 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:32.226405 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df42f07-373b-486d-8187-263ed196ba72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:32.238137 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df42f07-373b-486d-8187-263ed196ba72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:43:32.246983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-1df42f07-373b-486d-8187-263ed196ba72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:43:32.246983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:43:32.246983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:43:32.246983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:43:32.246983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:43:32.246983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:43:32.246983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:43:32.246983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:43:32.246983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:43:32.246983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:43:32.246983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:43:32.246983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:43:32.246983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:43:32.246983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:43:32.246983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:43:32.246983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:43:32.248040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:43:32.248040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:43:32.248040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:43:32.248040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:43:32.248040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:43:32.248040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:43:32.248040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:43:32.248040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:43:32.248040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:43:32.248040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:43:32.248040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:43:32.248040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:43:32.248040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:43:32.248040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:43:32.248040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:43:32.248040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:43:32.249523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:43:32.249523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:43:32.249523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:43:32.249523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:43:32.249523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:43:32.249523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:43:32.249523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:43:32.249523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:43:32.249523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:43:32.249523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:43:32.249523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:43:32.249523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:43:32.249523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:43:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:43:32.254033 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df42f07-373b-486d-8187-263ed196ba72 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:32.304921 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf51b5-ab8d-44bf-8fc2-5b96e0fcd202 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:32.307208 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:32.335918 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:32.344396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a0bb7-b09f-4158-8c7b-6d2f49fb3c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:32.345271 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a0bb7-b09f-4158-8c7b-6d2f49fb3c47 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:32.345554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a0bb7-b09f-4158-8c7b-6d2f49fb3c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:32.345831 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a0bb7-b09f-4158-8c7b-6d2f49fb3c47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:32.355589 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df42f07-373b-486d-8187-263ed196ba72 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:32.388860 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0eda1-86bb-4f97-89ad-c46c3855aba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:32.389599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0eda1-86bb-4f97-89ad-c46c3855aba2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:32.389886 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0eda1-86bb-4f97-89ad-c46c3855aba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:32.390154 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0eda1-86bb-4f97-89ad-c46c3855aba2 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:32.390813 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0eda1-86bb-4f97-89ad-c46c3855aba2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:32.391109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0eda1-86bb-4f97-89ad-c46c3855aba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:32.392567 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0eda1-86bb-4f97-89ad-c46c3855aba2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:32.404008 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:43:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:43:32.409709 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0eda1-86bb-4f97-89ad-c46c3855aba2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:32.413508 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a0bb7-b09f-4158-8c7b-6d2f49fb3c47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:32.415034 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a0bb7-b09f-4158-8c7b-6d2f49fb3c47 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:32.507929 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0eda1-86bb-4f97-89ad-c46c3855aba2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:32.517985 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:43:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:43:32.524022 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a0bb7-b09f-4158-8c7b-6d2f49fb3c47 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:32.527395 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:32.544264 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97088e-2d02-408b-ae0e-c21a63e33db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:32.544918 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97088e-2d02-408b-ae0e-c21a63e33db2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:32.545191 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97088e-2d02-408b-ae0e-c21a63e33db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:32.545459 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97088e-2d02-408b-ae0e-c21a63e33db2 None admin] PATH_INFO: `/v3/users/fcaa90c0553848528e601e03ebda1656` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:32.546815 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97088e-2d02-408b-ae0e-c21a63e33db2 None admin] RBAC: Authorizing `identity:get_user(user_id=fcaa90c0553848528e601e03ebda1656)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:32.548345 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97088e-2d02-408b-ae0e-c21a63e33db2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:32.549936 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:43:32 2022] GET /identity/v3/users/fcaa90c0553848528e601e03ebda1656 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:32.555583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97088e-2d02-408b-ae0e-c21a63e33db2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:32.570665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:32.632448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a0bb7-b09f-4158-8c7b-6d2f49fb3c47 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:32.655542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97088e-2d02-408b-ae0e-c21a63e33db2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:32.666172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b836e-40fb-4dc6-9012-1759e80741d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:32.667040 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b836e-40fb-4dc6-9012-1759e80741d3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:32.667316 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b836e-40fb-4dc6-9012-1759e80741d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:32.667601 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b836e-40fb-4dc6-9012-1759e80741d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:32.686073 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b836e-40fb-4dc6-9012-1759e80741d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:32.687717 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b836e-40fb-4dc6-9012-1759e80741d3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:32.690334 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551ace9-f243-4f1b-9cba-07a731e3a836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:32.690964 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551ace9-f243-4f1b-9cba-07a731e3a836 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:32.691238 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551ace9-f243-4f1b-9cba-07a731e3a836 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:32.691545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551ace9-f243-4f1b-9cba-07a731e3a836 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:32.692659 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551ace9-f243-4f1b-9cba-07a731e3a836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:32.694113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551ace9-f243-4f1b-9cba-07a731e3a836 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:32.695693 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 10/18] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:43:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:43:32.701409 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551ace9-f243-4f1b-9cba-07a731e3a836 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:32.705755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ac2b836e-40fb-4dc6-9012-1759e80741d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:43:32.705755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:43:32.705755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:43:32.705755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:43:32.705755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:43:32.705755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:43:32.705755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:43:32.705755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:43:32.705755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:43:32.705755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:43:32.705755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:43:32.705755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:43:32.705755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:43:32.705755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:43:32.705755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:43:32.705755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:43:32.706992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:43:32.706992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:43:32.706992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:43:32.706992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:43:32.706992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:43:32.706992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:43:32.706992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:43:32.706992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:43:32.706992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:43:32.706992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:43:32.706992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:43:32.706992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:43:32.706992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:43:32.706992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:43:32.706992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:43:32.706992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:43:32.706992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:43:32.707891 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:43:32.707891 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:43:32.707891 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:43:32.707891 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 9/19] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:43:32.712776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b836e-40fb-4dc6-9012-1759e80741d3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:32.768730 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:32.782793 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:32.802390 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551ace9-f243-4f1b-9cba-07a731e3a836 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:32.814475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b836e-40fb-4dc6-9012-1759e80741d3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:32.837752 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cb07b-ca8a-41f1-aeaa-d7108ee55b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:32.838438 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cb07b-ca8a-41f1-aeaa-d7108ee55b90 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:32.838720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cb07b-ca8a-41f1-aeaa-d7108ee55b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:32.838990 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cb07b-ca8a-41f1-aeaa-d7108ee55b90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:32.840100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729cb07b-ca8a-41f1-aeaa-d7108ee55b90 None admin] RBAC: Adding query filter params (role.id=4f4d8a6881ca496bb2d4845a6592fea8, scope.domain.id=default, user.id=fcaa90c0553848528e601e03ebda1656) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:32.840407 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729cb07b-ca8a-41f1-aeaa-d7108ee55b90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:32.841884 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729cb07b-ca8a-41f1-aeaa-d7108ee55b90 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:32.847651 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce58362-a934-4866-aa57-17538fc8d212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:32.848266 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce58362-a934-4866-aa57-17538fc8d212 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:32.848543 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 11/20] 10.222.0.27 () {56 vars in 1322 bytes} [Tue Aug 30 11:43:32 2022] GET /identity/v3/role_assignments?user.id=fcaa90c0553848528e601e03ebda1656&scope.domain.id=default&role.id=4f4d8a6881ca496bb2d4845a6592fea8 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:43:32.848719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce58362-a934-4866-aa57-17538fc8d212 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:32.848816 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce58362-a934-4866-aa57-17538fc8d212 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:32.849440 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce58362-a934-4866-aa57-17538fc8d212 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:32.849720 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce58362-a934-4866-aa57-17538fc8d212 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:32.851132 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce58362-a934-4866-aa57-17538fc8d212 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:32.873839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 10/21] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:34.927586 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74318599-1122-421f-bf26-fd280f049760 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:34.928140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74318599-1122-421f-bf26-fd280f049760 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:34.928140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74318599-1122-421f-bf26-fd280f049760 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:34.929489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 12/22] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:34.931083 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867a890-f3be-406b-8d31-680b60195927 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:34.931498 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867a890-f3be-406b-8d31-680b60195927 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:34.931667 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867a890-f3be-406b-8d31-680b60195927 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:34.933138 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 11/23] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:34.935877 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70293c-a93e-43d9-b4d4-8f094976b331 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:34.936160 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70293c-a93e-43d9-b4d4-8f094976b331 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:34.936522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70293c-a93e-43d9-b4d4-8f094976b331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:34.939011 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641272ce-b7a8-4718-8c96-2e9b4b5c4556 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:34.939285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641272ce-b7a8-4718-8c96-2e9b4b5c4556 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:34.939593 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641272ce-b7a8-4718-8c96-2e9b4b5c4556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:34.972157 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-641272ce-b7a8-4718-8c96-2e9b4b5c4556 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:34.973712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-641272ce-b7a8-4718-8c96-2e9b4b5c4556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:34.979380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-4a70293c-a93e-43d9-b4d4-8f094976b331 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:34.979380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4a70293c-a93e-43d9-b4d4-8f094976b331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:35.125679 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 12/24] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:43:35.149676 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 13/25] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:43:35.494654 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3c7e8-ac1b-4007-b05c-c4d3485bddbb None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:35.495378 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3c7e8-ac1b-4007-b05c-c4d3485bddbb None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:35.495865 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3c7e8-ac1b-4007-b05c-c4d3485bddbb None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:35.497420 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 13/26] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:35.503275 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07805c-2450-4af9-ac04-0fc4a43eb13c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:35.503593 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07805c-2450-4af9-ac04-0fc4a43eb13c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:35.503869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07805c-2450-4af9-ac04-0fc4a43eb13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:35.530916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3c7e8-ac1b-4007-b05c-c4d3485bddbb None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:35.535473 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-1e07805c-2450-4af9-ac04-0fc4a43eb13c None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:35.542912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1e07805c-2450-4af9-ac04-0fc4a43eb13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:35.630500 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:35.696749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3c7e8-ac1b-4007-b05c-c4d3485bddbb None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:35.696969 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 14/27] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:43:35.698397 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae36a2-8c6d-4e9d-9434-33e55af73205 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:35.698693 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae36a2-8c6d-4e9d-9434-33e55af73205 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:35.698971 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae36a2-8c6d-4e9d-9434-33e55af73205 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:35.700451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 15/28] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:35.700948 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae36a2-8c6d-4e9d-9434-33e55af73205 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:35.710058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:35.758704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76fdb3-758e-4633-a85e-6549c1485837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:35.759261 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76fdb3-758e-4633-a85e-6549c1485837 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:35.760212 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76fdb3-758e-4633-a85e-6549c1485837 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:35.760490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76fdb3-758e-4633-a85e-6549c1485837 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:35.785579 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76fdb3-758e-4633-a85e-6549c1485837 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:43:35.794757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-1e76fdb3-758e-4633-a85e-6549c1485837 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:43:35.794757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:43:35.794757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:43:35.794757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:43:35.794757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:43:35.794757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:43:35.794757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:43:35.794757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:43:35.794757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:43:35.794757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:43:35.794757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:43:35.794757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:43:35.794757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:43:35.794757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:43:35.794757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:43:35.794757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:43:35.796013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:43:35.796013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:43:35.796013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:43:35.796013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:43:35.796013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:43:35.796013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:43:35.796013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:43:35.796013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:43:35.796013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:43:35.796013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:43:35.796013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:43:35.796013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:43:35.796013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:43:35.796013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:43:35.796013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:43:35.796013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:43:35.796760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:43:35.796760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:43:35.796760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:43:35.796760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:43:35.796760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:43:35.796760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:43:35.796760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:43:35.796760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:43:35.796760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:43:35.796760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:43:35.796760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:43:35.796760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:43:35.796760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 14/29] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:43:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:43:35.797379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b50c3b-21d8-4032-a034-6ebdd17ff64b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:35.798098 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b50c3b-21d8-4032-a034-6ebdd17ff64b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:35.800394 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b50c3b-21d8-4032-a034-6ebdd17ff64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:35.837893 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-89b50c3b-21d8-4032-a034-6ebdd17ff64b None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:35.841990 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-89b50c3b-21d8-4032-a034-6ebdd17ff64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:35.898178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae36a2-8c6d-4e9d-9434-33e55af73205 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:35.956988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc090a6-57ab-41bd-8ace-1e1cf1455423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:35.957653 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc090a6-57ab-41bd-8ace-1e1cf1455423 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:35.957948 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc090a6-57ab-41bd-8ace-1e1cf1455423 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:35.958221 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc090a6-57ab-41bd-8ace-1e1cf1455423 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:35.979024 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc090a6-57ab-41bd-8ace-1e1cf1455423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:35.980568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc090a6-57ab-41bd-8ace-1e1cf1455423 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:35.988961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 15/30] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:43:35.989585 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b50c3b-21d8-4032-a034-6ebdd17ff64b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:35.999194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-fcc090a6-57ab-41bd-8ace-1e1cf1455423 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:43:35.999194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:43:35.999194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:43:35.999194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:43:35.999194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:43:35.999194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:43:35.999194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:43:35.999194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:43:35.999194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:43:35.999194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:43:35.999194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:43:35.999194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:43:35.999194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:43:35.999194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:43:35.999194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:43:35.999194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:43:36.000101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:43:36.000101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:43:36.000101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:43:36.000101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:43:36.000101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:43:36.000101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:43:36.000101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:43:36.000101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:43:36.000101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:43:36.000101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:43:36.000101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:43:36.000101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:43:36.000101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:43:36.000101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:43:36.000101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:43:36.000101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:43:36.000101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:43:36.000887 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:43:36.000887 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:43:36.000887 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:43:36.000887 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 16/31] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:43:36.013547 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc090a6-57ab-41bd-8ace-1e1cf1455423 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:36.027087 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:36.087395 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:36.143381 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b50c3b-21d8-4032-a034-6ebdd17ff64b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:36.143691 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc090a6-57ab-41bd-8ace-1e1cf1455423 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:36.208517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0368920-258f-4838-b4f2-bfdefd0bfb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:36.209151 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0368920-258f-4838-b4f2-bfdefd0bfb4b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:36.209427 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0368920-258f-4838-b4f2-bfdefd0bfb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:36.209702 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0368920-258f-4838-b4f2-bfdefd0bfb4b None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:36.210368 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0368920-258f-4838-b4f2-bfdefd0bfb4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:36.210676 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0368920-258f-4838-b4f2-bfdefd0bfb4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:36.213024 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc12f7d-1e33-4a44-b25e-4ab5b9064c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:36.213646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc12f7d-1e33-4a44-b25e-4ab5b9064c1a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:36.213922 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc12f7d-1e33-4a44-b25e-4ab5b9064c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:36.214542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc12f7d-1e33-4a44-b25e-4ab5b9064c1a None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:36.215190 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc12f7d-1e33-4a44-b25e-4ab5b9064c1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:36.215518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc12f7d-1e33-4a44-b25e-4ab5b9064c1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:36.217076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0368920-258f-4838-b4f2-bfdefd0bfb4b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:36.219114 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc12f7d-1e33-4a44-b25e-4ab5b9064c1a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:36.240428 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 17/32] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:36.241563 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 16/33] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:43:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:36.246346 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc12f7d-1e33-4a44-b25e-4ab5b9064c1a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:36.247181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0368920-258f-4838-b4f2-bfdefd0bfb4b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:36.350987 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc12f7d-1e33-4a44-b25e-4ab5b9064c1a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:36.368639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:36.389609 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a3e57-f169-4273-85bb-6a5750c321be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:36.390505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a3e57-f169-4273-85bb-6a5750c321be None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:36.390930 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a3e57-f169-4273-85bb-6a5750c321be None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:36.391343 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a3e57-f169-4273-85bb-6a5750c321be None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:36.392296 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a3e57-f169-4273-85bb-6a5750c321be None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:36.393975 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a3e57-f169-4273-85bb-6a5750c321be None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:36.398017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:36.402686 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0368920-258f-4838-b4f2-bfdefd0bfb4b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:36.442104 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34114753-ef0d-4678-949c-11f37726beac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:36.443092 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34114753-ef0d-4678-949c-11f37726beac None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:36.443614 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34114753-ef0d-4678-949c-11f37726beac None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:36.444085 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34114753-ef0d-4678-949c-11f37726beac None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:36.445254 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34114753-ef0d-4678-949c-11f37726beac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:36.446920 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34114753-ef0d-4678-949c-11f37726beac None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:36.526934 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 18/34] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Aug 30 11:43:36 2022] POST /identity/v3/roles => generated 219 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:43:36.528060 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a3e57-f169-4273-85bb-6a5750c321be None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:36.589121 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 17/35] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Aug 30 11:43:36 2022] POST /identity/v3/projects => generated 301 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:43:36.591510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34114753-ef0d-4678-949c-11f37726beac None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:36.677022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a3e57-f169-4273-85bb-6a5750c321be None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:36.749724 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338fddc-494a-4ae8-ab37-225908f934cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:36.750747 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338fddc-494a-4ae8-ab37-225908f934cf None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:36.751341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338fddc-494a-4ae8-ab37-225908f934cf None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:36.751726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338fddc-494a-4ae8-ab37-225908f934cf None admin] PATH_INFO: `/v3/users/fcaa90c0553848528e601e03ebda1656` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:36.755407 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338fddc-494a-4ae8-ab37-225908f934cf None admin] RBAC: Authorizing `identity:get_user(user_id=fcaa90c0553848528e601e03ebda1656)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:36.757274 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338fddc-494a-4ae8-ab37-225908f934cf None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:36.763715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 19/36] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:43:36 2022] GET /identity/v3/users/fcaa90c0553848528e601e03ebda1656 => generated 247 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:36.765714 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc4846-4f9c-4e39-acfd-0da1e4ac0dea None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:36.766003 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc4846-4f9c-4e39-acfd-0da1e4ac0dea None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:36.766281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc4846-4f9c-4e39-acfd-0da1e4ac0dea None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:36.767860 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 20/37] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:36.770023 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc4846-4f9c-4e39-acfd-0da1e4ac0dea None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:36.776169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34114753-ef0d-4678-949c-11f37726beac None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:36.825528 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e594797-e020-452a-bcf4-5b4d05a96809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:36.826167 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e594797-e020-452a-bcf4-5b4d05a96809 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:36.826449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e594797-e020-452a-bcf4-5b4d05a96809 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:36.826730 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e594797-e020-452a-bcf4-5b4d05a96809 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:36.828111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e594797-e020-452a-bcf4-5b4d05a96809 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:36.829715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e594797-e020-452a-bcf4-5b4d05a96809 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:36.840605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:36.854262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 18/38] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Aug 30 11:43:36 2022] POST /identity/v3/roles => generated 225 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:43:36.855963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c858d-aafb-4c94-b192-75989b8baf00 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:36.856458 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c858d-aafb-4c94-b192-75989b8baf00 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:36.856936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c858d-aafb-4c94-b192-75989b8baf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:36.877430 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-393c858d-aafb-4c94-b192-75989b8baf00 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:36.879339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-393c858d-aafb-4c94-b192-75989b8baf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:36.883324 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:36.957799 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 19/39] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:43:36.959668 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f58b9-ed63-4c79-9a93-3301ce8f6069 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:36.960157 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f58b9-ed63-4c79-9a93-3301ce8f6069 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:36.960649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f58b9-ed63-4c79-9a93-3301ce8f6069 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:36.961657 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc4846-4f9c-4e39-acfd-0da1e4ac0dea None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:36.962898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 20/40] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:36.975381 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43941d7c-9cfc-4684-bbfe-7e3a9f341897 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:36.975381 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43941d7c-9cfc-4684-bbfe-7e3a9f341897 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:36.975381 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43941d7c-9cfc-4684-bbfe-7e3a9f341897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:37.000561 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-43941d7c-9cfc-4684-bbfe-7e3a9f341897 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:37.001924 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-43941d7c-9cfc-4684-bbfe-7e3a9f341897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:37.010529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf2df2-c5ce-43d1-bf22-1ea9b2986ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:37.011889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf2df2-c5ce-43d1-bf22-1ea9b2986ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:37.012178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf2df2-c5ce-43d1-bf22-1ea9b2986ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:37.012449 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf2df2-c5ce-43d1-bf22-1ea9b2986ef1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:37.014253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf2df2-c5ce-43d1-bf22-1ea9b2986ef1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:37.016418 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf2df2-c5ce-43d1-bf22-1ea9b2986ef1 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:37.018437 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 21/41] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:43:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:37.024449 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf2df2-c5ce-43d1-bf22-1ea9b2986ef1 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:37.087776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 21/42] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:43:37.139807 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf2df2-c5ce-43d1-bf22-1ea9b2986ef1 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:37.154434 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:37.181826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7ae17-1585-4fe1-9148-978114fcbc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:37.182563 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7ae17-1585-4fe1-9148-978114fcbc5e None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:37.182852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7ae17-1585-4fe1-9148-978114fcbc5e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:37.183133 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7ae17-1585-4fe1-9148-978114fcbc5e None admin] PATH_INFO: `/v3/domains/default/users/fcaa90c0553848528e601e03ebda1656/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:37.185140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7ae17-1585-4fe1-9148-978114fcbc5e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=fcaa90c0553848528e601e03ebda1656, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:37.186846 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7ae17-1585-4fe1-9148-978114fcbc5e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:37.204246 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 22/43] 10.222.0.27 () {58 vars in 1361 bytes} [Tue Aug 30 11:43:37 2022] PUT /identity/v3/domains/default/users/fcaa90c0553848528e601e03ebda1656/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:43:37.232399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43941d7c-9cfc-4684-bbfe-7e3a9f341897 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:37.313561 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:37.349130 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43941d7c-9cfc-4684-bbfe-7e3a9f341897 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:37.374495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7ae17-1585-4fe1-9148-978114fcbc5e None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:37.388906 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a29dc-dd7f-44fa-90e7-5dd3052d7fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:37.389666 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a29dc-dd7f-44fa-90e7-5dd3052d7fe0 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:37.389937 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a29dc-dd7f-44fa-90e7-5dd3052d7fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:37.390206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a29dc-dd7f-44fa-90e7-5dd3052d7fe0 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:37.390902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a29dc-dd7f-44fa-90e7-5dd3052d7fe0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:37.392390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a29dc-dd7f-44fa-90e7-5dd3052d7fe0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:37.409573 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 22/44] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Aug 30 11:43:37 2022] POST /identity/v3/roles => generated 223 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:43:37.620879 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7ae17-1585-4fe1-9148-978114fcbc5e None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:37.655781 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e4133-db13-4f28-ac51-a1e9368a5c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:37.656431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e4133-db13-4f28-ac51-a1e9368a5c8c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:37.656716 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e4133-db13-4f28-ac51-a1e9368a5c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:37.656993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e4133-db13-4f28-ac51-a1e9368a5c8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:37.658119 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e4133-db13-4f28-ac51-a1e9368a5c8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:37.659645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e4133-db13-4f28-ac51-a1e9368a5c8c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:37.661261 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 23/45] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:43:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:43:37.667002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a29dc-dd7f-44fa-90e7-5dd3052d7fe0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:37.767656 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a29dc-dd7f-44fa-90e7-5dd3052d7fe0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:37.796598 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:37.802966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b3194-f6b4-4460-9080-d1b1c4943a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:37.803622 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b3194-f6b4-4460-9080-d1b1c4943a41 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:37.803897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b3194-f6b4-4460-9080-d1b1c4943a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:37.804183 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b3194-f6b4-4460-9080-d1b1c4943a41 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:37.804867 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b3194-f6b4-4460-9080-d1b1c4943a41 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:37.806454 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b3194-f6b4-4460-9080-d1b1c4943a41 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:37.835076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 23/46] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Aug 30 11:43:37 2022] POST /identity/v3/projects => generated 312 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:43:39.101257 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afccc45-495d-48bf-bc39-c0abb7b8ad6b None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:39.101835 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afccc45-495d-48bf-bc39-c0abb7b8ad6b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:39.101835 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afccc45-495d-48bf-bc39-c0abb7b8ad6b None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:39.103427 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 24/47] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:39.109733 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466def2-cc33-4550-bf27-c6a10b28f02e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:39.110137 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466def2-cc33-4550-bf27-c6a10b28f02e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:39.110308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466def2-cc33-4550-bf27-c6a10b28f02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:39.129767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3466def2-cc33-4550-bf27-c6a10b28f02e None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:39.130965 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3466def2-cc33-4550-bf27-c6a10b28f02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:39.201523 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 24/48] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:43:39.468719 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afccc45-495d-48bf-bc39-c0abb7b8ad6b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:39.513031 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:39.573905 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afccc45-495d-48bf-bc39-c0abb7b8ad6b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:39.609299 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2293f-b771-483c-93d8-0b2d15332cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:39.609935 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2293f-b771-483c-93d8-0b2d15332cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:39.610214 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2293f-b771-483c-93d8-0b2d15332cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:39.610487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2293f-b771-483c-93d8-0b2d15332cf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:39.621666 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2293f-b771-483c-93d8-0b2d15332cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:43:39.626551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-5fc2293f-b771-483c-93d8-0b2d15332cf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:43:39.626551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:43:39.626551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:43:39.626551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:43:39.626551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:43:39.626551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:43:39.626551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:43:39.626551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:43:39.626551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:43:39.626551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:43:39.626551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:43:39.626551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:43:39.626551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:43:39.626551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:43:39.626551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:43:39.626551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:43:39.627431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:43:39.627431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:43:39.627431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:43:39.627431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:43:39.627431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:43:39.627431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:43:39.627431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:43:39.627431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:43:39.627431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:43:39.627431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:43:39.627431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:43:39.627431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:43:39.627431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:43:39.627431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:43:39.627431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:43:39.627431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:43:39.628211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:43:39.628211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:43:39.628211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:43:39.628211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:43:39.628211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:43:39.628211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:43:39.628211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:43:39.628211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:43:39.628211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:43:39.628211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:43:39.628211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:43:39.628211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:43:39.628211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 25/49] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:43:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:43:39.633702 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466def2-cc33-4550-bf27-c6a10b28f02e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:39.736625 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466def2-cc33-4550-bf27-c6a10b28f02e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:39.749966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:39.771943 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb204ae-4b10-4477-8c3e-e08d9f3af26d None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:39.772214 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb204ae-4b10-4477-8c3e-e08d9f3af26d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:39.772513 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb204ae-4b10-4477-8c3e-e08d9f3af26d None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:39.772843 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554fe38-153b-4205-a17e-1b5d5975c9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:39.773459 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554fe38-153b-4205-a17e-1b5d5975c9ea None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:39.773736 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554fe38-153b-4205-a17e-1b5d5975c9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:39.773874 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 26/50] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:43:39.774000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554fe38-153b-4205-a17e-1b5d5975c9ea None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:39.774664 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554fe38-153b-4205-a17e-1b5d5975c9ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:39.774965 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554fe38-153b-4205-a17e-1b5d5975c9ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:39.776392 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554fe38-153b-4205-a17e-1b5d5975c9ea None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:39.778765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bde56b-893b-4cbd-924e-d2ea6071f8d7 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:39.779061 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bde56b-893b-4cbd-924e-d2ea6071f8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:39.779330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bde56b-893b-4cbd-924e-d2ea6071f8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:39.785048 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 25/51] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:43:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:39.790423 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554fe38-153b-4205-a17e-1b5d5975c9ea None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:39.798749 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-01bde56b-893b-4cbd-924e-d2ea6071f8d7 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:39.800312 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-01bde56b-893b-4cbd-924e-d2ea6071f8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:39.869536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 27/52] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:43:39.892783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554fe38-153b-4205-a17e-1b5d5975c9ea None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:39.927599 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4895f-6a2a-4732-a571-aa54c88f0729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:39.928238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4895f-6a2a-4732-a571-aa54c88f0729 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:39.928521 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4895f-6a2a-4732-a571-aa54c88f0729 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:39.928794 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4895f-6a2a-4732-a571-aa54c88f0729 None admin] PATH_INFO: `/v3/users/fcaa90c0553848528e601e03ebda1656` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:39.930187 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4895f-6a2a-4732-a571-aa54c88f0729 None admin] RBAC: Authorizing `identity:get_user(user_id=fcaa90c0553848528e601e03ebda1656)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:39.931698 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4895f-6a2a-4732-a571-aa54c88f0729 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:39.933267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:43:39 2022] GET /identity/v3/users/fcaa90c0553848528e601e03ebda1656 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:43:39.939282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bde56b-893b-4cbd-924e-d2ea6071f8d7 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:39.971533 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:40.043127 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bde56b-893b-4cbd-924e-d2ea6071f8d7 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:40.077814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c3670-062c-4d8b-af1c-f6b79ad05b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:40.078439 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c3670-062c-4d8b-af1c-f6b79ad05b7f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:40.078720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c3670-062c-4d8b-af1c-f6b79ad05b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:40.078993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c3670-062c-4d8b-af1c-f6b79ad05b7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:40.080154 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c3670-062c-4d8b-af1c-f6b79ad05b7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:40.081639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c3670-062c-4d8b-af1c-f6b79ad05b7f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:40.083235 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 28/54] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:43:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:40.089232 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4895f-6a2a-4732-a571-aa54c88f0729 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:40.135201 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c3670-062c-4d8b-af1c-f6b79ad05b7f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:40.241826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:40.244946 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:40.245826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c3670-062c-4d8b-af1c-f6b79ad05b7f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:40.280189 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f346a17-e56a-4822-bed2-9c0aa0adcc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:40.280835 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f346a17-e56a-4822-bed2-9c0aa0adcc5d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:40.281155 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f346a17-e56a-4822-bed2-9c0aa0adcc5d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:40.281430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f346a17-e56a-4822-bed2-9c0aa0adcc5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:40.282557 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f346a17-e56a-4822-bed2-9c0aa0adcc5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:40.284088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f346a17-e56a-4822-bed2-9c0aa0adcc5d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:40.285675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 29/55] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:43:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:40.291155 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f346a17-e56a-4822-bed2-9c0aa0adcc5d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:40.301969 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4895f-6a2a-4732-a571-aa54c88f0729 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:40.336791 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59965bd-35cf-4ccc-bb8a-baa1411698e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:40.337419 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59965bd-35cf-4ccc-bb8a-baa1411698e9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:40.337701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59965bd-35cf-4ccc-bb8a-baa1411698e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:40.337977 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59965bd-35cf-4ccc-bb8a-baa1411698e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:40.338715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59965bd-35cf-4ccc-bb8a-baa1411698e9 None admin] RBAC: Adding query filter params (role.id=4f4d8a6881ca496bb2d4845a6592fea8, scope.domain.id=default, user.id=fcaa90c0553848528e601e03ebda1656) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:40.339032 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59965bd-35cf-4ccc-bb8a-baa1411698e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:40.340909 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59965bd-35cf-4ccc-bb8a-baa1411698e9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:40.349800 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 27/56] 10.222.0.27 () {56 vars in 1322 bytes} [Tue Aug 30 11:43:40 2022] GET /identity/v3/role_assignments?user.id=fcaa90c0553848528e601e03ebda1656&scope.domain.id=default&role.id=4f4d8a6881ca496bb2d4845a6592fea8 => generated 530 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:40.393080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f346a17-e56a-4822-bed2-9c0aa0adcc5d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:40.431937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576861a6-6fd1-49a8-b3da-51acb6880583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:40.432570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576861a6-6fd1-49a8-b3da-51acb6880583 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:40.432853 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576861a6-6fd1-49a8-b3da-51acb6880583 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:40.433160 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576861a6-6fd1-49a8-b3da-51acb6880583 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:40.433843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576861a6-6fd1-49a8-b3da-51acb6880583 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:40.435351 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576861a6-6fd1-49a8-b3da-51acb6880583 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:40.468124 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 30/57] 10.222.0.27 () {60 vars in 1140 bytes} [Tue Aug 30 11:43:40 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:43:42.373447 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47ab13-dc8d-422d-9eac-06a7f33fe008 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:42.373968 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47ab13-dc8d-422d-9eac-06a7f33fe008 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:42.373968 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47ab13-dc8d-422d-9eac-06a7f33fe008 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:42.375349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 28/58] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:42.381776 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a082d-8a45-46be-99d4-085dc9bfd8cf None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:42.382475 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a082d-8a45-46be-99d4-085dc9bfd8cf None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:42.382622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a082d-8a45-46be-99d4-085dc9bfd8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:42.411103 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-078a082d-8a45-46be-99d4-085dc9bfd8cf None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:42.412343 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-078a082d-8a45-46be-99d4-085dc9bfd8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:42.426240 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:42.498620 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 31/59] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:43:42.763699 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47ab13-dc8d-422d-9eac-06a7f33fe008 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:42.883810 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47ab13-dc8d-422d-9eac-06a7f33fe008 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:42.891098 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:42.919272 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a32578-efb0-41c3-a7e5-ff35038aad1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:42.919927 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a32578-efb0-41c3-a7e5-ff35038aad1c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:42.920204 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a32578-efb0-41c3-a7e5-ff35038aad1c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:42.920476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a32578-efb0-41c3-a7e5-ff35038aad1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:42.921645 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a32578-efb0-41c3-a7e5-ff35038aad1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:42.923093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a32578-efb0-41c3-a7e5-ff35038aad1c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:42.924672 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 29/60] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:43:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:42.930634 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a082d-8a45-46be-99d4-085dc9bfd8cf None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:43.036982 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a082d-8a45-46be-99d4-085dc9bfd8cf None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:43.072857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73111a84-538c-45f3-9e49-82644ae9f9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:43.073464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73111a84-538c-45f3-9e49-82644ae9f9ab None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:43.073753 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73111a84-538c-45f3-9e49-82644ae9f9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:43.074023 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73111a84-538c-45f3-9e49-82644ae9f9ab None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:43.074675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73111a84-538c-45f3-9e49-82644ae9f9ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:43.076183 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73111a84-538c-45f3-9e49-82644ae9f9ab None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:43.106099 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 32/61] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Aug 30 11:43:42 2022] POST /identity/v3/users => generated 275 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:43:45.929078 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cc210-59d1-461d-864a-84cc354f616f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:45.929609 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cc210-59d1-461d-864a-84cc354f616f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:45.929609 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cc210-59d1-461d-864a-84cc354f616f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:45.930971 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 30/62] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:45.948145 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1997e6d-b109-4466-8340-e4b8058c09c4 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:45.949012 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1997e6d-b109-4466-8340-e4b8058c09c4 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:45.949463 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1997e6d-b109-4466-8340-e4b8058c09c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:45.958694 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:45.976392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-b1997e6d-b109-4466-8340-e4b8058c09c4 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:45.978237 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b1997e6d-b109-4466-8340-e4b8058c09c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:46.073378 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 33/63] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:43:46.257651 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb823f-8075-438d-af5e-3263a8a7d9c8 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:46.257847 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb823f-8075-438d-af5e-3263a8a7d9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:46.258292 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb823f-8075-438d-af5e-3263a8a7d9c8 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:46.260063 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 31/64] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:46.266298 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc198390-6cd9-4e2c-8e1b-d695cf06bf3d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:46.266765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc198390-6cd9-4e2c-8e1b-d695cf06bf3d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:46.267215 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc198390-6cd9-4e2c-8e1b-d695cf06bf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:46.290331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-fc198390-6cd9-4e2c-8e1b-d695cf06bf3d None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:46.291852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-fc198390-6cd9-4e2c-8e1b-d695cf06bf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:46.381017 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 34/65] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:43:46.550167 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb823f-8075-438d-af5e-3263a8a7d9c8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:46.636839 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca45be6-07cd-473a-9606-9694434bd97c None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:46.637466 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca45be6-07cd-473a-9606-9694434bd97c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:46.637978 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca45be6-07cd-473a-9606-9694434bd97c None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:46.639562 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 35/66] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:46.644720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d8f6b-87d4-427f-b801-d83fe86d6d37 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:46.645258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d8f6b-87d4-427f-b801-d83fe86d6d37 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:46.645757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d8f6b-87d4-427f-b801-d83fe86d6d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:46.666892 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-7a1d8f6b-87d4-427f-b801-d83fe86d6d37 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:46.668115 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7a1d8f6b-87d4-427f-b801-d83fe86d6d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:46.675254 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb823f-8075-438d-af5e-3263a8a7d9c8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:46.711026 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e985b-0f30-4459-9900-24bc3513dbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:46.711702 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e985b-0f30-4459-9900-24bc3513dbb3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:46.711988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e985b-0f30-4459-9900-24bc3513dbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:46.712265 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e985b-0f30-4459-9900-24bc3513dbb3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:46.723762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e985b-0f30-4459-9900-24bc3513dbb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:43:46.728852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-f27e985b-0f30-4459-9900-24bc3513dbb3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:43:46.728852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:43:46.728852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:43:46.728852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:43:46.728852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:43:46.728852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:43:46.728852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:43:46.728852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:43:46.728852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:43:46.728852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:43:46.728852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:43:46.728852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:43:46.728852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:43:46.728852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:43:46.728852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:43:46.728852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:43:46.729903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:43:46.729903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:43:46.729903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:43:46.729903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:43:46.729903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:43:46.729903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:43:46.729903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:43:46.729903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:43:46.729903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:43:46.729903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:43:46.729903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:43:46.729903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:43:46.729903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:43:46.729903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:43:46.729903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:43:46.729903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:43:46.730865 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:43:46.730865 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:43:46.730865 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:43:46.730865 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:43:46.730865 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:43:46.730865 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:43:46.730865 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:43:46.730865 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:43:46.730865 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:43:46.730865 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:43:46.730865 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:43:46.730865 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:43:46.732819 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 32/67] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:43:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:43:46.733562 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:46.738081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac4415-b087-4d17-9b98-d91a2be70b79 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:46.738742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac4415-b087-4d17-9b98-d91a2be70b79 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:46.739012 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac4415-b087-4d17-9b98-d91a2be70b79 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:46.740373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 33/68] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:46.741150 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac4415-b087-4d17-9b98-d91a2be70b79 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:46.743684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 36/69] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:43:46.744727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d8f6b-87d4-427f-b801-d83fe86d6d37 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:46.792543 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:46.849732 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d8f6b-87d4-427f-b801-d83fe86d6d37 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:46.863305 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac4415-b087-4d17-9b98-d91a2be70b79 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:46.885623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f8af9-e6ae-4235-80b6-e6526094e026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:46.886249 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f8af9-e6ae-4235-80b6-e6526094e026 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:46.886533 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f8af9-e6ae-4235-80b6-e6526094e026 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:46.886809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f8af9-e6ae-4235-80b6-e6526094e026 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:46.887515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f8af9-e6ae-4235-80b6-e6526094e026 None admin] RBAC: Adding query filter params (name=member) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:46.887829 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f8af9-e6ae-4235-80b6-e6526094e026 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:46.889248 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f8af9-e6ae-4235-80b6-e6526094e026 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:46.897770 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 37/70] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:43:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:46.898930 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9b644-ea0d-460f-9d58-42e36cb036d0 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:46.899216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9b644-ea0d-460f-9d58-42e36cb036d0 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:46.899524 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9b644-ea0d-460f-9d58-42e36cb036d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:46.905384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca241a7e-fcde-460f-88d7-57a19c6fc152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:46.906282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca241a7e-fcde-460f-88d7-57a19c6fc152 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:46.906591 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca241a7e-fcde-460f-88d7-57a19c6fc152 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:46.906887 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca241a7e-fcde-460f-88d7-57a19c6fc152 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:46.917735 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca241a7e-fcde-460f-88d7-57a19c6fc152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:43:46.918239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a3a9b644-ea0d-460f-9d58-42e36cb036d0 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:46.919471 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a3a9b644-ea0d-460f-9d58-42e36cb036d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:46.922592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ca241a7e-fcde-460f-88d7-57a19c6fc152 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:43:46.922592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:43:46.922592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:43:46.922592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:43:46.922592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:43:46.922592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:43:46.922592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:43:46.922592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:43:46.922592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:43:46.922592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:43:46.922592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:43:46.922592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:43:46.922592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:43:46.922592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:43:46.922592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:43:46.922592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:43:46.923649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:43:46.923649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:43:46.923649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:43:46.923649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:43:46.923649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:43:46.923649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:43:46.923649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:43:46.923649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:43:46.923649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:43:46.923649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:43:46.923649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:43:46.923649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:43:46.923649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:43:46.923649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:43:46.923649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:43:46.923649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:43:46.924517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:43:46.924517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:43:46.924517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:43:46.924517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:43:46.924517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:43:46.924517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:43:46.924517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:43:46.924517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:43:46.924517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:43:46.924517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:43:46.924517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:43:46.924517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:43:46.924517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 34/71] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:43:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:43:46.925139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3150c-1e44-4b51-8bb7-1c0fa9106484 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:46.925139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3150c-1e44-4b51-8bb7-1c0fa9106484 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:46.925866 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3150c-1e44-4b51-8bb7-1c0fa9106484 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:46.927992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 35/72] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:46.932432 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3150c-1e44-4b51-8bb7-1c0fa9106484 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:46.981792 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:46.999220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 38/73] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:43:47.008458 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9b644-ea0d-460f-9d58-42e36cb036d0 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:47.033585 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:47.042210 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3150c-1e44-4b51-8bb7-1c0fa9106484 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:47.077122 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ef6aa-ab98-4718-8e4a-b10439a2559d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:47.077768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ef6aa-ab98-4718-8e4a-b10439a2559d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:47.078045 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ef6aa-ab98-4718-8e4a-b10439a2559d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:47.078411 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ef6aa-ab98-4718-8e4a-b10439a2559d None admin] PATH_INFO: `/v3/users/69abfe9255ec4f2e97b3d7b9e1433201` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:47.093934 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ef6aa-ab98-4718-8e4a-b10439a2559d None admin] RBAC: Authorizing `identity:get_user(user_id=69abfe9255ec4f2e97b3d7b9e1433201)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:47.095422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ef6aa-ab98-4718-8e4a-b10439a2559d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:47.101912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 36/74] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:43:46 2022] GET /identity/v3/users/69abfe9255ec4f2e97b3d7b9e1433201 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:47.101912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97746c4-634a-43ea-96b3-89942ec66058 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:47.101912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97746c4-634a-43ea-96b3-89942ec66058 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:47.101912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97746c4-634a-43ea-96b3-89942ec66058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:47.119648 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e97746c4-634a-43ea-96b3-89942ec66058 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:47.120822 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e97746c4-634a-43ea-96b3-89942ec66058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:47.122855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9b644-ea0d-460f-9d58-42e36cb036d0 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:47.159212 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97703a44-e47e-4389-b1f3-edca5c61285f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:47.159876 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97703a44-e47e-4389-b1f3-edca5c61285f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:47.160155 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97703a44-e47e-4389-b1f3-edca5c61285f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:47.160423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97703a44-e47e-4389-b1f3-edca5c61285f None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:47.161077 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97703a44-e47e-4389-b1f3-edca5c61285f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:47.161379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97703a44-e47e-4389-b1f3-edca5c61285f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:47.162773 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97703a44-e47e-4389-b1f3-edca5c61285f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:47.172048 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 39/75] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:43:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:47.172939 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97703a44-e47e-4389-b1f3-edca5c61285f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:47.194273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 37/76] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:43:47.195485 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97746c4-634a-43ea-96b3-89942ec66058 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:47.243291 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:47.282261 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:47.302850 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97703a44-e47e-4389-b1f3-edca5c61285f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:47.303992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97746c4-634a-43ea-96b3-89942ec66058 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:47.338640 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adae0f2-3645-4449-93f2-3652eea6c123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:47.339280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adae0f2-3645-4449-93f2-3652eea6c123 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:47.339955 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adae0f2-3645-4449-93f2-3652eea6c123 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:47.340052 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ccf3b-2d6a-4318-bf21-01b37b943e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:47.340243 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adae0f2-3645-4449-93f2-3652eea6c123 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:47.340704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ccf3b-2d6a-4318-bf21-01b37b943e29 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:47.340937 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ccf3b-2d6a-4318-bf21-01b37b943e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:47.341209 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ccf3b-2d6a-4318-bf21-01b37b943e29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:47.350867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adae0f2-3645-4449-93f2-3652eea6c123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:43:47.356253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-4adae0f2-3645-4449-93f2-3652eea6c123 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:43:47.356253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:43:47.356253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:43:47.356253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:43:47.356253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:43:47.356253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:43:47.356253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:43:47.356253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:43:47.356253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:43:47.356253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:43:47.356253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:43:47.356253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:43:47.356253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:43:47.356253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:43:47.356253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:43:47.356253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:43:47.357064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:43:47.357064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:43:47.357064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:43:47.357064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:43:47.357064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:43:47.357064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:43:47.357064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:43:47.357064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:43:47.357064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:43:47.357064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:43:47.357064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:43:47.357064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:43:47.357064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:43:47.357064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:43:47.357064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:43:47.357064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:43:47.357825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:43:47.357825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:43:47.357825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:43:47.357825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:43:47.357825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:43:47.357825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:43:47.357825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:43:47.357825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:43:47.357825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:43:47.357825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:43:47.357825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:43:47.357825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:43:47.357825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 40/77] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Aug 30 11:43:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:43:47.358465 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adae0f2-3645-4449-93f2-3652eea6c123 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:47.417394 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ccf3b-2d6a-4318-bf21-01b37b943e29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:47.418871 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ccf3b-2d6a-4318-bf21-01b37b943e29 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:47.462928 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adae0f2-3645-4449-93f2-3652eea6c123 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:47.472344 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:47.496892 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:47.497286 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034383f8-3e93-478c-b91b-372b2128aa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:47.497926 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034383f8-3e93-478c-b91b-372b2128aa88 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:47.498217 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034383f8-3e93-478c-b91b-372b2128aa88 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:47.498495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034383f8-3e93-478c-b91b-372b2128aa88 None admin] PATH_INFO: `/v3/users/fcaa90c0553848528e601e03ebda1656` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:47.499655 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034383f8-3e93-478c-b91b-372b2128aa88 None admin] RBAC: Authorizing `identity:get_user(user_id=fcaa90c0553848528e601e03ebda1656)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:47.501250 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034383f8-3e93-478c-b91b-372b2128aa88 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:47.502857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 41/78] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:43:47 2022] GET /identity/v3/users/fcaa90c0553848528e601e03ebda1656 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:47.507685 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034383f8-3e93-478c-b91b-372b2128aa88 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:47.515820 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 38/79] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:43:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:43:47.516730 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ccf3b-2d6a-4318-bf21-01b37b943e29 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:47.607775 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034383f8-3e93-478c-b91b-372b2128aa88 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:47.614551 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ccf3b-2d6a-4318-bf21-01b37b943e29 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:47.641037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae904ae-d58b-4cc2-b3de-9650b53cc44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:47.641798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae904ae-d58b-4cc2-b3de-9650b53cc44b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:47.642121 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae904ae-d58b-4cc2-b3de-9650b53cc44b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:47.642402 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae904ae-d58b-4cc2-b3de-9650b53cc44b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:47.648769 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec3219-eb33-46c1-8525-65ac2406e60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:47.649376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec3219-eb33-46c1-8525-65ac2406e60f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:47.649653 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec3219-eb33-46c1-8525-65ac2406e60f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:47.649934 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec3219-eb33-46c1-8525-65ac2406e60f None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:47.650586 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec3219-eb33-46c1-8525-65ac2406e60f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:47.650890 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec3219-eb33-46c1-8525-65ac2406e60f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:47.652308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec3219-eb33-46c1-8525-65ac2406e60f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:47.652806 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae904ae-d58b-4cc2-b3de-9650b53cc44b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:43:47.658373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-8ae904ae-d58b-4cc2-b3de-9650b53cc44b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:43:47.658373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:43:47.658373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:43:47.658373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:43:47.658373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:43:47.658373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:43:47.658373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:43:47.658373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:43:47.658373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:43:47.658373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:43:47.658373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:43:47.658373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:43:47.658373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:43:47.658373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:43:47.658373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:43:47.658373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:43:47.659218 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:43:47.659218 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:43:47.659218 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:43:47.659218 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:43:47.659218 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:43:47.659218 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:43:47.659218 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:43:47.659218 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:43:47.659218 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:43:47.659218 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:43:47.659218 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:43:47.659218 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:43:47.659218 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:43:47.659218 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:43:47.659218 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:43:47.659218 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:43:47.660011 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:43:47.660011 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:43:47.660011 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:43:47.660011 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:43:47.660011 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:43:47.660011 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:43:47.660011 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:43:47.660011 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:43:47.660011 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:43:47.660011 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:43:47.660011 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:43:47.660011 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:43:47.660011 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 42/80] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:43:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:43:47.660658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae904ae-d58b-4cc2-b3de-9650b53cc44b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:47.663588 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 39/81] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:43:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:47.665891 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec3219-eb33-46c1-8525-65ac2406e60f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:47.697866 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:47.713838 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:47.762281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae904ae-d58b-4cc2-b3de-9650b53cc44b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:47.767538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec3219-eb33-46c1-8525-65ac2406e60f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:47.794208 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad58eb0-d820-453d-ab99-a0d0856afb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:47.794841 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad58eb0-d820-453d-ab99-a0d0856afb70 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:47.795126 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad58eb0-d820-453d-ab99-a0d0856afb70 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:47.795429 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad58eb0-d820-453d-ab99-a0d0856afb70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:47.796536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad58eb0-d820-453d-ab99-a0d0856afb70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:47.798080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad58eb0-d820-453d-ab99-a0d0856afb70 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:47.799915 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 43/82] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:43:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:47.800441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad58eb0-d820-453d-ab99-a0d0856afb70 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:47.800808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5f9fc-b51e-4850-b26f-d63d2b8e5533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:47.801322 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5f9fc-b51e-4850-b26f-d63d2b8e5533 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:47.801609 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5f9fc-b51e-4850-b26f-d63d2b8e5533 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:47.801890 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5f9fc-b51e-4850-b26f-d63d2b8e5533 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:47.869639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5f9fc-b51e-4850-b26f-d63d2b8e5533 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:47.871033 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5f9fc-b51e-4850-b26f-d63d2b8e5533 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:47.898875 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad58eb0-d820-453d-ab99-a0d0856afb70 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:47.901216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:47.915769 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:47.936603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78d41e-125f-4a58-92c4-0f2e668d367d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:47.937240 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78d41e-125f-4a58-92c4-0f2e668d367d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:47.937537 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78d41e-125f-4a58-92c4-0f2e668d367d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:47.937814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78d41e-125f-4a58-92c4-0f2e668d367d None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:47.938927 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78d41e-125f-4a58-92c4-0f2e668d367d None admin] RBAC: Authorizing `identity:get_project(project_id=1e107e4257e749cdbbc856b69ced1cc1)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:47.940452 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78d41e-125f-4a58-92c4-0f2e668d367d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:47.942092 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 44/83] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:43:47 2022] GET /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:47.942843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78d41e-125f-4a58-92c4-0f2e668d367d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:47.973485 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 40/84] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:43:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:43:47.974957 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5f9fc-b51e-4850-b26f-d63d2b8e5533 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:48.045699 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78d41e-125f-4a58-92c4-0f2e668d367d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:48.072506 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5f9fc-b51e-4850-b26f-d63d2b8e5533 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:48.080796 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8b40a-2582-457f-8d3d-f227a6329141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:48.081423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8b40a-2582-457f-8d3d-f227a6329141 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:48.081739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8b40a-2582-457f-8d3d-f227a6329141 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:48.082013 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8b40a-2582-457f-8d3d-f227a6329141 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:48.082645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8b40a-2582-457f-8d3d-f227a6329141 None admin] RBAC: Adding query filter params (name=member) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:48.082955 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8b40a-2582-457f-8d3d-f227a6329141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:48.084413 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8b40a-2582-457f-8d3d-f227a6329141 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:48.093016 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 45/85] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:43:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:48.093784 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8b40a-2582-457f-8d3d-f227a6329141 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:48.109118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6235a-e3db-44d9-a103-79ce5767a8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:48.110228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6235a-e3db-44d9-a103-79ce5767a8b5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:48.110461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6235a-e3db-44d9-a103-79ce5767a8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:48.110758 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6235a-e3db-44d9-a103-79ce5767a8b5 None admin] PATH_INFO: `/v3/users/69abfe9255ec4f2e97b3d7b9e1433201` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:48.111950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6235a-e3db-44d9-a103-79ce5767a8b5 None admin] RBAC: Authorizing `identity:get_user(user_id=69abfe9255ec4f2e97b3d7b9e1433201)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:48.113398 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6235a-e3db-44d9-a103-79ce5767a8b5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:48.115198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 41/86] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:43:47 2022] GET /identity/v3/users/69abfe9255ec4f2e97b3d7b9e1433201 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:48.115770 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6235a-e3db-44d9-a103-79ce5767a8b5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:48.134308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:48.135610 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:48.201396 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8b40a-2582-457f-8d3d-f227a6329141 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:48.220961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6235a-e3db-44d9-a103-79ce5767a8b5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:48.237291 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012a78f-8e6f-4f20-b2a8-64b398911186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:48.237914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012a78f-8e6f-4f20-b2a8-64b398911186 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:48.238196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012a78f-8e6f-4f20-b2a8-64b398911186 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:48.238465 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012a78f-8e6f-4f20-b2a8-64b398911186 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:48.239128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012a78f-8e6f-4f20-b2a8-64b398911186 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:48.240645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012a78f-8e6f-4f20-b2a8-64b398911186 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:48.255654 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a445f-10a8-4a90-a08b-3f114f15f8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:48.256279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a445f-10a8-4a90-a08b-3f114f15f8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:48.256564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a445f-10a8-4a90-a08b-3f114f15f8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:48.256840 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a445f-10a8-4a90-a08b-3f114f15f8b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:48.257574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a445f-10a8-4a90-a08b-3f114f15f8b9 None admin] RBAC: Adding query filter params (role.id=7f855c6f817f4a64a1e635407de8bfb0, scope.project.id=1e107e4257e749cdbbc856b69ced1cc1, user.id=69abfe9255ec4f2e97b3d7b9e1433201) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:48.257891 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a445f-10a8-4a90-a08b-3f114f15f8b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:48.259575 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a445f-10a8-4a90-a08b-3f114f15f8b9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:48.262824 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 46/87] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Aug 30 11:43:48 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:43:48.263685 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012a78f-8e6f-4f20-b2a8-64b398911186 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:48.270009 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 42/88] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:43:48 2022] GET /identity/v3/role_assignments?user.id=69abfe9255ec4f2e97b3d7b9e1433201&scope.project.id=1e107e4257e749cdbbc856b69ced1cc1&role.id=7f855c6f817f4a64a1e635407de8bfb0 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:48.276441 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a445f-10a8-4a90-a08b-3f114f15f8b9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:48.374176 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:48.389596 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:48.404450 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012a78f-8e6f-4f20-b2a8-64b398911186 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:48.408277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a445f-10a8-4a90-a08b-3f114f15f8b9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:48.456403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f713ac3-6d16-435a-8797-e75fb7bbe6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:48.456839 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcdb70-e70b-4022-b414-7f0bcf988695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:48.457299 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f713ac3-6d16-435a-8797-e75fb7bbe6af None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:48.457500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcdb70-e70b-4022-b414-7f0bcf988695 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:48.457619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f713ac3-6d16-435a-8797-e75fb7bbe6af None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:48.457786 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcdb70-e70b-4022-b414-7f0bcf988695 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:48.457884 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f713ac3-6d16-435a-8797-e75fb7bbe6af None admin] PATH_INFO: `/v3/users/69abfe9255ec4f2e97b3d7b9e1433201` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:48.458066 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcdb70-e70b-4022-b414-7f0bcf988695 None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:48.459867 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f713ac3-6d16-435a-8797-e75fb7bbe6af None admin] RBAC: Authorizing `identity:get_user(user_id=69abfe9255ec4f2e97b3d7b9e1433201)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:48.459993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcdb70-e70b-4022-b414-7f0bcf988695 None admin] RBAC: Authorizing `identity:get_project(project_id=1e107e4257e749cdbbc856b69ced1cc1)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:48.461341 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f713ac3-6d16-435a-8797-e75fb7bbe6af None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:48.461442 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcdb70-e70b-4022-b414-7f0bcf988695 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:48.463153 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 43/89] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:43:48 2022] GET /identity/v3/users/69abfe9255ec4f2e97b3d7b9e1433201 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:48.463260 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 47/90] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:43:48 2022] GET /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:48.464897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f713ac3-6d16-435a-8797-e75fb7bbe6af None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:48.469071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcdb70-e70b-4022-b414-7f0bcf988695 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:48.590494 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f713ac3-6d16-435a-8797-e75fb7bbe6af None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:48.593479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcdb70-e70b-4022-b414-7f0bcf988695 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:48.634062 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18132ae-d15f-491c-9d66-1cddf8d58047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:48.634402 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18132ae-d15f-491c-9d66-1cddf8d58047 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:48.634595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18132ae-d15f-491c-9d66-1cddf8d58047 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:48.634868 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18132ae-d15f-491c-9d66-1cddf8d58047 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:48.637087 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf40ec-794a-440b-ae3d-827667303b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:48.638065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf40ec-794a-440b-ae3d-827667303b93 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:48.638672 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf40ec-794a-440b-ae3d-827667303b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:48.639013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf40ec-794a-440b-ae3d-827667303b93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:48.658878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:48.670300 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:48.722063 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf40ec-794a-440b-ae3d-827667303b93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:48.722256 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18132ae-d15f-491c-9d66-1cddf8d58047 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:48.723590 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf40ec-794a-440b-ae3d-827667303b93 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:48.723691 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18132ae-d15f-491c-9d66-1cddf8d58047 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:48.837368 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 48/91] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:43:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 11:43:48.838500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18132ae-d15f-491c-9d66-1cddf8d58047 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:48.852185 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 44/92] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:43:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:43:48.853081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf40ec-794a-440b-ae3d-827667303b93 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:48.902979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:48.960222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf40ec-794a-440b-ae3d-827667303b93 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:48.995728 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:48.999969 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad1d6b-58d3-4a24-8a86-b92f08e211bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:49.000918 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad1d6b-58d3-4a24-8a86-b92f08e211bd None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:49.001218 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad1d6b-58d3-4a24-8a86-b92f08e211bd None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:49.001496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad1d6b-58d3-4a24-8a86-b92f08e211bd None admin] PATH_INFO: `/v3/projects/b80f6823f3ab4fe2914a1133b2acccee` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:49.002668 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad1d6b-58d3-4a24-8a86-b92f08e211bd None admin] RBAC: Authorizing `identity:get_project(project_id=b80f6823f3ab4fe2914a1133b2acccee)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:49.004325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad1d6b-58d3-4a24-8a86-b92f08e211bd None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:49.006295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 45/93] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:43:48 2022] GET /identity/v3/projects/b80f6823f3ab4fe2914a1133b2acccee => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:49.007561 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad1d6b-58d3-4a24-8a86-b92f08e211bd None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:49.102761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18132ae-d15f-491c-9d66-1cddf8d58047 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:49.164095 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad1d6b-58d3-4a24-8a86-b92f08e211bd None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:49.169457 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e47e1-f434-42f4-a08b-495988851cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:49.170080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e47e1-f434-42f4-a08b-495988851cdd None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:49.170357 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e47e1-f434-42f4-a08b-495988851cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:49.170627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e47e1-f434-42f4-a08b-495988851cdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:49.171369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e47e1-f434-42f4-a08b-495988851cdd None admin] RBAC: Adding query filter params (role.id=4f4d8a6881ca496bb2d4845a6592fea8, scope.project.id=1e107e4257e749cdbbc856b69ced1cc1, user.id=fcaa90c0553848528e601e03ebda1656) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:49.171680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e47e1-f434-42f4-a08b-495988851cdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:49.173219 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e47e1-f434-42f4-a08b-495988851cdd None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:49.185308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 49/94] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:43:48 2022] GET /identity/v3/role_assignments?user.id=fcaa90c0553848528e601e03ebda1656&scope.project.id=1e107e4257e749cdbbc856b69ced1cc1&role.id=4f4d8a6881ca496bb2d4845a6592fea8 => generated 259 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:49.190707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e47e1-f434-42f4-a08b-495988851cdd None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:49.193985 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:49.250449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1db70-830f-49b4-bf70-17aee2d9d72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:49.251031 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1db70-830f-49b4-bf70-17aee2d9d72d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:49.251309 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1db70-830f-49b4-bf70-17aee2d9d72d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:49.251607 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1db70-830f-49b4-bf70-17aee2d9d72d None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:49.254395 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1db70-830f-49b4-bf70-17aee2d9d72d None admin] RBAC: Authorizing `identity:get_project(project_id=1e107e4257e749cdbbc856b69ced1cc1)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:49.255919 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1db70-830f-49b4-bf70-17aee2d9d72d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:49.263493 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 46/95] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:43:49 2022] GET /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:49.271507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1db70-830f-49b4-bf70-17aee2d9d72d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:49.385347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e47e1-f434-42f4-a08b-495988851cdd None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:49.413820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:49.426822 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d349110-ac41-4c15-8f13-96b988dffb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:49.427472 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d349110-ac41-4c15-8f13-96b988dffb35 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:49.427756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d349110-ac41-4c15-8f13-96b988dffb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:49.428029 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d349110-ac41-4c15-8f13-96b988dffb35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:49.428762 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d349110-ac41-4c15-8f13-96b988dffb35 None admin] RBAC: Adding query filter params (role.id=7f855c6f817f4a64a1e635407de8bfb0, scope.project.id=b80f6823f3ab4fe2914a1133b2acccee, user.id=69abfe9255ec4f2e97b3d7b9e1433201) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:49.429070 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d349110-ac41-4c15-8f13-96b988dffb35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:49.430568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d349110-ac41-4c15-8f13-96b988dffb35 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:49.438177 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 50/96] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:43:49 2022] GET /identity/v3/role_assignments?user.id=69abfe9255ec4f2e97b3d7b9e1433201&scope.project.id=b80f6823f3ab4fe2914a1133b2acccee&role.id=7f855c6f817f4a64a1e635407de8bfb0 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:49.489709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1db70-830f-49b4-bf70-17aee2d9d72d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:49.565303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144f77e-6af0-4864-b357-c8797534715d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:49.565950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144f77e-6af0-4864-b357-c8797534715d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:49.566234 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144f77e-6af0-4864-b357-c8797534715d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:49.566512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144f77e-6af0-4864-b357-c8797534715d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:49.567263 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144f77e-6af0-4864-b357-c8797534715d None admin] RBAC: Adding query filter params (role.id=30c5b9fbbb564c6dafe66f759683738b, scope.project.id=1e107e4257e749cdbbc856b69ced1cc1, user.id=69abfe9255ec4f2e97b3d7b9e1433201) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:49.567652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144f77e-6af0-4864-b357-c8797534715d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:49.569151 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144f77e-6af0-4864-b357-c8797534715d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:49.580382 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 47/97] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:43:49 2022] GET /identity/v3/role_assignments?user.id=69abfe9255ec4f2e97b3d7b9e1433201&scope.project.id=1e107e4257e749cdbbc856b69ced1cc1&role.id=30c5b9fbbb564c6dafe66f759683738b => generated 259 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:43:50.615300 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfce6b-644f-466c-b9aa-4e6596db4164 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:50.616355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfce6b-644f-466c-b9aa-4e6596db4164 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:50.616829 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfce6b-644f-466c-b9aa-4e6596db4164 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:50.618374 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 51/98] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:50.623755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630d7fc-0b4c-4f36-bbed-bd19ba259d72 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:50.624531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630d7fc-0b4c-4f36-bbed-bd19ba259d72 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:50.624992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630d7fc-0b4c-4f36-bbed-bd19ba259d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:50.643809 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2630d7fc-0b4c-4f36-bbed-bd19ba259d72 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:50.645342 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2630d7fc-0b4c-4f36-bbed-bd19ba259d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:50.699650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:50.708009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f02e0a-f8c8-4e44-8df6-9eeb3b6d4e55 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:50.708289 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f02e0a-f8c8-4e44-8df6-9eeb3b6d4e55 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:50.708562 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f02e0a-f8c8-4e44-8df6-9eeb3b6d4e55 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:50.709907 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 52/99] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:43:50.715247 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee60d8-0bdf-4c3a-88d8-129306cb5293 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:50.715571 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee60d8-0bdf-4c3a-88d8-129306cb5293 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:50.715911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee60d8-0bdf-4c3a-88d8-129306cb5293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:50.740045 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-6aee60d8-0bdf-4c3a-88d8-129306cb5293 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:50.741240 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6aee60d8-0bdf-4c3a-88d8-129306cb5293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:50.762427 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 48/100] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:43:50.849329 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 53/101] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:43:51.104888 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ec162-e095-4978-b377-bedadec1e2fc None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:51.105414 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ec162-e095-4978-b377-bedadec1e2fc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:51.105880 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ec162-e095-4978-b377-bedadec1e2fc None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:51.107697 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 49/102] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:51.112326 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee60d8-0bdf-4c3a-88d8-129306cb5293 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:51.120761 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c2dbf-816e-4b6b-bd3c-7ec0c8cddeab None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:51.121397 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c2dbf-816e-4b6b-bd3c-7ec0c8cddeab None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:51.121909 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c2dbf-816e-4b6b-bd3c-7ec0c8cddeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:51.145964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6a6c2dbf-816e-4b6b-bd3c-7ec0c8cddeab None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:51.149123 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6a6c2dbf-816e-4b6b-bd3c-7ec0c8cddeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:51.277875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 50/103] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:43:51.295926 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee60d8-0bdf-4c3a-88d8-129306cb5293 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:51.325421 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:51.350610 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba21b45-3749-42a6-8450-2056cb7fa79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:51.351651 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba21b45-3749-42a6-8450-2056cb7fa79b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:51.352187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba21b45-3749-42a6-8450-2056cb7fa79b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:51.352667 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba21b45-3749-42a6-8450-2056cb7fa79b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:51.356993 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c2dbf-816e-4b6b-bd3c-7ec0c8cddeab None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:51.374927 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba21b45-3749-42a6-8450-2056cb7fa79b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:43:51.380085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-2ba21b45-3749-42a6-8450-2056cb7fa79b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:43:51.380085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:43:51.380085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:43:51.380085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:43:51.380085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:43:51.380085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:43:51.380085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:43:51.380085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:43:51.380085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:43:51.380085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:43:51.380085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:43:51.380085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:43:51.380085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:43:51.380085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:43:51.380085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:43:51.380085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:43:51.380986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:43:51.380986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:43:51.380986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:43:51.380986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:43:51.380986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:43:51.380986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:43:51.380986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:43:51.380986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:43:51.380986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:43:51.380986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:43:51.380986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:43:51.380986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:43:51.380986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:43:51.380986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:43:51.380986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:43:51.380986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:43:51.381733 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:43:51.381733 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:43:51.381733 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:43:51.381733 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:43:51.381733 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:43:51.381733 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:43:51.381733 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:43:51.381733 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:43:51.381733 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:43:51.381733 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:43:51.381733 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:43:51.381733 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:43:51.383919 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 54/104] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:43:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:43:51.388816 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba21b45-3749-42a6-8450-2056cb7fa79b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:51.538956 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c2dbf-816e-4b6b-bd3c-7ec0c8cddeab None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:51.544813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:51.601820 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98aca15-b09d-45c9-a24c-d97f94bd3b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:51.603479 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aca15-b09d-45c9-a24c-d97f94bd3b28 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:51.603954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aca15-b09d-45c9-a24c-d97f94bd3b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:51.604529 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aca15-b09d-45c9-a24c-d97f94bd3b28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:51.605080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba21b45-3749-42a6-8450-2056cb7fa79b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:51.611990 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98aca15-b09d-45c9-a24c-d97f94bd3b28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:51.613744 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98aca15-b09d-45c9-a24c-d97f94bd3b28 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:51.615626 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 51/105] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:43:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:43:51.622103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98aca15-b09d-45c9-a24c-d97f94bd3b28 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:51.692095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3f3eb-350f-46b0-9574-5c5d78546447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:51.692789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3f3eb-350f-46b0-9574-5c5d78546447 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:51.693014 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3f3eb-350f-46b0-9574-5c5d78546447 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:51.693291 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3f3eb-350f-46b0-9574-5c5d78546447 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:51.693967 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3f3eb-350f-46b0-9574-5c5d78546447 None admin] RBAC: Adding query filter params (name=member) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:51.694275 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3f3eb-350f-46b0-9574-5c5d78546447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:51.695752 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3f3eb-350f-46b0-9574-5c5d78546447 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:51.711539 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 55/106] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:43:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:43:51.719465 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3f3eb-350f-46b0-9574-5c5d78546447 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:51.788973 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98aca15-b09d-45c9-a24c-d97f94bd3b28 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:51.803870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:51.877058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3f3eb-350f-46b0-9574-5c5d78546447 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:51.884091 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e604959-0387-4351-bc59-fe7fe44d74fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:51.884979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e604959-0387-4351-bc59-fe7fe44d74fa None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:51.885524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e604959-0387-4351-bc59-fe7fe44d74fa None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:51.885982 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e604959-0387-4351-bc59-fe7fe44d74fa None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:51.886842 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e604959-0387-4351-bc59-fe7fe44d74fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:51.888594 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e604959-0387-4351-bc59-fe7fe44d74fa None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:51.922726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5825d2-3b62-49a9-a11d-2552895c648a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:51.923564 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5825d2-3b62-49a9-a11d-2552895c648a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:51.923845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5825d2-3b62-49a9-a11d-2552895c648a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:51.924121 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5825d2-3b62-49a9-a11d-2552895c648a None admin] PATH_INFO: `/v3/users/69abfe9255ec4f2e97b3d7b9e1433201` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:51.925857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5825d2-3b62-49a9-a11d-2552895c648a None admin] RBAC: Authorizing `identity:get_user(user_id=69abfe9255ec4f2e97b3d7b9e1433201)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:51.927670 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5825d2-3b62-49a9-a11d-2552895c648a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:51.929769 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 56/107] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:43:51 2022] GET /identity/v3/users/69abfe9255ec4f2e97b3d7b9e1433201 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:43:51.930571 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5825d2-3b62-49a9-a11d-2552895c648a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:51.946677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 52/108] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Aug 30 11:43:51 2022] POST /identity/v3/projects => generated 302 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:43:51.947604 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e604959-0387-4351-bc59-fe7fe44d74fa None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:52.031830 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:52.100107 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e604959-0387-4351-bc59-fe7fe44d74fa None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:52.204311 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ed30c-be87-459e-ba33-6bc0dbfa8488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:52.204906 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ed30c-be87-459e-ba33-6bc0dbfa8488 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:52.205434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ed30c-be87-459e-ba33-6bc0dbfa8488 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:52.205719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ed30c-be87-459e-ba33-6bc0dbfa8488 None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:52.206951 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ed30c-be87-459e-ba33-6bc0dbfa8488 None admin] RBAC: Authorizing `identity:get_project(project_id=1e107e4257e749cdbbc856b69ced1cc1)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:52.208461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ed30c-be87-459e-ba33-6bc0dbfa8488 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:52.210144 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 53/109] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:43:51 2022] GET /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:52.216322 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ed30c-be87-459e-ba33-6bc0dbfa8488 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:52.217132 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5825d2-3b62-49a9-a11d-2552895c648a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:52.225838 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:52.258700 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f9fbf-f967-4c40-8b1f-dc1f94822e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:52.259349 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f9fbf-f967-4c40-8b1f-dc1f94822e50 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:52.259659 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f9fbf-f967-4c40-8b1f-dc1f94822e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:52.259941 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f9fbf-f967-4c40-8b1f-dc1f94822e50 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:52.271828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f9fbf-f967-4c40-8b1f-dc1f94822e50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:43:52.277369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-4e8f9fbf-f967-4c40-8b1f-dc1f94822e50 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:43:52.277369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:43:52.277369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:43:52.277369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:43:52.277369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:43:52.277369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:43:52.277369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:43:52.277369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:43:52.277369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:43:52.277369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:43:52.277369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:43:52.277369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:43:52.277369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:43:52.277369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:43:52.277369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:43:52.277369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:43:52.278197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:43:52.278197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:43:52.278197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:43:52.278197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:43:52.278197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:43:52.278197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:43:52.278197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:43:52.278197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:43:52.278197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:43:52.278197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:43:52.278197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:43:52.278197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:43:52.278197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:43:52.278197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:43:52.278197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:43:52.278197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:43:52.279495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:43:52.279495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:43:52.279495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:43:52.279495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:43:52.279495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:43:52.279495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:43:52.279495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:43:52.279495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:43:52.279495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:43:52.279495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:43:52.279495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:43:52.279495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:43:52.279495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 57/110] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:43:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:43:52.284939 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f9fbf-f967-4c40-8b1f-dc1f94822e50 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:52.362654 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:52.373562 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ed30c-be87-459e-ba33-6bc0dbfa8488 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:52.392922 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f9fbf-f967-4c40-8b1f-dc1f94822e50 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:52.418288 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a76a6-1f9c-4ba1-b1f3-7ef00f1733ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:52.419809 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a76a6-1f9c-4ba1-b1f3-7ef00f1733ec None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:52.420565 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a76a6-1f9c-4ba1-b1f3-7ef00f1733ec None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:52.421054 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a76a6-1f9c-4ba1-b1f3-7ef00f1733ec None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1/users/69abfe9255ec4f2e97b3d7b9e1433201/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:52.424080 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a76a6-1f9c-4ba1-b1f3-7ef00f1733ec None admin] RBAC: Authorizing `identity:create_grant(project_id=1e107e4257e749cdbbc856b69ced1cc1, user_id=69abfe9255ec4f2e97b3d7b9e1433201, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:52.425808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a76a6-1f9c-4ba1-b1f3-7ef00f1733ec None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:52.427205 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639661e1-7130-4635-a580-9e5861e382b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:52.428006 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639661e1-7130-4635-a580-9e5861e382b0 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:52.428388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639661e1-7130-4635-a580-9e5861e382b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:52.428760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639661e1-7130-4635-a580-9e5861e382b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:52.429523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639661e1-7130-4635-a580-9e5861e382b0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:52.429942 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639661e1-7130-4635-a580-9e5861e382b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:52.431464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639661e1-7130-4635-a580-9e5861e382b0 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:52.440746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 58/111] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:43:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:43:52.441875 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1fc67-5cc9-4bdd-8c6f-9f82f3c65a94 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:52.442278 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1fc67-5cc9-4bdd-8c6f-9f82f3c65a94 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:52.442625 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1fc67-5cc9-4bdd-8c6f-9f82f3c65a94 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:52.447413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 54/112] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:43:52 2022] PUT /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1/users/69abfe9255ec4f2e97b3d7b9e1433201/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:43:52.448489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 59/113] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:52.450016 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a76a6-1f9c-4ba1-b1f3-7ef00f1733ec None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:52.458273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b17fa8-0745-438c-b441-e6a822ed0d1e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:52.458273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b17fa8-0745-438c-b441-e6a822ed0d1e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:52.458273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b17fa8-0745-438c-b441-e6a822ed0d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:52.490565 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-c3b17fa8-0745-438c-b441-e6a822ed0d1e None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:52.495269 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c3b17fa8-0745-438c-b441-e6a822ed0d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:52.531262 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:52.584877 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 60/114] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:43:52.586250 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399661c-e1af-43d4-8732-3a2ddc92037a None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:52.586535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399661c-e1af-43d4-8732-3a2ddc92037a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:52.586809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399661c-e1af-43d4-8732-3a2ddc92037a None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:52.593176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 61/115] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:52.594623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d7e4e-68b8-4f2f-918c-b64010743663 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:52.594910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d7e4e-68b8-4f2f-918c-b64010743663 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:52.595182 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d7e4e-68b8-4f2f-918c-b64010743663 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:52.596502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 62/116] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:52.598245 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a76a6-1f9c-4ba1-b1f3-7ef00f1733ec None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:52.605029 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8508bc5-4b2f-4ea8-926c-d149ebf5ca89 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:52.605337 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8508bc5-4b2f-4ea8-926c-d149ebf5ca89 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:52.605599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8508bc5-4b2f-4ea8-926c-d149ebf5ca89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:52.633421 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a8508bc5-4b2f-4ea8-926c-d149ebf5ca89 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:52.634610 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a8508bc5-4b2f-4ea8-926c-d149ebf5ca89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:52.643429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d2f6e-0f65-4875-babe-2a4978a353bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:52.644137 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d2f6e-0f65-4875-babe-2a4978a353bd None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:52.644578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d2f6e-0f65-4875-babe-2a4978a353bd None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:52.644867 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d2f6e-0f65-4875-babe-2a4978a353bd None admin] PATH_INFO: `/v3/users/9fe110ccd43341aba585d4f42aa402a5` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:52.660987 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d2f6e-0f65-4875-babe-2a4978a353bd None admin] RBAC: Authorizing `identity:get_user(user_id=9fe110ccd43341aba585d4f42aa402a5)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:52.662505 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d2f6e-0f65-4875-babe-2a4978a353bd None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:52.665206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 55/117] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:43:52 2022] GET /identity/v3/users/9fe110ccd43341aba585d4f42aa402a5 => generated 289 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:52.666496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8d536-4b66-4a07-b0ed-836aca8aeefb None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:52.666786 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8d536-4b66-4a07-b0ed-836aca8aeefb None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:52.667416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8d536-4b66-4a07-b0ed-836aca8aeefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:52.690813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-23f8d536-4b66-4a07-b0ed-836aca8aeefb None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:52.692238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-23f8d536-4b66-4a07-b0ed-836aca8aeefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:52.695638 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:52.710918 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 63/118] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:43:52.712489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8508bc5-4b2f-4ea8-926c-d149ebf5ca89 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:52.775384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 56/119] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:43:52.858754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:52.879089 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8508bc5-4b2f-4ea8-926c-d149ebf5ca89 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:52.929721 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5955fa-1fae-4f50-9e15-175d3bc2201d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:52.930345 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5955fa-1fae-4f50-9e15-175d3bc2201d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:52.930624 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5955fa-1fae-4f50-9e15-175d3bc2201d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:52.930894 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5955fa-1fae-4f50-9e15-175d3bc2201d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:53.013508 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5955fa-1fae-4f50-9e15-175d3bc2201d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:53.014928 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5955fa-1fae-4f50-9e15-175d3bc2201d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:53.070307 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8d536-4b66-4a07-b0ed-836aca8aeefb None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:53.143090 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:53.154687 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 64/120] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:43:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:43:53.155692 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5955fa-1fae-4f50-9e15-175d3bc2201d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:53.223553 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8d536-4b66-4a07-b0ed-836aca8aeefb None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:53.287023 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5955fa-1fae-4f50-9e15-175d3bc2201d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:53.290448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac478203-ccc3-4f49-82f2-0b7fad15858e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:53.291427 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac478203-ccc3-4f49-82f2-0b7fad15858e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:53.291861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac478203-ccc3-4f49-82f2-0b7fad15858e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:53.292271 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac478203-ccc3-4f49-82f2-0b7fad15858e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:53.306041 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:53.310742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac478203-ccc3-4f49-82f2-0b7fad15858e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:43:53.322709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ac478203-ccc3-4f49-82f2-0b7fad15858e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:43:53.322709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:43:53.322709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:43:53.322709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:43:53.322709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:43:53.322709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:43:53.322709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:43:53.322709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:43:53.322709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:43:53.322709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:43:53.322709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:43:53.322709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:43:53.322709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:43:53.322709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:43:53.322709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:43:53.322709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:43:53.323649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:43:53.323649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:43:53.323649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:43:53.323649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:43:53.323649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:43:53.323649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:43:53.323649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:43:53.323649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:43:53.323649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:43:53.323649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:43:53.323649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:43:53.323649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:43:53.323649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:43:53.323649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:43:53.323649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:43:53.323649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:43:53.324827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:43:53.324827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:43:53.324827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:43:53.324827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:43:53.324827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:43:53.324827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:43:53.324827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:43:53.324827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:43:53.324827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:43:53.324827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:43:53.324827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:43:53.324827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:43:53.324827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 57/121] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:43:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:43:53.324827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac478203-ccc3-4f49-82f2-0b7fad15858e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:53.330633 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83b36b-2bac-449b-bd7a-b713059cec4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:53.331587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83b36b-2bac-449b-bd7a-b713059cec4d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:53.332054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83b36b-2bac-449b-bd7a-b713059cec4d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:53.332530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83b36b-2bac-449b-bd7a-b713059cec4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:53.344596 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83b36b-2bac-449b-bd7a-b713059cec4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:43:53.349957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-7c83b36b-2bac-449b-bd7a-b713059cec4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:43:53.349957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:43:53.349957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:43:53.349957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:43:53.349957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:43:53.349957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:43:53.349957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:43:53.349957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:43:53.349957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:43:53.349957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:43:53.349957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:43:53.349957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:43:53.349957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:43:53.349957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:43:53.349957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:43:53.349957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:43:53.350810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:43:53.350810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:43:53.350810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:43:53.350810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:43:53.350810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:43:53.350810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:43:53.350810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:43:53.350810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:43:53.350810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:43:53.350810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:43:53.350810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:43:53.350810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:43:53.350810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:43:53.350810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:43:53.350810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:43:53.350810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:43:53.351958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:43:53.351958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:43:53.351958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:43:53.351958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:43:53.351958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:43:53.351958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:43:53.351958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:43:53.351958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:43:53.351958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:43:53.351958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:43:53.351958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:43:53.351958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:43:53.354043 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 65/122] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:43:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:43:53.355177 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83b36b-2bac-449b-bd7a-b713059cec4d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:53.410007 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:53.465475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac478203-ccc3-4f49-82f2-0b7fad15858e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:53.470882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83b36b-2bac-449b-bd7a-b713059cec4d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:53.501027 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737cba3-ba21-4c6d-b9fa-d52c2aad4e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:53.502163 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737cba3-ba21-4c6d-b9fa-d52c2aad4e1f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:53.502649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737cba3-ba21-4c6d-b9fa-d52c2aad4e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:53.503154 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737cba3-ba21-4c6d-b9fa-d52c2aad4e1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:53.512469 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f76f0-3625-45f9-8624-9b7d05292a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:53.513106 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f76f0-3625-45f9-8624-9b7d05292a90 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:53.513390 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f76f0-3625-45f9-8624-9b7d05292a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:53.513672 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f76f0-3625-45f9-8624-9b7d05292a90 None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:53.514916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737cba3-ba21-4c6d-b9fa-d52c2aad4e1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:43:53.515018 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f76f0-3625-45f9-8624-9b7d05292a90 None admin] RBAC: Authorizing `identity:get_project(project_id=1e107e4257e749cdbbc856b69ced1cc1)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:53.516633 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f76f0-3625-45f9-8624-9b7d05292a90 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:53.518582 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 66/123] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:43:53 2022] GET /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:53.519368 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f76f0-3625-45f9-8624-9b7d05292a90 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:53.521483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-7737cba3-ba21-4c6d-b9fa-d52c2aad4e1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:43:53.521483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:43:53.521483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:43:53.521483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:43:53.521483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:43:53.521483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:43:53.521483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:43:53.521483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:43:53.521483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:43:53.521483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:43:53.521483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:43:53.521483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:43:53.521483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:43:53.521483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:43:53.521483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:43:53.521483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:43:53.522330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:43:53.522330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:43:53.522330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:43:53.522330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:43:53.522330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:43:53.522330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:43:53.522330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:43:53.522330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:43:53.522330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:43:53.522330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:43:53.522330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:43:53.522330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:43:53.522330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:43:53.522330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:43:53.522330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:43:53.522330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:43:53.523704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:43:53.523704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:43:53.523704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:43:53.523704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:43:53.523704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:43:53.523704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:43:53.523704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:43:53.523704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:43:53.523704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:43:53.523704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:43:53.523704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:43:53.523704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:43:53.525746 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 58/124] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Aug 30 11:43:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:43:53.531222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737cba3-ba21-4c6d-b9fa-d52c2aad4e1f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:53.604549 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:53.643106 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f76f0-3625-45f9-8624-9b7d05292a90 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:53.657356 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737cba3-ba21-4c6d-b9fa-d52c2aad4e1f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:53.660239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:53.680808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7bfe1-6437-47bd-88e1-df1d74fa3167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:53.681673 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7bfe1-6437-47bd-88e1-df1d74fa3167 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:53.682164 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7bfe1-6437-47bd-88e1-df1d74fa3167 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:53.682709 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7bfe1-6437-47bd-88e1-df1d74fa3167 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:53.683613 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7bfe1-6437-47bd-88e1-df1d74fa3167 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:53.684149 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7bfe1-6437-47bd-88e1-df1d74fa3167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:53.685788 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7bfe1-6437-47bd-88e1-df1d74fa3167 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:53.698651 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 67/125] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:43:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:53.698651 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7bfe1-6437-47bd-88e1-df1d74fa3167 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:53.706260 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63753f92-51db-4a41-a726-52e3fd0893d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:53.706907 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63753f92-51db-4a41-a726-52e3fd0893d7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:53.707191 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63753f92-51db-4a41-a726-52e3fd0893d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:53.707508 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63753f92-51db-4a41-a726-52e3fd0893d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:53.708208 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63753f92-51db-4a41-a726-52e3fd0893d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:53.708522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63753f92-51db-4a41-a726-52e3fd0893d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:53.709986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63753f92-51db-4a41-a726-52e3fd0893d7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:53.720570 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 59/126] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:43:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:53.721469 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63753f92-51db-4a41-a726-52e3fd0893d7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:53.800074 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7bfe1-6437-47bd-88e1-df1d74fa3167 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:53.846594 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63753f92-51db-4a41-a726-52e3fd0893d7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:53.848723 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad7887-b7a5-4019-9f96-2616059f6945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:53.850475 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad7887-b7a5-4019-9f96-2616059f6945 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:53.850978 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad7887-b7a5-4019-9f96-2616059f6945 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:53.851517 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad7887-b7a5-4019-9f96-2616059f6945 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:53.852446 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad7887-b7a5-4019-9f96-2616059f6945 None admin] RBAC: Adding query filter params (role.id=0c933d29c2794fad8da4b91509d53aba, scope.project.id=1e107e4257e749cdbbc856b69ced1cc1, user.id=9fe110ccd43341aba585d4f42aa402a5) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:53.852950 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad7887-b7a5-4019-9f96-2616059f6945 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:53.855274 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad7887-b7a5-4019-9f96-2616059f6945 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:53.863776 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 68/127] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:43:53 2022] GET /identity/v3/role_assignments?user.id=9fe110ccd43341aba585d4f42aa402a5&scope.project.id=1e107e4257e749cdbbc856b69ced1cc1&role.id=0c933d29c2794fad8da4b91509d53aba => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:53.865067 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad7887-b7a5-4019-9f96-2616059f6945 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:53.882682 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:53.920662 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:53.923374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23183842-46f2-4f16-90ba-bd2ae8b1df7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:53.924110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23183842-46f2-4f16-90ba-bd2ae8b1df7f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:53.924393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23183842-46f2-4f16-90ba-bd2ae8b1df7f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:53.924697 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23183842-46f2-4f16-90ba-bd2ae8b1df7f None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:53.925352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23183842-46f2-4f16-90ba-bd2ae8b1df7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:53.925662 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23183842-46f2-4f16-90ba-bd2ae8b1df7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:53.927249 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23183842-46f2-4f16-90ba-bd2ae8b1df7f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:53.947720 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 60/128] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:43:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:53.948600 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23183842-46f2-4f16-90ba-bd2ae8b1df7f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:53.995583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad7887-b7a5-4019-9f96-2616059f6945 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:54.039053 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb75ba2-5e51-445e-b333-6ed7a3007e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:54.041039 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb75ba2-5e51-445e-b333-6ed7a3007e17 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:54.042869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb75ba2-5e51-445e-b333-6ed7a3007e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:54.045720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb75ba2-5e51-445e-b333-6ed7a3007e17 None admin] PATH_INFO: `/v3/users/fcaa90c0553848528e601e03ebda1656` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:54.047478 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb75ba2-5e51-445e-b333-6ed7a3007e17 None admin] RBAC: Authorizing `identity:get_user(user_id=fcaa90c0553848528e601e03ebda1656)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:54.049227 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb75ba2-5e51-445e-b333-6ed7a3007e17 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:54.054491 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 69/129] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:43:53 2022] GET /identity/v3/users/fcaa90c0553848528e601e03ebda1656 => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:54.058226 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb75ba2-5e51-445e-b333-6ed7a3007e17 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:54.200322 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23183842-46f2-4f16-90ba-bd2ae8b1df7f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:54.219119 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb75ba2-5e51-445e-b333-6ed7a3007e17 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:54.232184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:54.259785 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2516c-7b05-453e-ba67-f462eef06fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:54.260971 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2516c-7b05-453e-ba67-f462eef06fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:54.261636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2516c-7b05-453e-ba67-f462eef06fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:54.262303 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2516c-7b05-453e-ba67-f462eef06fa5 None admin] PATH_INFO: `/v3/users/69abfe9255ec4f2e97b3d7b9e1433201` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:54.264059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2516c-7b05-453e-ba67-f462eef06fa5 None admin] RBAC: Authorizing `identity:get_user(user_id=69abfe9255ec4f2e97b3d7b9e1433201)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:54.265932 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2516c-7b05-453e-ba67-f462eef06fa5 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:54.268154 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 70/130] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:43:54 2022] GET /identity/v3/users/69abfe9255ec4f2e97b3d7b9e1433201 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:54.269258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2516c-7b05-453e-ba67-f462eef06fa5 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:54.283906 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcadb5-0ea7-4f3e-9311-29364f67e646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:54.284556 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcadb5-0ea7-4f3e-9311-29364f67e646 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:54.284836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcadb5-0ea7-4f3e-9311-29364f67e646 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:54.285108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcadb5-0ea7-4f3e-9311-29364f67e646 None admin] PATH_INFO: `/v3/users/69abfe9255ec4f2e97b3d7b9e1433201` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:54.286250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efcadb5-0ea7-4f3e-9311-29364f67e646 None admin] RBAC: Authorizing `identity:get_user(user_id=69abfe9255ec4f2e97b3d7b9e1433201)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:54.287977 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efcadb5-0ea7-4f3e-9311-29364f67e646 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:54.289333 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 61/131] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:43:53 2022] GET /identity/v3/users/69abfe9255ec4f2e97b3d7b9e1433201 => generated 275 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:54.290178 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcadb5-0ea7-4f3e-9311-29364f67e646 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:54.373442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:54.385215 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2516c-7b05-453e-ba67-f462eef06fa5 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:54.421897 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a559fb-a9c2-47c9-989f-7ba403818dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:54.423341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a559fb-a9c2-47c9-989f-7ba403818dbb None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:54.423859 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a559fb-a9c2-47c9-989f-7ba403818dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:54.424350 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a559fb-a9c2-47c9-989f-7ba403818dbb None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:54.425717 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a559fb-a9c2-47c9-989f-7ba403818dbb None admin] RBAC: Authorizing `identity:get_project(project_id=1e107e4257e749cdbbc856b69ced1cc1)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:54.427444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a559fb-a9c2-47c9-989f-7ba403818dbb None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:54.429829 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 71/132] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:43:54 2022] GET /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:54.430987 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a559fb-a9c2-47c9-989f-7ba403818dbb None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:54.487839 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:54.490316 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcadb5-0ea7-4f3e-9311-29364f67e646 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:54.544409 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a559fb-a9c2-47c9-989f-7ba403818dbb None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:54.580736 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013c458-2927-4f0c-836b-bd347ffbb498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:54.581724 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013c458-2927-4f0c-836b-bd347ffbb498 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:54.582215 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013c458-2927-4f0c-836b-bd347ffbb498 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:54.582704 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013c458-2927-4f0c-836b-bd347ffbb498 None admin] PATH_INFO: `/v3/projects/b80f6823f3ab4fe2914a1133b2acccee` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:54.584035 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013c458-2927-4f0c-836b-bd347ffbb498 None admin] RBAC: Authorizing `identity:get_project(project_id=b80f6823f3ab4fe2914a1133b2acccee)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:54.585700 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013c458-2927-4f0c-836b-bd347ffbb498 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:54.587579 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 72/133] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:43:54 2022] GET /identity/v3/projects/b80f6823f3ab4fe2914a1133b2acccee => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:54.588528 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013c458-2927-4f0c-836b-bd347ffbb498 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:54.594002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3438e2-ad4d-419e-bb9c-3b2bf1071f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:54.594002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3438e2-ad4d-419e-bb9c-3b2bf1071f84 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:54.594002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3438e2-ad4d-419e-bb9c-3b2bf1071f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:54.594002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3438e2-ad4d-419e-bb9c-3b2bf1071f84 None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:54.600108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3438e2-ad4d-419e-bb9c-3b2bf1071f84 None admin] RBAC: Authorizing `identity:get_project(project_id=1e107e4257e749cdbbc856b69ced1cc1)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:54.601588 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3438e2-ad4d-419e-bb9c-3b2bf1071f84 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:54.603322 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 62/134] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:43:54 2022] GET /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1 => generated 298 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:54.604293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3438e2-ad4d-419e-bb9c-3b2bf1071f84 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:54.711025 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013c458-2927-4f0c-836b-bd347ffbb498 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:54.733112 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3438e2-ad4d-419e-bb9c-3b2bf1071f84 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:54.739817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:54.749061 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6457b-3b42-4ead-acd8-d91e527e22d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:54.750031 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6457b-3b42-4ead-acd8-d91e527e22d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:54.750549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6457b-3b42-4ead-acd8-d91e527e22d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:54.751052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6457b-3b42-4ead-acd8-d91e527e22d5 None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1/users/fcaa90c0553848528e601e03ebda1656/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:54.753358 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6457b-3b42-4ead-acd8-d91e527e22d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e107e4257e749cdbbc856b69ced1cc1, user_id=fcaa90c0553848528e601e03ebda1656, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:54.755137 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:54.756197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6457b-3b42-4ead-acd8-d91e527e22d5 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:54.772696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 73/135] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:43:54 2022] PUT /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1/users/fcaa90c0553848528e601e03ebda1656/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:43:54.773778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6457b-3b42-4ead-acd8-d91e527e22d5 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:54.774635 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fd699-3ee3-4cd2-aede-0feea86c3630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:54.775502 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fd699-3ee3-4cd2-aede-0feea86c3630 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:54.775886 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fd699-3ee3-4cd2-aede-0feea86c3630 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:54.776265 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fd699-3ee3-4cd2-aede-0feea86c3630 None admin] PATH_INFO: `/v3/projects/b80f6823f3ab4fe2914a1133b2acccee/users/69abfe9255ec4f2e97b3d7b9e1433201/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:54.778436 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fd699-3ee3-4cd2-aede-0feea86c3630 None admin] RBAC: Authorizing `identity:create_grant(project_id=b80f6823f3ab4fe2914a1133b2acccee, user_id=69abfe9255ec4f2e97b3d7b9e1433201, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:54.780099 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fd699-3ee3-4cd2-aede-0feea86c3630 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:54.797807 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 63/136] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:43:54 2022] PUT /identity/v3/projects/b80f6823f3ab4fe2914a1133b2acccee/users/69abfe9255ec4f2e97b3d7b9e1433201/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:43:54.803609 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43216c-ddf0-48fd-9194-5de385bf7e6f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:54.803609 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43216c-ddf0-48fd-9194-5de385bf7e6f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:54.803609 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43216c-ddf0-48fd-9194-5de385bf7e6f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:54.803609 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 64/137] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:54.807338 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d9d38-694f-4424-8ca9-838b05a9d3f6 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:54.807722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d9d38-694f-4424-8ca9-838b05a9d3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:54.808280 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d9d38-694f-4424-8ca9-838b05a9d3f6 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:54.810119 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 65/138] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:54.811407 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb7fca-e79e-4f0c-a932-b480a1e0e541 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:54.812180 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb7fca-e79e-4f0c-a932-b480a1e0e541 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:54.812180 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb7fca-e79e-4f0c-a932-b480a1e0e541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:54.833862 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5ebb7fca-e79e-4f0c-a932-b480a1e0e541 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:54.835210 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5ebb7fca-e79e-4f0c-a932-b480a1e0e541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:54.950928 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 66/139] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:43:54.955398 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0925fa-3315-4ec1-999d-1e5e1c147093 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:54.955961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0925fa-3315-4ec1-999d-1e5e1c147093 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:54.956405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0925fa-3315-4ec1-999d-1e5e1c147093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:54.988259 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8c0925fa-3315-4ec1-999d-1e5e1c147093 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:54.988739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6457b-3b42-4ead-acd8-d91e527e22d5 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:54.990483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8c0925fa-3315-4ec1-999d-1e5e1c147093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:55.032426 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62006d23-5549-4ec8-84af-c1113c666924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:55.033108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62006d23-5549-4ec8-84af-c1113c666924 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:55.033398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62006d23-5549-4ec8-84af-c1113c666924 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:55.033660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62006d23-5549-4ec8-84af-c1113c666924 None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1/users/69abfe9255ec4f2e97b3d7b9e1433201/roles/30c5b9fbbb564c6dafe66f759683738b` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:55.035897 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62006d23-5549-4ec8-84af-c1113c666924 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e107e4257e749cdbbc856b69ced1cc1, user_id=69abfe9255ec4f2e97b3d7b9e1433201, role_id=30c5b9fbbb564c6dafe66f759683738b)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:55.037393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62006d23-5549-4ec8-84af-c1113c666924 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:55.070699 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 74/140] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:43:54 2022] PUT /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1/users/69abfe9255ec4f2e97b3d7b9e1433201/roles/30c5b9fbbb564c6dafe66f759683738b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:43:55.078906 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 67/141] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:43:55.303568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62006d23-5549-4ec8-84af-c1113c666924 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:55.350987 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:55.432891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62006d23-5549-4ec8-84af-c1113c666924 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:55.474550 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df3277-d9f3-4e05-999a-aabb21154dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:55.475204 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df3277-d9f3-4e05-999a-aabb21154dff None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:55.475508 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df3277-d9f3-4e05-999a-aabb21154dff None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:55.475777 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df3277-d9f3-4e05-999a-aabb21154dff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:55.476902 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df3277-d9f3-4e05-999a-aabb21154dff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:55.478438 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df3277-d9f3-4e05-999a-aabb21154dff None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:55.480127 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 75/142] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:43:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:55.485920 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0925fa-3315-4ec1-999d-1e5e1c147093 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:55.514846 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df3277-d9f3-4e05-999a-aabb21154dff None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:55.544200 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:55.613025 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0925fa-3315-4ec1-999d-1e5e1c147093 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:55.651258 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa86739-3075-4e55-9754-53c66efad68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:55.652320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa86739-3075-4e55-9754-53c66efad68c None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:55.652740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa86739-3075-4e55-9754-53c66efad68c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:55.653148 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa86739-3075-4e55-9754-53c66efad68c None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:55.654498 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa86739-3075-4e55-9754-53c66efad68c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:55.656396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa86739-3075-4e55-9754-53c66efad68c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:55.698079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df3277-d9f3-4e05-999a-aabb21154dff None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:55.700150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:55.712990 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 68/143] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Aug 30 11:43:55 2022] POST /identity/v3/users => generated 283 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:43:55.759134 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6173c1-50be-47a4-975e-e217da863575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:55.759812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6173c1-50be-47a4-975e-e217da863575 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:55.760098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6173c1-50be-47a4-975e-e217da863575 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:55.760364 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6173c1-50be-47a4-975e-e217da863575 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:55.777371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6173c1-50be-47a4-975e-e217da863575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:43:55.782910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-8b6173c1-50be-47a4-975e-e217da863575 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:43:55.782910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:43:55.782910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:43:55.782910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:43:55.782910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:43:55.782910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:43:55.782910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:43:55.782910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:43:55.782910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:43:55.782910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:43:55.782910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:43:55.782910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:43:55.782910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:43:55.782910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:43:55.782910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:43:55.782910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:43:55.783789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:43:55.783789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:43:55.783789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:43:55.783789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:43:55.783789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:43:55.783789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:43:55.783789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:43:55.783789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:43:55.783789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:43:55.783789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:43:55.783789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:43:55.783789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:43:55.783789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:43:55.783789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:43:55.783789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:43:55.783789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:43:55.784572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:43:55.784572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:43:55.784572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:43:55.784572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:43:55.784572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:43:55.784572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:43:55.784572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:43:55.784572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:43:55.784572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:43:55.784572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:43:55.784572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:43:55.784572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:43:55.784572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 76/144] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:43:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:43:55.792274 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa86739-3075-4e55-9754-53c66efad68c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:55.913093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:55.920609 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa86739-3075-4e55-9754-53c66efad68c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:55.966521 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9cc17-221b-484e-bc2b-416454e9f6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:55.967566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9cc17-221b-484e-bc2b-416454e9f6fd None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:55.968037 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9cc17-221b-484e-bc2b-416454e9f6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:55.968494 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9cc17-221b-484e-bc2b-416454e9f6fd None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:55.969865 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9cc17-221b-484e-bc2b-416454e9f6fd None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:55.970478 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9cc17-221b-484e-bc2b-416454e9f6fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:55.972206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9cc17-221b-484e-bc2b-416454e9f6fd None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:55.985699 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 69/145] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:43:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:55.991565 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6173c1-50be-47a4-975e-e217da863575 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:56.131843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6173c1-50be-47a4-975e-e217da863575 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:56.150423 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ce3e8-043b-499b-9222-1e69bacde7c6 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:56.151017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ce3e8-043b-499b-9222-1e69bacde7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:56.151527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ce3e8-043b-499b-9222-1e69bacde7c6 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:56.153084 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 70/146] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:56.160221 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148bd4f-43bb-408e-8433-e809dd8ec779 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:56.160753 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148bd4f-43bb-408e-8433-e809dd8ec779 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:56.161200 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148bd4f-43bb-408e-8433-e809dd8ec779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:56.186316 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7151b9f-465d-4ab4-9463-fb440578d12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:56.186965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7151b9f-465d-4ab4-9463-fb440578d12f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:56.187243 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7151b9f-465d-4ab4-9463-fb440578d12f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:56.187584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7151b9f-465d-4ab4-9463-fb440578d12f None admin] PATH_INFO: `/v3/users/69abfe9255ec4f2e97b3d7b9e1433201` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:56.188817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7151b9f-465d-4ab4-9463-fb440578d12f None admin] RBAC: Authorizing `identity:get_user(user_id=69abfe9255ec4f2e97b3d7b9e1433201)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:56.190299 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7151b9f-465d-4ab4-9463-fb440578d12f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:56.191943 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 77/147] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:43:55 2022] GET /identity/v3/users/69abfe9255ec4f2e97b3d7b9e1433201 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:56.193203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d148bd4f-43bb-408e-8433-e809dd8ec779 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:56.194696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d148bd4f-43bb-408e-8433-e809dd8ec779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:56.200649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7151b9f-465d-4ab4-9463-fb440578d12f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:56.260861 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:56.333165 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 71/148] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:43:56.383524 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7151b9f-465d-4ab4-9463-fb440578d12f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:56.433951 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dadcec-dd76-48de-91b9-09ef81b4ed8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:56.434639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dadcec-dd76-48de-91b9-09ef81b4ed8a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:56.434919 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dadcec-dd76-48de-91b9-09ef81b4ed8a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:56.435187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dadcec-dd76-48de-91b9-09ef81b4ed8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:56.530026 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dadcec-dd76-48de-91b9-09ef81b4ed8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:56.531789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dadcec-dd76-48de-91b9-09ef81b4ed8a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:56.579731 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:56.681524 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 78/149] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:43:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:43:56.687579 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148bd4f-43bb-408e-8433-e809dd8ec779 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:56.753377 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dadcec-dd76-48de-91b9-09ef81b4ed8a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:56.806558 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:56.826995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148bd4f-43bb-408e-8433-e809dd8ec779 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:56.879171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc75af-d55f-4fcf-9769-ae4afe9bfb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:56.879889 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc75af-d55f-4fcf-9769-ae4afe9bfb2e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:56.880178 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc75af-d55f-4fcf-9769-ae4afe9bfb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:56.880457 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc75af-d55f-4fcf-9769-ae4afe9bfb2e None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:56.884068 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc75af-d55f-4fcf-9769-ae4afe9bfb2e None admin] RBAC: Authorizing `identity:get_project(project_id=1e107e4257e749cdbbc856b69ced1cc1)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:56.885715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc75af-d55f-4fcf-9769-ae4afe9bfb2e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:56.887558 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 72/150] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:43:56 2022] GET /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:56.887991 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dadcec-dd76-48de-91b9-09ef81b4ed8a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:56.893813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc75af-d55f-4fcf-9769-ae4afe9bfb2e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:56.919983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:56.927982 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec01dfd-376a-45c4-9342-b7785e2a0ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:56.928693 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec01dfd-376a-45c4-9342-b7785e2a0ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:56.928979 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec01dfd-376a-45c4-9342-b7785e2a0ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:56.929251 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec01dfd-376a-45c4-9342-b7785e2a0ff2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:56.940837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec01dfd-376a-45c4-9342-b7785e2a0ff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:43:56.945992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-4ec01dfd-376a-45c4-9342-b7785e2a0ff2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:43:56.945992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:43:56.945992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:43:56.945992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:43:56.945992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:43:56.945992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:43:56.945992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:43:56.945992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:43:56.945992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:43:56.945992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:43:56.945992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:43:56.945992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:43:56.945992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:43:56.945992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:43:56.945992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:43:56.945992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:43:56.946799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:43:56.946799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:43:56.946799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:43:56.946799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:43:56.946799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:43:56.946799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:43:56.946799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:43:56.946799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:43:56.946799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:43:56.946799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:43:56.946799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:43:56.946799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:43:56.946799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:43:56.946799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:43:56.946799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:43:56.946799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:43:56.947598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:43:56.947598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:43:56.947598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:43:56.947598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:43:56.947598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:43:56.947598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:43:56.947598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:43:56.947598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:43:56.947598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:43:56.947598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:43:56.947598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:43:56.947598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:43:56.947598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 79/151] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:43:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:43:56.956597 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec01dfd-376a-45c4-9342-b7785e2a0ff2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:57.074994 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec01dfd-376a-45c4-9342-b7785e2a0ff2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:57.106677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc75af-d55f-4fcf-9769-ae4afe9bfb2e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:57.129146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abe304-4b12-41ca-bbc4-b03cca7e1234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:57.129784 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abe304-4b12-41ca-bbc4-b03cca7e1234 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:57.130062 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abe304-4b12-41ca-bbc4-b03cca7e1234 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:57.130334 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abe304-4b12-41ca-bbc4-b03cca7e1234 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:57.131008 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abe304-4b12-41ca-bbc4-b03cca7e1234 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:57.131311 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abe304-4b12-41ca-bbc4-b03cca7e1234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:57.132756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abe304-4b12-41ca-bbc4-b03cca7e1234 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:57.161804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 80/152] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:43:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:57.168762 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abe304-4b12-41ca-bbc4-b03cca7e1234 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:57.195230 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bd500-a1fe-49ff-97c6-7a7c3b502bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:57.195891 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bd500-a1fe-49ff-97c6-7a7c3b502bee None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:57.196179 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bd500-a1fe-49ff-97c6-7a7c3b502bee None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:57.196466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bd500-a1fe-49ff-97c6-7a7c3b502bee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:57.197203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bd500-a1fe-49ff-97c6-7a7c3b502bee None admin] RBAC: Adding query filter params (role.id=7f855c6f817f4a64a1e635407de8bfb0, scope.project.id=1e107e4257e749cdbbc856b69ced1cc1, user.id=69abfe9255ec4f2e97b3d7b9e1433201) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:57.197521 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bd500-a1fe-49ff-97c6-7a7c3b502bee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:57.198996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bd500-a1fe-49ff-97c6-7a7c3b502bee None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:57.212280 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 73/153] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:43:56 2022] GET /identity/v3/role_assignments?user.id=69abfe9255ec4f2e97b3d7b9e1433201&scope.project.id=1e107e4257e749cdbbc856b69ced1cc1&role.id=7f855c6f817f4a64a1e635407de8bfb0 => generated 608 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:43:57.263050 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:57.337009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abe304-4b12-41ca-bbc4-b03cca7e1234 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:57.382480 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64d3db-ff31-4a81-8f35-f09ae577adf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:57.383142 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64d3db-ff31-4a81-8f35-f09ae577adf1 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:57.383458 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64d3db-ff31-4a81-8f35-f09ae577adf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:57.383738 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64d3db-ff31-4a81-8f35-f09ae577adf1 None admin] PATH_INFO: `/v3/users/9fe110ccd43341aba585d4f42aa402a5` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:57.384908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64d3db-ff31-4a81-8f35-f09ae577adf1 None admin] RBAC: Authorizing `identity:get_user(user_id=9fe110ccd43341aba585d4f42aa402a5)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:57.386494 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64d3db-ff31-4a81-8f35-f09ae577adf1 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:57.388176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 81/154] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:43:57 2022] GET /identity/v3/users/9fe110ccd43341aba585d4f42aa402a5 => generated 289 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:57.394008 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bd500-a1fe-49ff-97c6-7a7c3b502bee None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:57.431845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:57.527274 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bd500-a1fe-49ff-97c6-7a7c3b502bee None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:57.570777 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25878e33-5c6a-40ed-928d-cbb19f0d1b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:57.571720 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25878e33-5c6a-40ed-928d-cbb19f0d1b4b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:57.571998 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25878e33-5c6a-40ed-928d-cbb19f0d1b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:57.572268 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25878e33-5c6a-40ed-928d-cbb19f0d1b4b None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:57.573421 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25878e33-5c6a-40ed-928d-cbb19f0d1b4b None admin] RBAC: Authorizing `identity:get_project(project_id=1e107e4257e749cdbbc856b69ced1cc1)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:57.574880 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25878e33-5c6a-40ed-928d-cbb19f0d1b4b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:57.576558 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 74/155] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:43:57 2022] GET /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:57.582773 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64d3db-ff31-4a81-8f35-f09ae577adf1 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:57.724568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64d3db-ff31-4a81-8f35-f09ae577adf1 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:57.755031 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:57.778872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51283dd-a2fe-4a1f-bc53-aa515feb1807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:57.779589 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51283dd-a2fe-4a1f-bc53-aa515feb1807 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:57.779872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51283dd-a2fe-4a1f-bc53-aa515feb1807 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:57.780151 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51283dd-a2fe-4a1f-bc53-aa515feb1807 None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1/users/9fe110ccd43341aba585d4f42aa402a5/roles/0c933d29c2794fad8da4b91509d53aba` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:57.782829 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51283dd-a2fe-4a1f-bc53-aa515feb1807 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e107e4257e749cdbbc856b69ced1cc1, user_id=9fe110ccd43341aba585d4f42aa402a5, role_id=0c933d29c2794fad8da4b91509d53aba)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:57.784376 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51283dd-a2fe-4a1f-bc53-aa515feb1807 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:57.810710 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 82/156] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:43:57 2022] PUT /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1/users/9fe110ccd43341aba585d4f42aa402a5/roles/0c933d29c2794fad8da4b91509d53aba => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:43:57.934649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8727c5-68af-4f25-9cf7-4ee56b3274d6 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:57.935957 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8727c5-68af-4f25-9cf7-4ee56b3274d6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:57.936598 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8727c5-68af-4f25-9cf7-4ee56b3274d6 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:57.938427 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 75/157] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:57.944695 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc65249-e2d2-4de7-bfa0-b8f466cb8754 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:57.945008 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc65249-e2d2-4de7-bfa0-b8f466cb8754 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:57.945294 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc65249-e2d2-4de7-bfa0-b8f466cb8754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:57.971049 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-7bc65249-e2d2-4de7-bfa0-b8f466cb8754 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:57.972287 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7bc65249-e2d2-4de7-bfa0-b8f466cb8754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:58.012115 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec77e6-e19b-4de6-9543-5d73d518cddc None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:58.012717 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec77e6-e19b-4de6-9543-5d73d518cddc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:58.013277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec77e6-e19b-4de6-9543-5d73d518cddc None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:58.014909 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 76/158] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:43:58.030486 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1175e93-f7c2-40bc-bc94-459cc07d6f82 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:58.031114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1175e93-f7c2-40bc-bc94-459cc07d6f82 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:58.033440 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1175e93-f7c2-40bc-bc94-459cc07d6f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:58.065615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 83/159] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:43:58.072387 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c1175e93-f7c2-40bc-bc94-459cc07d6f82 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:58.073910 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c1175e93-f7c2-40bc-bc94-459cc07d6f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:58.128994 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53dee8-9c34-46d4-a2f8-2ed005f1c138 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:58.129520 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53dee8-9c34-46d4-a2f8-2ed005f1c138 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:58.129520 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53dee8-9c34-46d4-a2f8-2ed005f1c138 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:58.130914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 84/160] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:43:58.138036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0892366-26b9-4fe8-adf7-7d333f4495b8 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:58.138352 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0892366-26b9-4fe8-adf7-7d333f4495b8 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:58.138583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0892366-26b9-4fe8-adf7-7d333f4495b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:58.186843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-c0892366-26b9-4fe8-adf7-7d333f4495b8 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:43:58.191056 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c0892366-26b9-4fe8-adf7-7d333f4495b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:43:58.198353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 77/161] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:43:58.267756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 85/162] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:43:58.497838 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1175e93-f7c2-40bc-bc94-459cc07d6f82 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:58.522318 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:58.614965 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1175e93-f7c2-40bc-bc94-459cc07d6f82 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:58.654986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068b732-65f6-4d9a-a6e3-8f0cc241085e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:58.655651 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068b732-65f6-4d9a-a6e3-8f0cc241085e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:58.655974 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068b732-65f6-4d9a-a6e3-8f0cc241085e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:58.656244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068b732-65f6-4d9a-a6e3-8f0cc241085e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:58.672471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068b732-65f6-4d9a-a6e3-8f0cc241085e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:43:58.677339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-7068b732-65f6-4d9a-a6e3-8f0cc241085e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:43:58.677339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:43:58.677339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:43:58.677339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:43:58.677339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:43:58.677339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:43:58.677339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:43:58.677339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:43:58.677339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:43:58.677339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:43:58.677339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:43:58.677339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:43:58.677339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:43:58.677339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:43:58.677339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:43:58.677339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:43:58.678175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:43:58.678175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:43:58.678175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:43:58.678175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:43:58.678175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:43:58.678175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:43:58.678175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:43:58.678175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:43:58.678175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:43:58.678175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:43:58.678175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:43:58.678175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:43:58.678175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:43:58.678175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:43:58.678175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:43:58.678175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:43:58.678941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:43:58.678941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:43:58.678941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:43:58.678941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:43:58.678941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:43:58.678941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:43:58.678941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:43:58.678941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:43:58.678941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:43:58.678941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:43:58.678941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:43:58.678941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:43:58.678941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 78/163] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Aug 30 11:43:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:43:58.684591 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0892366-26b9-4fe8-adf7-7d333f4495b8 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:58.748667 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:58.801556 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068b732-65f6-4d9a-a6e3-8f0cc241085e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:58.818308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0892366-26b9-4fe8-adf7-7d333f4495b8 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:58.858255 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2229f7e-44b8-4a37-b9b4-9c39426d31b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:58.858888 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2229f7e-44b8-4a37-b9b4-9c39426d31b4 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:58.859168 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2229f7e-44b8-4a37-b9b4-9c39426d31b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:58.859525 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2229f7e-44b8-4a37-b9b4-9c39426d31b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:58.860911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2229f7e-44b8-4a37-b9b4-9c39426d31b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:58.861261 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2229f7e-44b8-4a37-b9b4-9c39426d31b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:58.862717 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2229f7e-44b8-4a37-b9b4-9c39426d31b4 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:58.871293 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 86/164] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:43:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:58.876836 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2229f7e-44b8-4a37-b9b4-9c39426d31b4 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:58.995339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:59.016268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2229f7e-44b8-4a37-b9b4-9c39426d31b4 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:59.019930 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:59.049722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068b732-65f6-4d9a-a6e3-8f0cc241085e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:59.077471 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e321b1-5d79-4c78-bb3a-a245e9271d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:59.078638 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e321b1-5d79-4c78-bb3a-a245e9271d26 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:59.079060 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e321b1-5d79-4c78-bb3a-a245e9271d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:59.079564 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e321b1-5d79-4c78-bb3a-a245e9271d26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:59.098053 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e321b1-5d79-4c78-bb3a-a245e9271d26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:43:59.110826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-09e321b1-5d79-4c78-bb3a-a245e9271d26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:43:59.110826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:43:59.110826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:43:59.110826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:43:59.110826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:43:59.110826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:43:59.110826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:43:59.110826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:43:59.110826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:43:59.110826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:43:59.110826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:43:59.110826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:43:59.110826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:43:59.110826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:43:59.110826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:43:59.110826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:43:59.111708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:43:59.111708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:43:59.111708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:43:59.111708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:43:59.111708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:43:59.111708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:43:59.111708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:43:59.111708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:43:59.111708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:43:59.111708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:43:59.111708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:43:59.111708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:43:59.111708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:43:59.111708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:43:59.111708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:43:59.111708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:43:59.112482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:43:59.112482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:43:59.112482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:43:59.112482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:43:59.112482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:43:59.112482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:43:59.112482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:43:59.112482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:43:59.112482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:43:59.112482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:43:59.112482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:43:59.112482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:43:59.112482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 87/165] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:43:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:43:59.113347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e321b1-5d79-4c78-bb3a-a245e9271d26 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:59.129728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc97608-4dd8-47ae-aba7-971fbb8a10af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:59.130438 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc97608-4dd8-47ae-aba7-971fbb8a10af None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:59.130718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc97608-4dd8-47ae-aba7-971fbb8a10af None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:59.130996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc97608-4dd8-47ae-aba7-971fbb8a10af None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:59.151424 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc97608-4dd8-47ae-aba7-971fbb8a10af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:43:59.156403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ebc97608-4dd8-47ae-aba7-971fbb8a10af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:43:59.156403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:43:59.156403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:43:59.156403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:43:59.156403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:43:59.156403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:43:59.156403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:43:59.156403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:43:59.156403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:43:59.156403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:43:59.156403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:43:59.156403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:43:59.156403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:43:59.156403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:43:59.156403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:43:59.156403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:43:59.157460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:43:59.157460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:43:59.157460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:43:59.157460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:43:59.157460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:43:59.157460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:43:59.157460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:43:59.157460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:43:59.157460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:43:59.157460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:43:59.157460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:43:59.157460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:43:59.157460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:43:59.157460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:43:59.157460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:43:59.157460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:43:59.158247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:43:59.158247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:43:59.158247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:43:59.158247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:43:59.158247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:43:59.158247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:43:59.158247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:43:59.158247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:43:59.158247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:43:59.158247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:43:59.158247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:43:59.158247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:43:59.158247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 79/166] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:43:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:43:59.158893 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc97608-4dd8-47ae-aba7-971fbb8a10af None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:59.224120 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e321b1-5d79-4c78-bb3a-a245e9271d26 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:59.260524 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdc344-a875-45ed-9d31-e1f0b720685b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:59.261320 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdc344-a875-45ed-9d31-e1f0b720685b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:59.261696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdc344-a875-45ed-9d31-e1f0b720685b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:59.262098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdc344-a875-45ed-9d31-e1f0b720685b None admin] PATH_INFO: `/v3/users/69abfe9255ec4f2e97b3d7b9e1433201` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:59.263339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdc344-a875-45ed-9d31-e1f0b720685b None admin] RBAC: Authorizing `identity:get_user(user_id=69abfe9255ec4f2e97b3d7b9e1433201)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:59.264998 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdc344-a875-45ed-9d31-e1f0b720685b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:59.267510 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 88/167] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:43:59 2022] GET /identity/v3/users/69abfe9255ec4f2e97b3d7b9e1433201 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:59.268431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdc344-a875-45ed-9d31-e1f0b720685b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:59.318164 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:59.355989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc97608-4dd8-47ae-aba7-971fbb8a10af None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:59.412487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdc344-a875-45ed-9d31-e1f0b720685b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:59.430262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f33ff9-3bff-4641-b95d-b506cf8e22f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:59.431219 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f33ff9-3bff-4641-b95d-b506cf8e22f8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:59.431714 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f33ff9-3bff-4641-b95d-b506cf8e22f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:59.432196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f33ff9-3bff-4641-b95d-b506cf8e22f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:59.433159 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f33ff9-3bff-4641-b95d-b506cf8e22f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:59.433699 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f33ff9-3bff-4641-b95d-b506cf8e22f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:59.435296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f33ff9-3bff-4641-b95d-b506cf8e22f8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:59.446926 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:59.455000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 80/168] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:43:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:59.456234 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f33ff9-3bff-4641-b95d-b506cf8e22f8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:59.456409 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f1739-c4f7-451c-9dbd-314b794ffc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:59.461054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f1739-c4f7-451c-9dbd-314b794ffc2b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:59.461054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f1739-c4f7-451c-9dbd-314b794ffc2b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:59.461054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f1739-c4f7-451c-9dbd-314b794ffc2b None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:59.461054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f1739-c4f7-451c-9dbd-314b794ffc2b None admin] RBAC: Adding query filter params (name=member) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:43:59.461054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f1739-c4f7-451c-9dbd-314b794ffc2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:59.461054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f1739-c4f7-451c-9dbd-314b794ffc2b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:59.474256 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 89/169] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:43:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:59.475830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f1739-c4f7-451c-9dbd-314b794ffc2b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:59.585054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:59.594957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f1739-c4f7-451c-9dbd-314b794ffc2b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:59.630885 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cbd13-5686-4f90-8470-7dd0ec9723be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:59.631484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cbd13-5686-4f90-8470-7dd0ec9723be None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:59.631986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cbd13-5686-4f90-8470-7dd0ec9723be None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:59.632355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cbd13-5686-4f90-8470-7dd0ec9723be None admin] PATH_INFO: `/v3/users/fcaa90c0553848528e601e03ebda1656` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:59.633599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cbd13-5686-4f90-8470-7dd0ec9723be None admin] RBAC: Authorizing `identity:get_user(user_id=fcaa90c0553848528e601e03ebda1656)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:59.635164 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cbd13-5686-4f90-8470-7dd0ec9723be None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:59.636902 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 90/170] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:43:59 2022] GET /identity/v3/users/fcaa90c0553848528e601e03ebda1656 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:59.637856 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cbd13-5686-4f90-8470-7dd0ec9723be None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:59.651663 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f33ff9-3bff-4641-b95d-b506cf8e22f8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:59.713371 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a3890-4fda-4653-ad62-20026880445d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:59.714261 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a3890-4fda-4653-ad62-20026880445d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:59.714677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a3890-4fda-4653-ad62-20026880445d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:59.715460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a3890-4fda-4653-ad62-20026880445d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:59.757878 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cbd13-5686-4f90-8470-7dd0ec9723be None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:43:59.836282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b381b63-312d-4836-b469-1cab29f22c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:43:59.836935 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b381b63-312d-4836-b469-1cab29f22c67 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:43:59.837216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b381b63-312d-4836-b469-1cab29f22c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:43:59.837488 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b381b63-312d-4836-b469-1cab29f22c67 None admin] PATH_INFO: `/v3/users/69abfe9255ec4f2e97b3d7b9e1433201` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:43:59.840315 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b381b63-312d-4836-b469-1cab29f22c67 None admin] RBAC: Authorizing `identity:get_user(user_id=69abfe9255ec4f2e97b3d7b9e1433201)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:59.841796 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b381b63-312d-4836-b469-1cab29f22c67 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:59.843599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 91/171] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:43:59 2022] GET /identity/v3/users/69abfe9255ec4f2e97b3d7b9e1433201 => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:43:59.848994 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b381b63-312d-4836-b469-1cab29f22c67 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:43:59.867708 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:43:59.869692 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a3890-4fda-4653-ad62-20026880445d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:43:59.871254 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a3890-4fda-4653-ad62-20026880445d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:43:59.926140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:00.025944 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 81/172] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:43:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:00.026806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a3890-4fda-4653-ad62-20026880445d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:00.139742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:00.144041 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a3890-4fda-4653-ad62-20026880445d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:00.178995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90375f55-9de8-48e8-8ea2-ef64d95a0c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:00.179710 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90375f55-9de8-48e8-8ea2-ef64d95a0c28 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:00.180117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90375f55-9de8-48e8-8ea2-ef64d95a0c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:00.180483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90375f55-9de8-48e8-8ea2-ef64d95a0c28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:00.185272 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b381b63-312d-4836-b469-1cab29f22c67 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:00.250058 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90375f55-9de8-48e8-8ea2-ef64d95a0c28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:00.252104 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90375f55-9de8-48e8-8ea2-ef64d95a0c28 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:00.278211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed9202-f25a-44b3-a1b6-3ebbaa592ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:00.278903 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed9202-f25a-44b3-a1b6-3ebbaa592ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:00.279103 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed9202-f25a-44b3-a1b6-3ebbaa592ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:00.279393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed9202-f25a-44b3-a1b6-3ebbaa592ea9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:00.380081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 82/173] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:00.380969 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90375f55-9de8-48e8-8ea2-ef64d95a0c28 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:00.402529 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:00.465149 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed9202-f25a-44b3-a1b6-3ebbaa592ea9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:00.467245 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed9202-f25a-44b3-a1b6-3ebbaa592ea9 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:00.488066 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90375f55-9de8-48e8-8ea2-ef64d95a0c28 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:00.503145 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:00.534424 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99668f-d3f6-4b90-8576-31a0d472fdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:00.535188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99668f-d3f6-4b90-8576-31a0d472fdea None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:00.535784 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99668f-d3f6-4b90-8576-31a0d472fdea None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:00.536132 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99668f-d3f6-4b90-8576-31a0d472fdea None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:00.543390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99668f-d3f6-4b90-8576-31a0d472fdea None admin] RBAC: Authorizing `identity:get_project(project_id=1e107e4257e749cdbbc856b69ced1cc1)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:00.543390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99668f-d3f6-4b90-8576-31a0d472fdea None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:00.548879 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 83/174] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:00 2022] GET /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:00.550831 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cafcd6-a1b8-40b4-98f3-e55ad3c095ee None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:00.555380 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cafcd6-a1b8-40b4-98f3-e55ad3c095ee None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:00.555380 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cafcd6-a1b8-40b4-98f3-e55ad3c095ee None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:00.555380 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 84/175] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:00.555380 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cafcd6-a1b8-40b4-98f3-e55ad3c095ee None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:00.649298 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 92/176] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:43:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 805 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:00.650293 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb9329-e5ed-4533-966b-66b3d5ab9e4e None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:00.651487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb9329-e5ed-4533-966b-66b3d5ab9e4e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:00.651906 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb9329-e5ed-4533-966b-66b3d5ab9e4e None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:00.653326 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 93/177] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:00.654251 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb9329-e5ed-4533-966b-66b3d5ab9e4e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:00.668550 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:00.726807 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cafcd6-a1b8-40b4-98f3-e55ad3c095ee None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:00.769384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531d05c-fc1c-4109-a7ec-e4f59506166a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:00.770026 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531d05c-fc1c-4109-a7ec-e4f59506166a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:00.770298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531d05c-fc1c-4109-a7ec-e4f59506166a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:00.770563 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531d05c-fc1c-4109-a7ec-e4f59506166a None admin] PATH_INFO: `/v3/projects/b80f6823f3ab4fe2914a1133b2acccee` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:00.772131 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531d05c-fc1c-4109-a7ec-e4f59506166a None admin] RBAC: Authorizing `identity:get_project(project_id=b80f6823f3ab4fe2914a1133b2acccee)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:00.773649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531d05c-fc1c-4109-a7ec-e4f59506166a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:00.775579 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 85/178] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:00 2022] GET /identity/v3/projects/b80f6823f3ab4fe2914a1133b2acccee => generated 312 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:00.776687 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc0a16-565c-4dbe-8980-a9954612fff4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:00.776944 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc0a16-565c-4dbe-8980-a9954612fff4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:00.777184 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc0a16-565c-4dbe-8980-a9954612fff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:00.796062 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d9cc0a16-565c-4dbe-8980-a9954612fff4 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:00.797298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d9cc0a16-565c-4dbe-8980-a9954612fff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:00.820021 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb9329-e5ed-4533-966b-66b3d5ab9e4e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:00.852914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:00.861830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989a850-f3a1-4e38-8200-960694b01765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:00.862530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989a850-f3a1-4e38-8200-960694b01765 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:00.862870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989a850-f3a1-4e38-8200-960694b01765 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:00.863268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989a850-f3a1-4e38-8200-960694b01765 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:00.864170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989a850-f3a1-4e38-8200-960694b01765 None admin] RBAC: Adding query filter params (role.id=30c5b9fbbb564c6dafe66f759683738b, scope.project.id=1e107e4257e749cdbbc856b69ced1cc1, user.id=69abfe9255ec4f2e97b3d7b9e1433201) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:00.864612 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989a850-f3a1-4e38-8200-960694b01765 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:00.866584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989a850-f3a1-4e38-8200-960694b01765 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:00.873603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 94/179] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:44:00 2022] GET /identity/v3/role_assignments?user.id=69abfe9255ec4f2e97b3d7b9e1433201&scope.project.id=1e107e4257e749cdbbc856b69ced1cc1&role.id=30c5b9fbbb564c6dafe66f759683738b => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:00.874533 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989a850-f3a1-4e38-8200-960694b01765 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:00.882437 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 86/180] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:00.883825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1567ee-937e-4d72-9d2c-6e6037b87609 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:00.884116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1567ee-937e-4d72-9d2c-6e6037b87609 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:00.884393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1567ee-937e-4d72-9d2c-6e6037b87609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:00.905658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ac1567ee-937e-4d72-9d2c-6e6037b87609 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:00.907157 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ac1567ee-937e-4d72-9d2c-6e6037b87609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:00.980429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:00.990817 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 87/181] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:00.997548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7492d54-29fd-4590-91c0-6ee8caf336de None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:00.997890 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7492d54-29fd-4590-91c0-6ee8caf336de None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:00.999390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7492d54-29fd-4590-91c0-6ee8caf336de None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:01.001899 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 88/182] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:01.005013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7492d54-29fd-4590-91c0-6ee8caf336de None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:01.133480 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989a850-f3a1-4e38-8200-960694b01765 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:01.171860 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c84c26-be55-4459-ba7c-c8d362ea2489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:01.173110 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c84c26-be55-4459-ba7c-c8d362ea2489 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:01.173397 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c84c26-be55-4459-ba7c-c8d362ea2489 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:01.173672 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c84c26-be55-4459-ba7c-c8d362ea2489 None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:01.174814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c84c26-be55-4459-ba7c-c8d362ea2489 None admin] RBAC: Authorizing `identity:get_project(project_id=1e107e4257e749cdbbc856b69ced1cc1)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:01.176377 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c84c26-be55-4459-ba7c-c8d362ea2489 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:01.182713 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 95/183] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:00 2022] GET /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:01.182713 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e453aa9-ebef-4f84-af13-a393db995f13 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:01.182713 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e453aa9-ebef-4f84-af13-a393db995f13 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:01.183001 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e453aa9-ebef-4f84-af13-a393db995f13 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:01.184503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 96/184] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:01.190459 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db321f96-8933-403e-8bcf-f24e964c0b61 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:01.190887 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db321f96-8933-403e-8bcf-f24e964c0b61 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:01.191295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db321f96-8933-403e-8bcf-f24e964c0b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:01.217451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-db321f96-8933-403e-8bcf-f24e964c0b61 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:01.218666 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-db321f96-8933-403e-8bcf-f24e964c0b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:01.229191 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7492d54-29fd-4590-91c0-6ee8caf336de None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:01.279901 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c12ed-ceb5-431e-990b-55092e4deb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:01.280458 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c12ed-ceb5-431e-990b-55092e4deb7b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:01.280714 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c12ed-ceb5-431e-990b-55092e4deb7b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:01.281272 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c12ed-ceb5-431e-990b-55092e4deb7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:01.282045 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c12ed-ceb5-431e-990b-55092e4deb7b None admin] RBAC: Adding query filter params (role.id=7f855c6f817f4a64a1e635407de8bfb0, scope.project.id=b80f6823f3ab4fe2914a1133b2acccee, user.id=69abfe9255ec4f2e97b3d7b9e1433201) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:01.282621 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c12ed-ceb5-431e-990b-55092e4deb7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:01.284144 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c12ed-ceb5-431e-990b-55092e4deb7b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:01.291087 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 89/185] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:44:01 2022] GET /identity/v3/role_assignments?user.id=69abfe9255ec4f2e97b3d7b9e1433201&scope.project.id=b80f6823f3ab4fe2914a1133b2acccee&role.id=7f855c6f817f4a64a1e635407de8bfb0 => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:01.291921 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c12ed-ceb5-431e-990b-55092e4deb7b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:01.297455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:01.319409 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 97/186] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:01.319409 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5764ded-8f27-4c67-bb8c-4d15e0740cb8 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:01.319409 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5764ded-8f27-4c67-bb8c-4d15e0740cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:01.319409 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5764ded-8f27-4c67-bb8c-4d15e0740cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:01.345734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f5764ded-8f27-4c67-bb8c-4d15e0740cb8 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:01.347888 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f5764ded-8f27-4c67-bb8c-4d15e0740cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:01.363122 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:01.428547 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c12ed-ceb5-431e-990b-55092e4deb7b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:01.431656 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 98/187] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:01.432815 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5764ded-8f27-4c67-bb8c-4d15e0740cb8 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:01.485116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37444e5a-e6e0-418e-b4ba-42c5e49e85ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:01.485751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37444e5a-e6e0-418e-b4ba-42c5e49e85ab None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:01.486086 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37444e5a-e6e0-418e-b4ba-42c5e49e85ab None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:01.486919 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37444e5a-e6e0-418e-b4ba-42c5e49e85ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:01.487884 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37444e5a-e6e0-418e-b4ba-42c5e49e85ab None admin] RBAC: Adding query filter params (role.id=4f4d8a6881ca496bb2d4845a6592fea8, scope.project.id=1e107e4257e749cdbbc856b69ced1cc1, user.id=fcaa90c0553848528e601e03ebda1656) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:01.488354 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37444e5a-e6e0-418e-b4ba-42c5e49e85ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:01.490341 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37444e5a-e6e0-418e-b4ba-42c5e49e85ab None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:01.499769 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 90/188] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:44:01 2022] GET /identity/v3/role_assignments?user.id=fcaa90c0553848528e601e03ebda1656&scope.project.id=1e107e4257e749cdbbc856b69ced1cc1&role.id=4f4d8a6881ca496bb2d4845a6592fea8 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:01.500717 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37444e5a-e6e0-418e-b4ba-42c5e49e85ab None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:01.610350 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5764ded-8f27-4c67-bb8c-4d15e0740cb8 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:01.632526 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37444e5a-e6e0-418e-b4ba-42c5e49e85ab None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:01.643973 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:01.668159 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a677bdf-e0bb-4496-89b6-fbac4722251f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:01.669025 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:01.670468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a677bdf-e0bb-4496-89b6-fbac4722251f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:01.670957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a677bdf-e0bb-4496-89b6-fbac4722251f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:01.671901 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a677bdf-e0bb-4496-89b6-fbac4722251f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:01.680692 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7292dc9-a10e-4027-898f-5434c2431599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:01.681337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7292dc9-a10e-4027-898f-5434c2431599 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:01.681612 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7292dc9-a10e-4027-898f-5434c2431599 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:01.681878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7292dc9-a10e-4027-898f-5434c2431599 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:01.687128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a677bdf-e0bb-4496-89b6-fbac4722251f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:01.694036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-5a677bdf-e0bb-4496-89b6-fbac4722251f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:44:01.694036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:01.694036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:01.694036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:01.694036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:01.694036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:01.694036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:01.694036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:01.694036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:01.694036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:01.694036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:01.694036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:01.694036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:01.694036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:01.694036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:01.694036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:01.695308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:01.695308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:01.695308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:01.695308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:01.695308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:01.695308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:01.695308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:01.695308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:01.695308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:01.695308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:01.695308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:01.695308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:01.695308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:01.695308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:01.695308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:01.695308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:01.696187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:01.696187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:01.696187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:01.696187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:01.696187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:01.696187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:01.696187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:01.696187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:01.696187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:01.696187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:01.696187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:44:01.696187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:01.697328 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 99/189] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:44:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:01.697911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a677bdf-e0bb-4496-89b6-fbac4722251f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:01.698860 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7292dc9-a10e-4027-898f-5434c2431599 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:01.704162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-d7292dc9-a10e-4027-898f-5434c2431599 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:44:01.704162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:01.704162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:01.704162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:01.704162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:01.704162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:01.704162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:01.704162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:01.704162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:01.704162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:01.704162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:01.704162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:01.704162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:01.704162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:01.704162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:01.704162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:01.705081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:01.705081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:01.705081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:01.705081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:01.705081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:01.705081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:01.705081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:01.705081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:01.705081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:01.705081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:01.705081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:01.705081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:01.705081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:01.705081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:01.705081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:01.705081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:01.705857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:01.705857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:01.705857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:01.705857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:01.705857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:01.705857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:01.705857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:01.705857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:01.705857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:01.705857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:01.705857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:44:01.705857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:01.705857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 91/190] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Aug 30 11:44:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:01.706525 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7292dc9-a10e-4027-898f-5434c2431599 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:01.824530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a677bdf-e0bb-4496-89b6-fbac4722251f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:01.831105 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7292dc9-a10e-4027-898f-5434c2431599 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:01.859158 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa2d61-1a17-4ee6-be8c-32afca5bddfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:01.859838 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa2d61-1a17-4ee6-be8c-32afca5bddfb None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:01.860135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa2d61-1a17-4ee6-be8c-32afca5bddfb None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:01.860463 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa2d61-1a17-4ee6-be8c-32afca5bddfb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:01.861632 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa2d61-1a17-4ee6-be8c-32afca5bddfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:01.863107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa2d61-1a17-4ee6-be8c-32afca5bddfb None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:01.864527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4b6af-96e6-4d25-8a0f-1e946c139444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:01.864747 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 100/191] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:01.865140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4b6af-96e6-4d25-8a0f-1e946c139444 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:01.865419 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4b6af-96e6-4d25-8a0f-1e946c139444 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:01.865561 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa2d61-1a17-4ee6-be8c-32afca5bddfb None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:01.865643 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4b6af-96e6-4d25-8a0f-1e946c139444 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:01.866305 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4b6af-96e6-4d25-8a0f-1e946c139444 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:01.866637 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4b6af-96e6-4d25-8a0f-1e946c139444 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:01.868054 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4b6af-96e6-4d25-8a0f-1e946c139444 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:01.876779 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 92/192] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:01.879076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4b6af-96e6-4d25-8a0f-1e946c139444 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:01.914713 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:01.925608 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:01.965438 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa2d61-1a17-4ee6-be8c-32afca5bddfb None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:01.979606 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4b6af-96e6-4d25-8a0f-1e946c139444 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:01.999063 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a5687-0305-49db-85df-6406234458ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:01.999695 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a5687-0305-49db-85df-6406234458ef None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:01.999970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a5687-0305-49db-85df-6406234458ef None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:02.000242 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a5687-0305-49db-85df-6406234458ef None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:02.000896 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a5687-0305-49db-85df-6406234458ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:02.001196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a5687-0305-49db-85df-6406234458ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:02.002593 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a5687-0305-49db-85df-6406234458ef None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:02.010488 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 101/193] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:44:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:02.011275 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a5687-0305-49db-85df-6406234458ef None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:02.012120 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125f613-419b-4d16-a17c-4b760b8841d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:02.012786 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125f613-419b-4d16-a17c-4b760b8841d2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:02.013072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125f613-419b-4d16-a17c-4b760b8841d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:02.013338 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125f613-419b-4d16-a17c-4b760b8841d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:02.024101 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125f613-419b-4d16-a17c-4b760b8841d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:02.029377 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-5125f613-419b-4d16-a17c-4b760b8841d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:44:02.029377 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:02.029377 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:02.029377 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:02.029377 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:02.029377 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:02.029377 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:02.029377 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:02.029377 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:02.029377 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:02.029377 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:02.029377 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:02.029377 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:02.029377 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:02.029377 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:02.029377 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:02.030374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:02.030374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:02.030374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:02.030374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:02.030374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:02.030374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:02.030374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:02.030374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:02.030374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:02.030374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:02.030374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:02.030374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:02.030374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:02.030374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:02.030374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:02.030374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:02.031168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:02.031168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:02.031168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:02.031168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:02.031168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:02.031168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:02.031168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:02.031168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:02.031168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:02.031168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:02.031168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:44:02.031168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:02.031168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 93/194] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:02.032170 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125f613-419b-4d16-a17c-4b760b8841d2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:02.117984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a5687-0305-49db-85df-6406234458ef None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:02.128858 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:02.133205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125f613-419b-4d16-a17c-4b760b8841d2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:02.140093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:02.152503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad820209-112f-4180-ada2-f589de878b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:02.153111 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad820209-112f-4180-ada2-f589de878b85 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:02.153401 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad820209-112f-4180-ada2-f589de878b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:02.153683 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad820209-112f-4180-ada2-f589de878b85 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:02.154328 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad820209-112f-4180-ada2-f589de878b85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:02.155828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad820209-112f-4180-ada2-f589de878b85 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:02.167247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36bd02-e9fa-40d6-a34e-b17f12eb7d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:02.168140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36bd02-e9fa-40d6-a34e-b17f12eb7d15 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:02.168414 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36bd02-e9fa-40d6-a34e-b17f12eb7d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:02.168679 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36bd02-e9fa-40d6-a34e-b17f12eb7d15 None admin] PATH_INFO: `/v3/users/6f2d90be1e6841a78a383d8110976f22` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:02.178904 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 102/195] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Aug 30 11:44:02 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:44:02.183270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36bd02-e9fa-40d6-a34e-b17f12eb7d15 None admin] RBAC: Authorizing `identity:get_user(user_id=6f2d90be1e6841a78a383d8110976f22)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:02.185567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36bd02-e9fa-40d6-a34e-b17f12eb7d15 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:02.187379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 94/196] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:44:02 2022] GET /identity/v3/users/6f2d90be1e6841a78a383d8110976f22 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:02.192659 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad820209-112f-4180-ada2-f589de878b85 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:02.193242 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36bd02-e9fa-40d6-a34e-b17f12eb7d15 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:02.309945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36bd02-e9fa-40d6-a34e-b17f12eb7d15 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:02.313385 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad820209-112f-4180-ada2-f589de878b85 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:02.351437 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8d7db-1f4d-47ba-9c35-3d693e417439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:02.351646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b3c62-e5f2-4a9c-af68-21b0b39d09e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:02.352068 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8d7db-1f4d-47ba-9c35-3d693e417439 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:02.352183 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b3c62-e5f2-4a9c-af68-21b0b39d09e6 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:02.352350 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8d7db-1f4d-47ba-9c35-3d693e417439 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:02.352454 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b3c62-e5f2-4a9c-af68-21b0b39d09e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:02.352604 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8d7db-1f4d-47ba-9c35-3d693e417439 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:02.352706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b3c62-e5f2-4a9c-af68-21b0b39d09e6 None admin] PATH_INFO: `/v3/users/6f2d90be1e6841a78a383d8110976f22` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:02.353257 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8d7db-1f4d-47ba-9c35-3d693e417439 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:02.353558 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8d7db-1f4d-47ba-9c35-3d693e417439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:02.353767 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b3c62-e5f2-4a9c-af68-21b0b39d09e6 None admin] RBAC: Authorizing `identity:get_user(user_id=6f2d90be1e6841a78a383d8110976f22)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:02.354929 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8d7db-1f4d-47ba-9c35-3d693e417439 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:02.355213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b3c62-e5f2-4a9c-af68-21b0b39d09e6 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:02.356838 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 103/197] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:44:02 2022] GET /identity/v3/users/6f2d90be1e6841a78a383d8110976f22 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:02.357673 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b3c62-e5f2-4a9c-af68-21b0b39d09e6 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:02.365038 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 95/198] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:44:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:02.365872 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8d7db-1f4d-47ba-9c35-3d693e417439 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:02.394218 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:02.400227 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:02.483041 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b3c62-e5f2-4a9c-af68-21b0b39d09e6 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:02.497759 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8d7db-1f4d-47ba-9c35-3d693e417439 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:02.528377 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99605da5-8732-479e-80a6-0b5051d9eb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:02.529266 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99605da5-8732-479e-80a6-0b5051d9eb28 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:02.529550 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99605da5-8732-479e-80a6-0b5051d9eb28 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:02.529819 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99605da5-8732-479e-80a6-0b5051d9eb28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:02.536999 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485c652-b125-4557-9057-b68023596173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:02.537189 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485c652-b125-4557-9057-b68023596173 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:02.537418 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485c652-b125-4557-9057-b68023596173 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:02.537687 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485c652-b125-4557-9057-b68023596173 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:02.612024 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485c652-b125-4557-9057-b68023596173 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:02.613846 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485c652-b125-4557-9057-b68023596173 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:02.621041 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99605da5-8732-479e-80a6-0b5051d9eb28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:02.623039 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99605da5-8732-479e-80a6-0b5051d9eb28 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:02.650014 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:02.661950 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:02.741364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 96/199] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:02.743651 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485c652-b125-4557-9057-b68023596173 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:02.751857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 104/200] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:02.752959 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99605da5-8732-479e-80a6-0b5051d9eb28 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:02.857684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99605da5-8732-479e-80a6-0b5051d9eb28 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:02.860274 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485c652-b125-4557-9057-b68023596173 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:02.893904 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:02.895139 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43064eb-c863-417e-8a6f-82cc8618362d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:02.896049 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43064eb-c863-417e-8a6f-82cc8618362d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:02.896508 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43064eb-c863-417e-8a6f-82cc8618362d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:02.897025 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43064eb-c863-417e-8a6f-82cc8618362d None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:02.898323 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43064eb-c863-417e-8a6f-82cc8618362d None admin] RBAC: Authorizing `identity:get_project(project_id=f6e02d64fae241a7912706aa95544b4c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:02.900068 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43064eb-c863-417e-8a6f-82cc8618362d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:02.902203 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 105/201] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:02 2022] GET /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:02.903203 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43064eb-c863-417e-8a6f-82cc8618362d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:02.909597 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:02.912031 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568d062-43c9-4bc2-bbfe-cbbda8847a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:02.912791 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568d062-43c9-4bc2-bbfe-cbbda8847a25 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:02.913154 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568d062-43c9-4bc2-bbfe-cbbda8847a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:02.913584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568d062-43c9-4bc2-bbfe-cbbda8847a25 None admin] PATH_INFO: `/v3/users/9fe110ccd43341aba585d4f42aa402a5` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:02.915420 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568d062-43c9-4bc2-bbfe-cbbda8847a25 None admin] RBAC: Authorizing `identity:get_user(user_id=9fe110ccd43341aba585d4f42aa402a5)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:02.916976 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568d062-43c9-4bc2-bbfe-cbbda8847a25 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:02.923523 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 97/202] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:44:02 2022] GET /identity/v3/users/9fe110ccd43341aba585d4f42aa402a5 => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:02.924581 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568d062-43c9-4bc2-bbfe-cbbda8847a25 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:03.021929 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43064eb-c863-417e-8a6f-82cc8618362d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:03.043158 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568d062-43c9-4bc2-bbfe-cbbda8847a25 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:03.059911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfdb30-fde1-4bd6-b94e-00f68ea665be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:03.061151 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfdb30-fde1-4bd6-b94e-00f68ea665be None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:03.061601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfdb30-fde1-4bd6-b94e-00f68ea665be None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:03.062352 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfdb30-fde1-4bd6-b94e-00f68ea665be None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:03.064398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bfdb30-fde1-4bd6-b94e-00f68ea665be None admin] RBAC: Authorizing `identity:get_project(project_id=f6e02d64fae241a7912706aa95544b4c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:03.067042 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bfdb30-fde1-4bd6-b94e-00f68ea665be None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:03.070206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 106/203] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:02 2022] GET /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:03.071809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfdb30-fde1-4bd6-b94e-00f68ea665be None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:03.079281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76a71c-b0ca-404c-9f74-aa543474acb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:03.079935 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76a71c-b0ca-404c-9f74-aa543474acb1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:03.080214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76a71c-b0ca-404c-9f74-aa543474acb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:03.080486 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76a71c-b0ca-404c-9f74-aa543474acb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:03.081210 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76a71c-b0ca-404c-9f74-aa543474acb1 None admin] RBAC: Adding query filter params (role.id=30c5b9fbbb564c6dafe66f759683738b, scope.project.id=f6e02d64fae241a7912706aa95544b4c, user.id=6f2d90be1e6841a78a383d8110976f22) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:03.081519 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76a71c-b0ca-404c-9f74-aa543474acb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:03.083278 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76a71c-b0ca-404c-9f74-aa543474acb1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:03.089315 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 98/204] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:44:02 2022] GET /identity/v3/role_assignments?user.id=6f2d90be1e6841a78a383d8110976f22&scope.project.id=f6e02d64fae241a7912706aa95544b4c&role.id=30c5b9fbbb564c6dafe66f759683738b => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:03.090307 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76a71c-b0ca-404c-9f74-aa543474acb1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:03.169898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:03.222688 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:03.224760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76a71c-b0ca-404c-9f74-aa543474acb1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:03.266745 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918bd59-3cbf-402b-9212-fb489ba83b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:03.267690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918bd59-3cbf-402b-9212-fb489ba83b0f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:03.268132 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918bd59-3cbf-402b-9212-fb489ba83b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:03.268703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918bd59-3cbf-402b-9212-fb489ba83b0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:03.269704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918bd59-3cbf-402b-9212-fb489ba83b0f None admin] RBAC: Adding query filter params (role.id=4f4d8a6881ca496bb2d4845a6592fea8, scope.project.id=f6e02d64fae241a7912706aa95544b4c, user.id=6f2d90be1e6841a78a383d8110976f22) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:03.270155 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918bd59-3cbf-402b-9212-fb489ba83b0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:03.272622 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918bd59-3cbf-402b-9212-fb489ba83b0f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:03.280124 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 99/205] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:44:03 2022] GET /identity/v3/role_assignments?user.id=6f2d90be1e6841a78a383d8110976f22&scope.project.id=f6e02d64fae241a7912706aa95544b4c&role.id=4f4d8a6881ca496bb2d4845a6592fea8 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:03.289309 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfdb30-fde1-4bd6-b94e-00f68ea665be None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:03.329476 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658cc32c-6601-4017-9e88-0acde021fd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:03.330211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cc32c-6601-4017-9e88-0acde021fd85 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:03.330550 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cc32c-6601-4017-9e88-0acde021fd85 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:03.330882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cc32c-6601-4017-9e88-0acde021fd85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:03.404098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658cc32c-6601-4017-9e88-0acde021fd85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:03.405797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658cc32c-6601-4017-9e88-0acde021fd85 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:03.479816 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:03.526140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 107/206] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:03.533092 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918bd59-3cbf-402b-9212-fb489ba83b0f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:03.652181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918bd59-3cbf-402b-9212-fb489ba83b0f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:03.676352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:03.689165 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9887b08-10cf-41d5-981d-f9eac58e1c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:03.690020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9887b08-10cf-41d5-981d-f9eac58e1c64 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:03.690465 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9887b08-10cf-41d5-981d-f9eac58e1c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:03.690878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9887b08-10cf-41d5-981d-f9eac58e1c64 None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:03.692301 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9887b08-10cf-41d5-981d-f9eac58e1c64 None admin] RBAC: Authorizing `identity:get_project(project_id=1e107e4257e749cdbbc856b69ced1cc1)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:03.693914 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9887b08-10cf-41d5-981d-f9eac58e1c64 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:03.695830 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 100/207] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:03 2022] GET /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:03.703436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658cc32c-6601-4017-9e88-0acde021fd85 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:03.850211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658cc32c-6601-4017-9e88-0acde021fd85 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:03.895255 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0cfd5-1e0c-4982-a5e2-f425454cc102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:03.895991 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0cfd5-1e0c-4982-a5e2-f425454cc102 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:03.896278 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0cfd5-1e0c-4982-a5e2-f425454cc102 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:03.896549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0cfd5-1e0c-4982-a5e2-f425454cc102 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:03.897281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0cfd5-1e0c-4982-a5e2-f425454cc102 None admin] RBAC: Adding query filter params (role.id=0c933d29c2794fad8da4b91509d53aba, scope.project.id=1e107e4257e749cdbbc856b69ced1cc1, user.id=9fe110ccd43341aba585d4f42aa402a5) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:03.897592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0cfd5-1e0c-4982-a5e2-f425454cc102 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:03.899064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0cfd5-1e0c-4982-a5e2-f425454cc102 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:03.908409 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 108/208] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:44:03 2022] GET /identity/v3/role_assignments?user.id=9fe110ccd43341aba585d4f42aa402a5&scope.project.id=1e107e4257e749cdbbc856b69ced1cc1&role.id=0c933d29c2794fad8da4b91509d53aba => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:04.353816 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060bf71-f38e-4584-bf89-fcb3cc44dcd4 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:04.354225 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060bf71-f38e-4584-bf89-fcb3cc44dcd4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:04.354400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060bf71-f38e-4584-bf89-fcb3cc44dcd4 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:04.355876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 101/209] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:44:04.362509 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068858e-be4b-4462-bd17-3122a5324526 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:04.363426 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068858e-be4b-4462-bd17-3122a5324526 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:04.363896 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068858e-be4b-4462-bd17-3122a5324526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:04.384003 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-6068858e-be4b-4462-bd17-3122a5324526 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:04.385531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6068858e-be4b-4462-bd17-3122a5324526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:04.420056 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:04.471802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 109/210] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:04.645428 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ca4b7-b217-45f9-ad70-b423a3e69ffc None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:04.646352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ca4b7-b217-45f9-ad70-b423a3e69ffc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:04.646816 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ca4b7-b217-45f9-ad70-b423a3e69ffc None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:04.648686 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 102/211] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:04.654146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f107f26-f722-489b-b6bd-de7401dc69e6 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:04.654652 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f107f26-f722-489b-b6bd-de7401dc69e6 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:04.655191 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f107f26-f722-489b-b6bd-de7401dc69e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:04.675733 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-3f107f26-f722-489b-b6bd-de7401dc69e6 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:04.677317 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3f107f26-f722-489b-b6bd-de7401dc69e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:04.742155 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ca4b7-b217-45f9-ad70-b423a3e69ffc None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:04.749743 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 110/212] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:04.851080 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ca4b7-b217-45f9-ad70-b423a3e69ffc None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:04.885872 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efd901-e84f-4e38-a88d-cd618ae5ba59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:04.886562 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efd901-e84f-4e38-a88d-cd618ae5ba59 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:04.886835 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efd901-e84f-4e38-a88d-cd618ae5ba59 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:04.887104 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efd901-e84f-4e38-a88d-cd618ae5ba59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:04.898122 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17efd901-e84f-4e38-a88d-cd618ae5ba59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:04.903507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-17efd901-e84f-4e38-a88d-cd618ae5ba59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:04.903507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:04.903507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:04.903507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:04.903507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:04.903507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:04.903507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:04.903507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:04.903507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:04.903507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:04.903507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:04.903507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:04.903507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:04.903507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:04.903507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:04.903507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:04.904372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:04.904372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:04.904372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:04.904372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:04.904372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:04.904372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:04.904372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:04.904372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:04.904372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:04.904372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:04.904372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:04.904372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:04.904372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:04.904372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:04.904372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:04.904372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:04.905171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:04.905171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:04.905171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:04.905171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:04.905171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:04.905171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:04.905171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:04.905171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:04.905171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:04.905171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:04.905171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:04.905171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:04.905171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 103/213] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:04.912327 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f107f26-f722-489b-b6bd-de7401dc69e6 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:05.013352 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f107f26-f722-489b-b6bd-de7401dc69e6 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:05.016261 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:05.048341 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efd901-e84f-4e38-a88d-cd618ae5ba59 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:05.050172 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fcfd8-9436-4cae-9847-4795cc728a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:05.050795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fcfd8-9436-4cae-9847-4795cc728a72 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:05.051067 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fcfd8-9436-4cae-9847-4795cc728a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:05.051335 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fcfd8-9436-4cae-9847-4795cc728a72 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:05.052026 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fcfd8-9436-4cae-9847-4795cc728a72 None admin] RBAC: Adding query filter params (name=member) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:05.052323 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fcfd8-9436-4cae-9847-4795cc728a72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:05.053724 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fcfd8-9436-4cae-9847-4795cc728a72 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:05.067392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 111/214] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:44:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:05.071050 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fcfd8-9436-4cae-9847-4795cc728a72 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:05.126825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:05.189328 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efd901-e84f-4e38-a88d-cd618ae5ba59 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:05.210789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fcfd8-9436-4cae-9847-4795cc728a72 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:05.230164 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36377b-3a24-4cc1-a021-e94992c54316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:05.231045 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36377b-3a24-4cc1-a021-e94992c54316 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:05.231516 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36377b-3a24-4cc1-a021-e94992c54316 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:05.231919 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36377b-3a24-4cc1-a021-e94992c54316 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:05.233645 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36377b-3a24-4cc1-a021-e94992c54316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:05.235991 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36377b-3a24-4cc1-a021-e94992c54316 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:05.242842 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 104/215] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:05.244015 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36377b-3a24-4cc1-a021-e94992c54316 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:05.258388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c71df-e74b-4d57-a5f2-72a0cfe558ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:05.259396 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c71df-e74b-4d57-a5f2-72a0cfe558ca None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:05.259691 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c71df-e74b-4d57-a5f2-72a0cfe558ca None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:05.259960 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c71df-e74b-4d57-a5f2-72a0cfe558ca None admin] PATH_INFO: `/v3/users/b96f1c942b3640578bfabac7ce07728c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:05.274368 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c71df-e74b-4d57-a5f2-72a0cfe558ca None admin] RBAC: Authorizing `identity:get_user(user_id=b96f1c942b3640578bfabac7ce07728c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:05.275902 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c71df-e74b-4d57-a5f2-72a0cfe558ca None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:05.277905 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 112/216] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:44:05 2022] GET /identity/v3/users/b96f1c942b3640578bfabac7ce07728c => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:05.279098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dda7a-30e9-4412-a143-85f3081b3e42 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:05.279370 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dda7a-30e9-4412-a143-85f3081b3e42 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:05.279650 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dda7a-30e9-4412-a143-85f3081b3e42 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:05.280981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 113/217] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:05.285790 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79dda7a-30e9-4412-a143-85f3081b3e42 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:05.302683 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:05.354412 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36377b-3a24-4cc1-a021-e94992c54316 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:05.373276 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:05.391139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901fe54-a253-4ac5-b037-58e606b959a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:05.391905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901fe54-a253-4ac5-b037-58e606b959a0 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:05.392183 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901fe54-a253-4ac5-b037-58e606b959a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:05.392454 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901fe54-a253-4ac5-b037-58e606b959a0 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:05.393108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901fe54-a253-4ac5-b037-58e606b959a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:05.394555 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901fe54-a253-4ac5-b037-58e606b959a0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:05.395614 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79dda7a-30e9-4412-a143-85f3081b3e42 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:05.418050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 105/218] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Aug 30 11:44:05 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:44:05.419600 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364751d-94f9-4e44-a4ce-31e505c57d7f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:05.419887 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364751d-94f9-4e44-a4ce-31e505c57d7f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:05.420493 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364751d-94f9-4e44-a4ce-31e505c57d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:05.443978 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04850421-81e7-4c2e-a6c0-5f86596938d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:05.444948 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04850421-81e7-4c2e-a6c0-5f86596938d9 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:05.445457 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04850421-81e7-4c2e-a6c0-5f86596938d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:05.445893 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04850421-81e7-4c2e-a6c0-5f86596938d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:05.448297 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c364751d-94f9-4e44-a4ce-31e505c57d7f None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:05.449973 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c364751d-94f9-4e44-a4ce-31e505c57d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:05.531353 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04850421-81e7-4c2e-a6c0-5f86596938d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:05.533358 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04850421-81e7-4c2e-a6c0-5f86596938d9 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:05.551623 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 106/219] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:05.552429 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:05.553661 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7829306-ebde-49e3-8339-49509ab21c58 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:05.553986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7829306-ebde-49e3-8339-49509ab21c58 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:05.554326 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7829306-ebde-49e3-8339-49509ab21c58 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:05.556238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 107/220] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:05.562289 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc95f8-8f46-4f40-8bb7-02a8e8922db3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:05.562614 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc95f8-8f46-4f40-8bb7-02a8e8922db3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:05.562897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc95f8-8f46-4f40-8bb7-02a8e8922db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:05.582631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6dcc95f8-8f46-4f40-8bb7-02a8e8922db3 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:05.583858 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6dcc95f8-8f46-4f40-8bb7-02a8e8922db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:05.660680 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 108/221] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:44:05.675521 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 114/222] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:05.678404 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc95f8-8f46-4f40-8bb7-02a8e8922db3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:05.712863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:05.787476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc95f8-8f46-4f40-8bb7-02a8e8922db3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:05.828872 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35168f53-131b-464b-a6fa-86389ddf5fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:05.829774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35168f53-131b-464b-a6fa-86389ddf5fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:05.830052 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35168f53-131b-464b-a6fa-86389ddf5fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:05.830324 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35168f53-131b-464b-a6fa-86389ddf5fc5 None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:05.832164 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35168f53-131b-464b-a6fa-86389ddf5fc5 None admin] RBAC: Authorizing `identity:get_project(project_id=f6e02d64fae241a7912706aa95544b4c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:05.833892 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35168f53-131b-464b-a6fa-86389ddf5fc5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:05.835834 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 109/223] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:05 2022] GET /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:05.838668 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04850421-81e7-4c2e-a6c0-5f86596938d9 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:05.843039 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35168f53-131b-464b-a6fa-86389ddf5fc5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:05.965606 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35168f53-131b-464b-a6fa-86389ddf5fc5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:05.966229 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04850421-81e7-4c2e-a6c0-5f86596938d9 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:05.968041 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:05.987861 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:06.009017 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057cbf1-5e99-402b-a7e8-6fb09af7fe87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:06.009759 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057cbf1-5e99-402b-a7e8-6fb09af7fe87 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:06.010034 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057cbf1-5e99-402b-a7e8-6fb09af7fe87 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:06.010303 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057cbf1-5e99-402b-a7e8-6fb09af7fe87 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:06.010681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d968fe-5e25-46a0-81fe-21317f581d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:06.011716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d968fe-5e25-46a0-81fe-21317f581d76 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:06.012134 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d968fe-5e25-46a0-81fe-21317f581d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:06.012543 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d968fe-5e25-46a0-81fe-21317f581d76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:06.013435 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d968fe-5e25-46a0-81fe-21317f581d76 None admin] RBAC: Adding query filter params (role.id=7f855c6f817f4a64a1e635407de8bfb0, scope.project.id=f6e02d64fae241a7912706aa95544b4c, user.id=b96f1c942b3640578bfabac7ce07728c) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:06.013899 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d968fe-5e25-46a0-81fe-21317f581d76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:06.015549 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d968fe-5e25-46a0-81fe-21317f581d76 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:06.021958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057cbf1-5e99-402b-a7e8-6fb09af7fe87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:06.022512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 110/224] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:44:05 2022] GET /identity/v3/role_assignments?user.id=b96f1c942b3640578bfabac7ce07728c&scope.project.id=f6e02d64fae241a7912706aa95544b4c&role.id=7f855c6f817f4a64a1e635407de8bfb0 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:06.023499 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d968fe-5e25-46a0-81fe-21317f581d76 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:06.028071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-e057cbf1-5e99-402b-a7e8-6fb09af7fe87 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:44:06.028071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:06.028071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:06.028071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:06.028071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:06.028071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:06.028071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:06.028071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:06.028071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:06.028071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:06.028071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:06.028071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:06.028071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:06.028071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:06.028071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:06.028071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:06.029253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:06.029253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:06.029253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:06.029253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:06.029253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:06.029253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:06.029253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:06.029253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:06.029253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:06.029253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:06.029253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:06.029253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:06.029253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:06.029253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:06.029253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:06.029253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:06.030101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:06.030101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:06.030101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:06.030101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:06.030101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:06.030101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:06.030101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:06.030101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:06.030101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:06.030101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:06.030101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:44:06.030101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:06.030101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 115/225] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Aug 30 11:44:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:06.041589 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057cbf1-5e99-402b-a7e8-6fb09af7fe87 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:06.193780 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d968fe-5e25-46a0-81fe-21317f581d76 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:06.242457 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243ab4f-0e20-4591-bfcc-93477be0b27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:06.243966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243ab4f-0e20-4591-bfcc-93477be0b27e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:06.245336 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243ab4f-0e20-4591-bfcc-93477be0b27e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:06.245803 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243ab4f-0e20-4591-bfcc-93477be0b27e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:06.263260 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057cbf1-5e99-402b-a7e8-6fb09af7fe87 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:06.271114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243ab4f-0e20-4591-bfcc-93477be0b27e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:06.276639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-c243ab4f-0e20-4591-bfcc-93477be0b27e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:44:06.276639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:06.276639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:06.276639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:06.276639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:06.276639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:06.276639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:06.276639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:06.276639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:06.276639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:06.276639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:06.276639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:06.276639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:06.276639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:06.276639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:06.276639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:06.277530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:06.277530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:06.277530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:06.277530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:06.277530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:06.277530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:06.277530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:06.277530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:06.277530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:06.277530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:06.277530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:06.277530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:06.277530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:06.277530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:06.277530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:06.277530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:06.278312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:06.278312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:06.278312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:06.278312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:06.278312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:06.278312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:06.278312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:06.278312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:06.278312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:06.278312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:06.278312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:44:06.278312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:06.285656 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 111/226] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:44:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:06.287019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243ab4f-0e20-4591-bfcc-93477be0b27e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:06.332643 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:06.334224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef7fd4-7df8-4a3a-af52-dab1692e6540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:06.334905 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef7fd4-7df8-4a3a-af52-dab1692e6540 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:06.335624 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef7fd4-7df8-4a3a-af52-dab1692e6540 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:06.335912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef7fd4-7df8-4a3a-af52-dab1692e6540 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:06.338881 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef7fd4-7df8-4a3a-af52-dab1692e6540 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:06.339194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef7fd4-7df8-4a3a-af52-dab1692e6540 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:06.342334 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef7fd4-7df8-4a3a-af52-dab1692e6540 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:06.365419 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 116/227] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:44:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:06.371865 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef7fd4-7df8-4a3a-af52-dab1692e6540 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:06.468174 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:06.510855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243ab4f-0e20-4591-bfcc-93477be0b27e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:06.567981 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ee126-b03c-4b65-8209-a35e329e45db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:06.568649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ee126-b03c-4b65-8209-a35e329e45db None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:06.568929 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ee126-b03c-4b65-8209-a35e329e45db None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:06.569196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ee126-b03c-4b65-8209-a35e329e45db None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:06.569859 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ee126-b03c-4b65-8209-a35e329e45db None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:06.570160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ee126-b03c-4b65-8209-a35e329e45db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:06.571581 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ee126-b03c-4b65-8209-a35e329e45db None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:06.581401 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 112/228] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:06.588555 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ee126-b03c-4b65-8209-a35e329e45db None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:06.593870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef7fd4-7df8-4a3a-af52-dab1692e6540 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:06.643832 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07161d1e-77f3-4476-9700-4aa697fc6653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:06.644520 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07161d1e-77f3-4476-9700-4aa697fc6653 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:06.644805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07161d1e-77f3-4476-9700-4aa697fc6653 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:06.645073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07161d1e-77f3-4476-9700-4aa697fc6653 None admin] PATH_INFO: `/v3/users/6f2d90be1e6841a78a383d8110976f22` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:06.646432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07161d1e-77f3-4476-9700-4aa697fc6653 None admin] RBAC: Authorizing `identity:get_user(user_id=6f2d90be1e6841a78a383d8110976f22)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:06.647968 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07161d1e-77f3-4476-9700-4aa697fc6653 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:06.650015 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 117/229] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:44:06 2022] GET /identity/v3/users/6f2d90be1e6841a78a383d8110976f22 => generated 283 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:06.655347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07161d1e-77f3-4476-9700-4aa697fc6653 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:06.714196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:06.730206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ee126-b03c-4b65-8209-a35e329e45db None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:06.768738 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83223a-cfcf-4849-ba48-86b26f405773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:06.769457 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83223a-cfcf-4849-ba48-86b26f405773 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:06.769741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83223a-cfcf-4849-ba48-86b26f405773 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:06.769999 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83223a-cfcf-4849-ba48-86b26f405773 None admin] PATH_INFO: `/v3/users/6f2d90be1e6841a78a383d8110976f22` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:06.771150 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83223a-cfcf-4849-ba48-86b26f405773 None admin] RBAC: Authorizing `identity:get_user(user_id=6f2d90be1e6841a78a383d8110976f22)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:06.773064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83223a-cfcf-4849-ba48-86b26f405773 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:06.774666 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 113/230] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:44:06 2022] GET /identity/v3/users/6f2d90be1e6841a78a383d8110976f22 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:06.780918 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83223a-cfcf-4849-ba48-86b26f405773 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:06.894744 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83223a-cfcf-4849-ba48-86b26f405773 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:06.914462 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07161d1e-77f3-4476-9700-4aa697fc6653 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:06.931697 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:06.937939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c0491-deac-40fa-a713-54a199b899a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:06.938659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c0491-deac-40fa-a713-54a199b899a7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:06.938938 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c0491-deac-40fa-a713-54a199b899a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:06.939213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c0491-deac-40fa-a713-54a199b899a7 None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:06.941188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c0491-deac-40fa-a713-54a199b899a7 None admin] RBAC: Authorizing `identity:get_project(project_id=f6e02d64fae241a7912706aa95544b4c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:06.942970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c0491-deac-40fa-a713-54a199b899a7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:06.947292 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 114/231] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:06 2022] GET /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:06.950930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c0491-deac-40fa-a713-54a199b899a7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:06.981977 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:07.024929 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f2244-25ca-4b58-866c-4f12048ea1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:07.025506 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f2244-25ca-4b58-866c-4f12048ea1ad None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:07.025792 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f2244-25ca-4b58-866c-4f12048ea1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:07.026072 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f2244-25ca-4b58-866c-4f12048ea1ad None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:07.027222 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f2244-25ca-4b58-866c-4f12048ea1ad None admin] RBAC: Authorizing `identity:get_project(project_id=f6e02d64fae241a7912706aa95544b4c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:07.028747 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f2244-25ca-4b58-866c-4f12048ea1ad None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:07.030711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 118/232] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:06 2022] GET /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c => generated 302 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:07.036443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f2244-25ca-4b58-866c-4f12048ea1ad None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:07.070371 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c0491-deac-40fa-a713-54a199b899a7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:07.108006 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334efd9e-de60-45e9-a30a-dfe9329e7e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:07.108676 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334efd9e-de60-45e9-a30a-dfe9329e7e73 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:07.108958 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334efd9e-de60-45e9-a30a-dfe9329e7e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:07.109227 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334efd9e-de60-45e9-a30a-dfe9329e7e73 None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c/users/6f2d90be1e6841a78a383d8110976f22/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:07.111634 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334efd9e-de60-45e9-a30a-dfe9329e7e73 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e02d64fae241a7912706aa95544b4c, user_id=6f2d90be1e6841a78a383d8110976f22, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:07.113524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334efd9e-de60-45e9-a30a-dfe9329e7e73 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:07.131496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 115/233] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:44:06 2022] PUT /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c/users/6f2d90be1e6841a78a383d8110976f22/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:44:07.237682 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f2244-25ca-4b58-866c-4f12048ea1ad None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:07.276165 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a632b7-d7e5-44ed-893b-bc9a9e54459c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:07.276759 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a632b7-d7e5-44ed-893b-bc9a9e54459c None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:07.277088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a632b7-d7e5-44ed-893b-bc9a9e54459c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:07.277361 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a632b7-d7e5-44ed-893b-bc9a9e54459c None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c/users/6f2d90be1e6841a78a383d8110976f22/roles/30c5b9fbbb564c6dafe66f759683738b` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:07.279602 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a632b7-d7e5-44ed-893b-bc9a9e54459c None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e02d64fae241a7912706aa95544b4c, user_id=6f2d90be1e6841a78a383d8110976f22, role_id=30c5b9fbbb564c6dafe66f759683738b)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:07.281093 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a632b7-d7e5-44ed-893b-bc9a9e54459c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:07.297403 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 119/234] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:44:07 2022] PUT /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c/users/6f2d90be1e6841a78a383d8110976f22/roles/30c5b9fbbb564c6dafe66f759683738b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:44:07.958740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea165790-afcf-4464-9550-311533156462 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:07.959276 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea165790-afcf-4464-9550-311533156462 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:07.959276 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea165790-afcf-4464-9550-311533156462 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:07.960660 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 116/235] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:07.966355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f8ce0-d446-4e6e-ab44-b9694dd6dede None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:07.966765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f8ce0-d446-4e6e-ab44-b9694dd6dede None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:07.966934 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f8ce0-d446-4e6e-ab44-b9694dd6dede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:07.994901 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-408f8ce0-d446-4e6e-ab44-b9694dd6dede None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:07.996113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-408f8ce0-d446-4e6e-ab44-b9694dd6dede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:08.022726 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f47bac-61de-4bf0-91bc-76ae6848ab5b None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:08.023029 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f47bac-61de-4bf0-91bc-76ae6848ab5b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:08.023267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f47bac-61de-4bf0-91bc-76ae6848ab5b None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:08.024630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 117/236] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:44:08.029547 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4d3e2-d14e-49ca-ba2e-cfea413bff52 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:08.029825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4d3e2-d14e-49ca-ba2e-cfea413bff52 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:08.030098 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4d3e2-d14e-49ca-ba2e-cfea413bff52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:08.031636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:08.060874 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-66f4d3e2-d14e-49ca-ba2e-cfea413bff52 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:08.062056 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-66f4d3e2-d14e-49ca-ba2e-cfea413bff52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:08.083127 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 120/237] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:44:08.144032 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4dce4-7af7-4106-80ea-9e99e4efde8b None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:08.144648 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4dce4-7af7-4106-80ea-9e99e4efde8b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:08.145110 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4dce4-7af7-4106-80ea-9e99e4efde8b None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:08.147448 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 121/238] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:44:08.151971 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145928eb-333c-40fd-bda7-124266624ce2 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:08.152520 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145928eb-333c-40fd-bda7-124266624ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:08.152984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145928eb-333c-40fd-bda7-124266624ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:08.172814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-145928eb-333c-40fd-bda7-124266624ce2 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:08.174466 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-145928eb-333c-40fd-bda7-124266624ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:08.189917 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 118/239] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:08.288556 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 122/240] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:44:08.467775 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4d3e2-d14e-49ca-ba2e-cfea413bff52 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:08.488534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:08.520181 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145928eb-333c-40fd-bda7-124266624ce2 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:08.613105 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4d3e2-d14e-49ca-ba2e-cfea413bff52 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:08.666585 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:08.668521 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176324e2-1ab8-4c75-bb4d-5cf120bedb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:08.669476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176324e2-1ab8-4c75-bb4d-5cf120bedb96 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:08.670076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176324e2-1ab8-4c75-bb4d-5cf120bedb96 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:08.670639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176324e2-1ab8-4c75-bb4d-5cf120bedb96 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:08.676855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145928eb-333c-40fd-bda7-124266624ce2 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:08.683194 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176324e2-1ab8-4c75-bb4d-5cf120bedb96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:08.689298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-176324e2-1ab8-4c75-bb4d-5cf120bedb96 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:44:08.689298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:08.689298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:08.689298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:08.689298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:08.689298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:08.689298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:08.689298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:08.689298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:08.689298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:08.689298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:08.689298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:08.689298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:08.689298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:08.689298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:08.689298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:08.690168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:08.690168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:08.690168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:08.690168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:08.690168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:08.690168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:08.690168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:08.690168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:08.690168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:08.690168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:08.690168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:08.690168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:08.690168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:08.690168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:08.690168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:08.690168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:08.690966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:08.690966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:08.690966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:08.690966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:08.690966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:08.690966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:08.690966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:08.690966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:08.690966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:08.690966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:08.690966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:44:08.690966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:08.697810 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 119/241] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:08.698870 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176324e2-1ab8-4c75-bb4d-5cf120bedb96 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:08.715324 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4622b-d104-4082-bcad-e1bdf9365d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:08.716328 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4622b-d104-4082-bcad-e1bdf9365d6a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:08.716613 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4622b-d104-4082-bcad-e1bdf9365d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:08.716883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4622b-d104-4082-bcad-e1bdf9365d6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:08.718236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4622b-d104-4082-bcad-e1bdf9365d6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:08.719962 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4622b-d104-4082-bcad-e1bdf9365d6a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:08.722158 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 123/242] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:08.722923 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4622b-d104-4082-bcad-e1bdf9365d6a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:08.787219 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:08.814096 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176324e2-1ab8-4c75-bb4d-5cf120bedb96 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:08.835770 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4622b-d104-4082-bcad-e1bdf9365d6a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:08.849317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7b476-627a-40fa-9c09-f692914a8516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:08.849960 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7b476-627a-40fa-9c09-f692914a8516 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:08.850234 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7b476-627a-40fa-9c09-f692914a8516 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:08.850498 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7b476-627a-40fa-9c09-f692914a8516 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:08.862613 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7b476-627a-40fa-9c09-f692914a8516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:08.867766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-cac7b476-627a-40fa-9c09-f692914a8516 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:08.867766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:08.867766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:08.867766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:08.867766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:08.867766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:08.867766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:08.867766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:08.867766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:08.867766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:08.867766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:08.867766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:08.867766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:08.867766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:08.867766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:08.867766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:08.868704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:08.868704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:08.868704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:08.868704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:08.868704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:08.868704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:08.868704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:08.868704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:08.868704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:08.868704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:08.868704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:08.868704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:08.868704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:08.868704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:08.868704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:08.868704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:08.869489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:08.869489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:08.869489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:08.869489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:08.869489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:08.869489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:08.869489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:08.869489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:08.869489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:08.869489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:08.869489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:08.869489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:08.869489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 120/243] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:08.870169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7b476-627a-40fa-9c09-f692914a8516 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:08.884064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a97ae6-f98b-40bc-8015-f0bbbb87248f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:08.885035 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a97ae6-f98b-40bc-8015-f0bbbb87248f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:08.885543 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a97ae6-f98b-40bc-8015-f0bbbb87248f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:08.885997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a97ae6-f98b-40bc-8015-f0bbbb87248f None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:08.886870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a97ae6-f98b-40bc-8015-f0bbbb87248f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:08.887381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a97ae6-f98b-40bc-8015-f0bbbb87248f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:08.888978 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a97ae6-f98b-40bc-8015-f0bbbb87248f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:08.898574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 124/244] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:44:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:08.904387 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a97ae6-f98b-40bc-8015-f0bbbb87248f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:08.930839 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:08.975754 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7b476-627a-40fa-9c09-f692914a8516 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:09.015093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a9c96-1acd-4df5-b616-2d05d4eb3a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:09.015753 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a9c96-1acd-4df5-b616-2d05d4eb3a89 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:09.016196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a9c96-1acd-4df5-b616-2d05d4eb3a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:09.016675 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a9c96-1acd-4df5-b616-2d05d4eb3a89 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:09.017442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a9c96-1acd-4df5-b616-2d05d4eb3a89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:09.017756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a97ae6-f98b-40bc-8015-f0bbbb87248f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:09.018898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a9c96-1acd-4df5-b616-2d05d4eb3a89 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:09.027158 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:09.045385 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 121/245] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Aug 30 11:44:08 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:44:09.046668 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a9c96-1acd-4df5-b616-2d05d4eb3a89 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:09.071973 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060ef1a-9c8e-4110-ac06-3257dc6fc947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:09.072687 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060ef1a-9c8e-4110-ac06-3257dc6fc947 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:09.073014 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060ef1a-9c8e-4110-ac06-3257dc6fc947 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:09.073289 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060ef1a-9c8e-4110-ac06-3257dc6fc947 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:09.074012 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060ef1a-9c8e-4110-ac06-3257dc6fc947 None admin] RBAC: Adding query filter params (name=member) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:09.074360 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060ef1a-9c8e-4110-ac06-3257dc6fc947 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:09.076619 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060ef1a-9c8e-4110-ac06-3257dc6fc947 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:09.091419 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 125/246] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:44:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:09.096997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060ef1a-9c8e-4110-ac06-3257dc6fc947 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:09.193882 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a9c96-1acd-4df5-b616-2d05d4eb3a89 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:09.233137 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53081d-8f77-492e-88ac-b6ef929f8220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:09.234160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53081d-8f77-492e-88ac-b6ef929f8220 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:09.234631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53081d-8f77-492e-88ac-b6ef929f8220 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:09.235151 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53081d-8f77-492e-88ac-b6ef929f8220 None admin] PATH_INFO: `/v3/users/ee7ed666b20f41489cb8c5fd9925397c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:09.251001 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53081d-8f77-492e-88ac-b6ef929f8220 None admin] RBAC: Authorizing `identity:get_user(user_id=ee7ed666b20f41489cb8c5fd9925397c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:09.252994 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53081d-8f77-492e-88ac-b6ef929f8220 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:09.255394 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 122/247] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:44:09 2022] GET /identity/v3/users/ee7ed666b20f41489cb8c5fd9925397c => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:09.262411 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53081d-8f77-492e-88ac-b6ef929f8220 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:09.273111 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:09.305504 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060ef1a-9c8e-4110-ac06-3257dc6fc947 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:09.335215 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:09.366317 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf055b-4d9e-4e3c-ae22-245a9921b2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:09.366965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf055b-4d9e-4e3c-ae22-245a9921b2b8 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:09.367238 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf055b-4d9e-4e3c-ae22-245a9921b2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:09.367536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf055b-4d9e-4e3c-ae22-245a9921b2b8 None admin] PATH_INFO: `/v3/users/b96f1c942b3640578bfabac7ce07728c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:09.371073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf055b-4d9e-4e3c-ae22-245a9921b2b8 None admin] RBAC: Authorizing `identity:get_user(user_id=b96f1c942b3640578bfabac7ce07728c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:09.373074 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf055b-4d9e-4e3c-ae22-245a9921b2b8 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:09.379504 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 126/248] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:44:09 2022] GET /identity/v3/users/b96f1c942b3640578bfabac7ce07728c => generated 297 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:09.381371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf055b-4d9e-4e3c-ae22-245a9921b2b8 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:09.406850 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53081d-8f77-492e-88ac-b6ef929f8220 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:09.444084 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81c90f-1907-4fd6-b0cf-6478cecb1106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:09.445114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81c90f-1907-4fd6-b0cf-6478cecb1106 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:09.445516 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81c90f-1907-4fd6-b0cf-6478cecb1106 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:09.445933 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81c90f-1907-4fd6-b0cf-6478cecb1106 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:09.511986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf055b-4d9e-4e3c-ae22-245a9921b2b8 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:09.543573 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81c90f-1907-4fd6-b0cf-6478cecb1106 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:09.545146 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81c90f-1907-4fd6-b0cf-6478cecb1106 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:09.552704 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ce6a2-4d66-4677-8dff-eb2fd7f31e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:09.554236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ce6a2-4d66-4677-8dff-eb2fd7f31e5f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:09.554660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ce6a2-4d66-4677-8dff-eb2fd7f31e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:09.555067 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ce6a2-4d66-4677-8dff-eb2fd7f31e5f None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:09.557240 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ce6a2-4d66-4677-8dff-eb2fd7f31e5f None admin] RBAC: Authorizing `identity:get_project(project_id=f6e02d64fae241a7912706aa95544b4c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:09.559591 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ce6a2-4d66-4677-8dff-eb2fd7f31e5f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:09.561880 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 127/249] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:09 2022] GET /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:09.567830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056d332-c540-486d-9745-dac030e868e7 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:09.568308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056d332-c540-486d-9745-dac030e868e7 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:09.568876 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056d332-c540-486d-9745-dac030e868e7 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:09.570500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 128/250] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:09.571232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056d332-c540-486d-9745-dac030e868e7 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:09.602518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:09.604809 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:09.678181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 123/251] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 11:44:09.679864 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4ed60-4d67-42ed-a814-df3a6d8d187f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:09.680156 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4ed60-4d67-42ed-a814-df3a6d8d187f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:09.680424 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4ed60-4d67-42ed-a814-df3a6d8d187f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:09.701645 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2ce4ed60-4d67-42ed-a814-df3a6d8d187f None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:09.702754 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2ce4ed60-4d67-42ed-a814-df3a6d8d187f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:09.775493 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 124/252] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:09.776335 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056d332-c540-486d-9745-dac030e868e7 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:09.776452 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4ed60-4d67-42ed-a814-df3a6d8d187f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:09.838358 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ca839-4f88-4b25-8c26-1fc87c27bbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:09.839019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ca839-4f88-4b25-8c26-1fc87c27bbee None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:09.839292 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ca839-4f88-4b25-8c26-1fc87c27bbee None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:09.839586 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ca839-4f88-4b25-8c26-1fc87c27bbee None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c/users/b96f1c942b3640578bfabac7ce07728c/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:09.841830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ca839-4f88-4b25-8c26-1fc87c27bbee None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e02d64fae241a7912706aa95544b4c, user_id=b96f1c942b3640578bfabac7ce07728c, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:09.843294 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ca839-4f88-4b25-8c26-1fc87c27bbee None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:09.860686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 129/253] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:44:09 2022] PUT /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c/users/b96f1c942b3640578bfabac7ce07728c/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:44:09.863169 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a51e8-f194-4d37-835c-9757efe8b0af None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:09.864134 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a51e8-f194-4d37-835c-9757efe8b0af None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:09.864418 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a51e8-f194-4d37-835c-9757efe8b0af None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:09.869150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 130/254] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:09.876277 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c715792-0fe6-4676-bfeb-7ddd2b948454 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:09.877171 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c715792-0fe6-4676-bfeb-7ddd2b948454 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:09.877444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c715792-0fe6-4676-bfeb-7ddd2b948454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:09.913181 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-0c715792-0fe6-4676-bfeb-7ddd2b948454 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:09.914710 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0c715792-0fe6-4676-bfeb-7ddd2b948454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:09.939246 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:09.977006 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4ed60-4d67-42ed-a814-df3a6d8d187f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:10.003346 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 131/255] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:10.048724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6fc1a-9096-49ac-8b86-c7424c001267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:10.049393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6fc1a-9096-49ac-8b86-c7424c001267 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:10.049673 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6fc1a-9096-49ac-8b86-c7424c001267 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:10.049940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6fc1a-9096-49ac-8b86-c7424c001267 None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:10.051100 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6fc1a-9096-49ac-8b86-c7424c001267 None admin] RBAC: Authorizing `identity:get_project(project_id=f6e02d64fae241a7912706aa95544b4c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:10.052629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6fc1a-9096-49ac-8b86-c7424c001267 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:10.054316 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 125/256] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:09 2022] GET /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:10.060642 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c715792-0fe6-4676-bfeb-7ddd2b948454 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:10.078085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:10.203746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c715792-0fe6-4676-bfeb-7ddd2b948454 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:10.224897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6fc1a-9096-49ac-8b86-c7424c001267 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:10.251920 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e5776-d090-4bf7-bc77-2d7dbaeb956f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:10.252467 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e5776-d090-4bf7-bc77-2d7dbaeb956f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:10.252741 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e5776-d090-4bf7-bc77-2d7dbaeb956f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:10.253018 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e5776-d090-4bf7-bc77-2d7dbaeb956f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:10.253744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e5776-d090-4bf7-bc77-2d7dbaeb956f None admin] RBAC: Adding query filter params (role.id=0c933d29c2794fad8da4b91509d53aba, scope.project.id=f6e02d64fae241a7912706aa95544b4c, user.id=ee7ed666b20f41489cb8c5fd9925397c) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:10.254057 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e5776-d090-4bf7-bc77-2d7dbaeb956f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:10.255556 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e5776-d090-4bf7-bc77-2d7dbaeb956f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:10.266587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 132/257] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:44:10 2022] GET /identity/v3/role_assignments?user.id=ee7ed666b20f41489cb8c5fd9925397c&scope.project.id=f6e02d64fae241a7912706aa95544b4c&role.id=0c933d29c2794fad8da4b91509d53aba => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:10.371575 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6fc1a-9096-49ac-8b86-c7424c001267 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:10.411667 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9886c00-2224-410e-9be6-a9fddd69c7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:10.412330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9886c00-2224-410e-9be6-a9fddd69c7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:10.412606 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9886c00-2224-410e-9be6-a9fddd69c7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:10.412878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9886c00-2224-410e-9be6-a9fddd69c7b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:10.432376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9886c00-2224-410e-9be6-a9fddd69c7b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:10.437376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-a9886c00-2224-410e-9be6-a9fddd69c7b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:44:10.437376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:10.437376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:10.437376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:10.437376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:10.437376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:10.437376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:10.437376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:10.437376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:10.437376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:10.437376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:10.437376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:10.437376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:10.437376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:10.437376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:10.437376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:10.438262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:10.438262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:10.438262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:10.438262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:10.438262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:10.438262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:10.438262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:10.438262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:10.438262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:10.438262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:10.438262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:10.438262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:10.438262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:10.438262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:10.438262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:10.438262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:10.439050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:10.439050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:10.439050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:10.439050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:10.439050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:10.439050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:10.439050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:10.439050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:10.439050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:10.439050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:10.439050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:44:10.439050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:10.439050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 126/258] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:44:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:44:10.446320 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e5776-d090-4bf7-bc77-2d7dbaeb956f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:10.458039 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9886c00-2224-410e-9be6-a9fddd69c7b8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:10.478379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:10.591319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:10.629503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e5776-d090-4bf7-bc77-2d7dbaeb956f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:10.651206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9886c00-2224-410e-9be6-a9fddd69c7b8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:10.682252 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c834dbb-6f8e-43cf-b109-d4262931e00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:10.682878 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c834dbb-6f8e-43cf-b109-d4262931e00b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:10.683154 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c834dbb-6f8e-43cf-b109-d4262931e00b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:10.683450 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c834dbb-6f8e-43cf-b109-d4262931e00b None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:10.684116 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c834dbb-6f8e-43cf-b109-d4262931e00b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:10.684419 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c834dbb-6f8e-43cf-b109-d4262931e00b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:10.685951 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c834dbb-6f8e-43cf-b109-d4262931e00b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:10.696026 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 133/259] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:10.702428 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c834dbb-6f8e-43cf-b109-d4262931e00b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:10.716693 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b3a3b-a021-4768-a8a0-87c74d754306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:10.717774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b3a3b-a021-4768-a8a0-87c74d754306 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:10.718227 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b3a3b-a021-4768-a8a0-87c74d754306 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:10.718798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b3a3b-a021-4768-a8a0-87c74d754306 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:10.741636 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b3a3b-a021-4768-a8a0-87c74d754306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:10.747514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-225b3a3b-a021-4768-a8a0-87c74d754306 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:44:10.747514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:10.747514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:10.747514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:10.747514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:10.747514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:10.747514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:10.747514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:10.747514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:10.747514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:10.747514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:10.747514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:10.747514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:10.747514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:10.747514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:10.747514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:10.748490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:10.748490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:10.748490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:10.748490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:10.748490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:10.748490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:10.748490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:10.748490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:10.748490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:10.748490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:10.748490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:10.748490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:10.748490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:10.748490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:10.748490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:10.748490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:10.749281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:10.749281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:10.749281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:10.749281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:10.749281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:10.749281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:10.749281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:10.749281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:10.749281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:10.749281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:10.749281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:44:10.749281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:10.751718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 127/260] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Aug 30 11:44:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:10.759386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b3a3b-a021-4768-a8a0-87c74d754306 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:10.866740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c834dbb-6f8e-43cf-b109-d4262931e00b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:10.889439 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:10.940242 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec8fe4-6000-45f6-9ce5-78ccfce9f6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:10.940905 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec8fe4-6000-45f6-9ce5-78ccfce9f6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:10.941181 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec8fe4-6000-45f6-9ce5-78ccfce9f6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:10.941451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec8fe4-6000-45f6-9ce5-78ccfce9f6e2 None admin] PATH_INFO: `/v3/users/6f2d90be1e6841a78a383d8110976f22` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:10.943666 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec8fe4-6000-45f6-9ce5-78ccfce9f6e2 None admin] RBAC: Authorizing `identity:get_user(user_id=6f2d90be1e6841a78a383d8110976f22)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:10.945177 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec8fe4-6000-45f6-9ce5-78ccfce9f6e2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:10.953284 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 134/261] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:44:10 2022] GET /identity/v3/users/6f2d90be1e6841a78a383d8110976f22 => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:10.954229 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec8fe4-6000-45f6-9ce5-78ccfce9f6e2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:10.963253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:10.977582 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b3a3b-a021-4768-a8a0-87c74d754306 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:11.040107 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5aab8c-00a8-4fda-ba3d-b09c556ecb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:11.041101 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5aab8c-00a8-4fda-ba3d-b09c556ecb92 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:11.041603 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5aab8c-00a8-4fda-ba3d-b09c556ecb92 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:11.042062 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5aab8c-00a8-4fda-ba3d-b09c556ecb92 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:11.042984 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5aab8c-00a8-4fda-ba3d-b09c556ecb92 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:11.043538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5aab8c-00a8-4fda-ba3d-b09c556ecb92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:11.045183 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5aab8c-00a8-4fda-ba3d-b09c556ecb92 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:11.058977 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 128/262] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:44:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:11.065562 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5aab8c-00a8-4fda-ba3d-b09c556ecb92 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:11.129737 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec8fe4-6000-45f6-9ce5-78ccfce9f6e2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:11.201601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66079f-c321-4657-9560-5da1bd6cf7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:11.202226 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66079f-c321-4657-9560-5da1bd6cf7b2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:11.202503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66079f-c321-4657-9560-5da1bd6cf7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:11.202772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66079f-c321-4657-9560-5da1bd6cf7b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:11.265493 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5aab8c-00a8-4fda-ba3d-b09c556ecb92 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:11.314867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66079f-c321-4657-9560-5da1bd6cf7b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:11.316395 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66079f-c321-4657-9560-5da1bd6cf7b2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:11.316525 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:11.319262 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:11.336957 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e0be4-6636-4b6c-9058-8e7475ecaa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:11.337984 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e0be4-6636-4b6c-9058-8e7475ecaa55 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:11.338450 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e0be4-6636-4b6c-9058-8e7475ecaa55 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:11.338929 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e0be4-6636-4b6c-9058-8e7475ecaa55 None admin] PATH_INFO: `/v3/users/6f2d90be1e6841a78a383d8110976f22` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:11.344209 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e0be4-6636-4b6c-9058-8e7475ecaa55 None admin] RBAC: Authorizing `identity:get_user(user_id=6f2d90be1e6841a78a383d8110976f22)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:11.345917 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e0be4-6636-4b6c-9058-8e7475ecaa55 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:11.347797 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 129/263] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:44:11 2022] GET /identity/v3/users/6f2d90be1e6841a78a383d8110976f22 => generated 283 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:11.356657 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e0be4-6636-4b6c-9058-8e7475ecaa55 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:11.521574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 135/264] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:11.527617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66079f-c321-4657-9560-5da1bd6cf7b2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:11.599253 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e0be4-6636-4b6c-9058-8e7475ecaa55 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:11.684228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90c263-7273-4699-9f19-b9ebaaaf9426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:11.685264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90c263-7273-4699-9f19-b9ebaaaf9426 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:11.685761 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90c263-7273-4699-9f19-b9ebaaaf9426 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:11.686231 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90c263-7273-4699-9f19-b9ebaaaf9426 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:11.753392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66079f-c321-4657-9560-5da1bd6cf7b2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:11.756012 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:11.812670 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:11.824699 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90c263-7273-4699-9f19-b9ebaaaf9426 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:11.826447 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90c263-7273-4699-9f19-b9ebaaaf9426 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:11.841792 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c03731-b4c6-4d50-8bc7-9dbbc4bec053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:11.842449 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c03731-b4c6-4d50-8bc7-9dbbc4bec053 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:11.842728 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c03731-b4c6-4d50-8bc7-9dbbc4bec053 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:11.843001 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c03731-b4c6-4d50-8bc7-9dbbc4bec053 None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:11.848133 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c03731-b4c6-4d50-8bc7-9dbbc4bec053 None admin] RBAC: Authorizing `identity:get_project(project_id=f6e02d64fae241a7912706aa95544b4c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:11.849637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c03731-b4c6-4d50-8bc7-9dbbc4bec053 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:11.851749 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 136/265] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:11 2022] GET /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c => generated 302 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:11.857181 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c03731-b4c6-4d50-8bc7-9dbbc4bec053 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:12.035903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 130/266] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 679 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 11:44:12.037215 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba40364-4080-4bb6-a9bc-0e901aa34ae6 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:12.037499 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba40364-4080-4bb6-a9bc-0e901aa34ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:12.037774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba40364-4080-4bb6-a9bc-0e901aa34ae6 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:12.039254 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 131/267] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:12.047186 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba40364-4080-4bb6-a9bc-0e901aa34ae6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:12.092681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c03731-b4c6-4d50-8bc7-9dbbc4bec053 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:12.138485 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e20cbe-7b6f-4ad0-8e91-5a7a983fac7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:12.139261 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e20cbe-7b6f-4ad0-8e91-5a7a983fac7b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:12.139653 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e20cbe-7b6f-4ad0-8e91-5a7a983fac7b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:12.140010 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e20cbe-7b6f-4ad0-8e91-5a7a983fac7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:12.141473 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e20cbe-7b6f-4ad0-8e91-5a7a983fac7b None admin] RBAC: Adding query filter params (role.id=4f4d8a6881ca496bb2d4845a6592fea8, scope.project.id=f6e02d64fae241a7912706aa95544b4c, user.id=6f2d90be1e6841a78a383d8110976f22) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:12.142002 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e20cbe-7b6f-4ad0-8e91-5a7a983fac7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:12.144716 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e20cbe-7b6f-4ad0-8e91-5a7a983fac7b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:12.151291 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 137/268] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:44:11 2022] GET /identity/v3/role_assignments?user.id=6f2d90be1e6841a78a383d8110976f22&scope.project.id=f6e02d64fae241a7912706aa95544b4c&role.id=4f4d8a6881ca496bb2d4845a6592fea8 => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:12.153035 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e97cc5-7c70-4ce7-8689-2dc2218fa52d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:12.153415 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e97cc5-7c70-4ce7-8689-2dc2218fa52d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:12.153795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e97cc5-7c70-4ce7-8689-2dc2218fa52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:12.179586 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-10e97cc5-7c70-4ce7-8689-2dc2218fa52d None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:12.180977 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-10e97cc5-7c70-4ce7-8689-2dc2218fa52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:12.215772 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:12.225219 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba40364-4080-4bb6-a9bc-0e901aa34ae6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:12.229893 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:12.293065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531f1c5-9c71-419b-87c2-1857d1e41010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:12.293717 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531f1c5-9c71-419b-87c2-1857d1e41010 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:12.293989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531f1c5-9c71-419b-87c2-1857d1e41010 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:12.294254 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531f1c5-9c71-419b-87c2-1857d1e41010 None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:12.295573 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531f1c5-9c71-419b-87c2-1857d1e41010 None admin] RBAC: Authorizing `identity:get_project(project_id=f6e02d64fae241a7912706aa95544b4c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:12.298143 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531f1c5-9c71-419b-87c2-1857d1e41010 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:12.299857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 132/269] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:12 2022] GET /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:12.309398 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3e13d-f2c5-4c2c-ae45-e32364178f3a None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:12.309732 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3e13d-f2c5-4c2c-ae45-e32364178f3a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:12.309937 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3e13d-f2c5-4c2c-ae45-e32364178f3a None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:12.311315 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 133/270] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:12.316002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3e13d-f2c5-4c2c-ae45-e32364178f3a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:12.325075 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 138/271] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:12.327750 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95556979-cd60-47a0-bcc8-764d99c43529 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:12.328035 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95556979-cd60-47a0-bcc8-764d99c43529 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:12.328305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95556979-cd60-47a0-bcc8-764d99c43529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:12.366564 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-95556979-cd60-47a0-bcc8-764d99c43529 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:12.371175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-95556979-cd60-47a0-bcc8-764d99c43529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:12.505265 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 139/272] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:12.508824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3e13d-f2c5-4c2c-ae45-e32364178f3a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:12.543403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961e387-d61a-4728-8f4f-ce4e3daf5e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:12.544026 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961e387-d61a-4728-8f4f-ce4e3daf5e26 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:12.544300 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961e387-d61a-4728-8f4f-ce4e3daf5e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:12.544619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961e387-d61a-4728-8f4f-ce4e3daf5e26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:12.545440 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961e387-d61a-4728-8f4f-ce4e3daf5e26 None admin] RBAC: Adding query filter params (role.id=30c5b9fbbb564c6dafe66f759683738b, scope.project.id=f6e02d64fae241a7912706aa95544b4c, user.id=6f2d90be1e6841a78a383d8110976f22) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:12.545741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961e387-d61a-4728-8f4f-ce4e3daf5e26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:12.547373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961e387-d61a-4728-8f4f-ce4e3daf5e26 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:12.553776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 134/273] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:44:12 2022] GET /identity/v3/role_assignments?user.id=6f2d90be1e6841a78a383d8110976f22&scope.project.id=f6e02d64fae241a7912706aa95544b4c&role.id=30c5b9fbbb564c6dafe66f759683738b => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:12.717826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95556979-cd60-47a0-bcc8-764d99c43529 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:12.834478 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:12.840708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95556979-cd60-47a0-bcc8-764d99c43529 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:12.869446 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961e387-d61a-4728-8f4f-ce4e3daf5e26 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:12.880762 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a55675-ea27-4598-84ce-51ff7e033db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:12.881417 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a55675-ea27-4598-84ce-51ff7e033db2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:12.881693 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a55675-ea27-4598-84ce-51ff7e033db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:12.881957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a55675-ea27-4598-84ce-51ff7e033db2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:12.883781 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a55675-ea27-4598-84ce-51ff7e033db2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:12.885268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a55675-ea27-4598-84ce-51ff7e033db2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:12.887006 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 140/274] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:12.889189 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d4168-170f-4724-a06a-1e92d65b1c88 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:12.889475 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d4168-170f-4724-a06a-1e92d65b1c88 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:12.889744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d4168-170f-4724-a06a-1e92d65b1c88 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:12.891105 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 141/275] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:12.894792 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d4168-170f-4724-a06a-1e92d65b1c88 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:12.908952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:13.006254 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961e387-d61a-4728-8f4f-ce4e3daf5e26 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:13.015608 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d4168-170f-4724-a06a-1e92d65b1c88 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:13.039570 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9e7c5-ae1c-491a-bb91-e86c34ee3e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:13.040205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9e7c5-ae1c-491a-bb91-e86c34ee3e72 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:13.040482 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9e7c5-ae1c-491a-bb91-e86c34ee3e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:13.040749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9e7c5-ae1c-491a-bb91-e86c34ee3e72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:13.051239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9e7c5-ae1c-491a-bb91-e86c34ee3e72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:13.052450 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5df8ed-6f5d-4872-841a-80221ef3d56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:13.053062 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5df8ed-6f5d-4872-841a-80221ef3d56d None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:13.053336 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5df8ed-6f5d-4872-841a-80221ef3d56d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:13.053598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5df8ed-6f5d-4872-841a-80221ef3d56d None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:13.054246 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5df8ed-6f5d-4872-841a-80221ef3d56d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:13.055722 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5df8ed-6f5d-4872-841a-80221ef3d56d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:13.056641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-12f9e7c5-ae1c-491a-bb91-e86c34ee3e72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:13.056641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:13.056641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:13.056641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:13.056641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:13.056641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:13.056641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:13.056641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:13.056641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:13.056641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:13.056641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:13.056641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:13.056641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:13.056641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:13.056641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:13.056641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:13.057712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:13.057712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:13.057712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:13.057712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:13.057712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:13.057712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:13.057712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:13.057712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:13.057712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:13.057712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:13.057712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:13.057712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:13.057712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:13.057712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:13.057712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:13.057712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:13.058496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:13.058496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:13.058496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:13.058496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:13.058496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:13.058496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:13.058496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:13.058496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:13.058496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:13.058496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:13.058496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:13.058496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:13.058496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 135/276] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:13.059133 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd369ae-7435-4cad-a875-3f6b8d4f5207 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:13.059133 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd369ae-7435-4cad-a875-3f6b8d4f5207 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:13.059643 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd369ae-7435-4cad-a875-3f6b8d4f5207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:13.077987 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 142/277] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Aug 30 11:44:12 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:44:13.078168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-dcd369ae-7435-4cad-a875-3f6b8d4f5207 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:13.079384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dcd369ae-7435-4cad-a875-3f6b8d4f5207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:13.079532 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901e518-aa61-4e27-84bd-6d248247413b None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:13.079718 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901e518-aa61-4e27-84bd-6d248247413b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:13.079985 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901e518-aa61-4e27-84bd-6d248247413b None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:13.081464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 143/278] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:13.081990 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901e518-aa61-4e27-84bd-6d248247413b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:13.109633 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:13.167181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 136/279] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:13.168500 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52beb0e2-50b6-461a-b427-61b3ee53deeb None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:13.168784 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52beb0e2-50b6-461a-b427-61b3ee53deeb None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:13.169056 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52beb0e2-50b6-461a-b427-61b3ee53deeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:13.202326 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-52beb0e2-50b6-461a-b427-61b3ee53deeb None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:13.204017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-52beb0e2-50b6-461a-b427-61b3ee53deeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:13.220562 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:13.231203 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901e518-aa61-4e27-84bd-6d248247413b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:13.277997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d287f8-a5f2-4d6f-820f-a6f0fe355d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:13.278944 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d287f8-a5f2-4d6f-820f-a6f0fe355d65 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:13.279219 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d287f8-a5f2-4d6f-820f-a6f0fe355d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:13.279515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d287f8-a5f2-4d6f-820f-a6f0fe355d65 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:13.280254 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d287f8-a5f2-4d6f-820f-a6f0fe355d65 None admin] RBAC: Adding query filter params (name=member) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:13.280558 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d287f8-a5f2-4d6f-820f-a6f0fe355d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:13.282150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d287f8-a5f2-4d6f-820f-a6f0fe355d65 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:13.286425 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 137/280] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:13.295388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 144/281] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:44:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:13.297800 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52beb0e2-50b6-461a-b427-61b3ee53deeb None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:13.402977 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52beb0e2-50b6-461a-b427-61b3ee53deeb None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:13.435702 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d287f8-a5f2-4d6f-820f-a6f0fe355d65 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:13.445907 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e678fd-a7cc-4975-b738-012c2073dfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:13.446835 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e678fd-a7cc-4975-b738-012c2073dfeb None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:13.447270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e678fd-a7cc-4975-b738-012c2073dfeb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:13.447694 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e678fd-a7cc-4975-b738-012c2073dfeb None admin] PATH_INFO: `/v3/users/f49d4aecc0464d7a954796ffcef73645` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:13.466066 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e678fd-a7cc-4975-b738-012c2073dfeb None admin] RBAC: Authorizing `identity:get_user(user_id=f49d4aecc0464d7a954796ffcef73645)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:13.467616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e678fd-a7cc-4975-b738-012c2073dfeb None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:13.470014 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 138/282] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:44:13 2022] GET /identity/v3/users/f49d4aecc0464d7a954796ffcef73645 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:13.482465 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e678fd-a7cc-4975-b738-012c2073dfeb None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:13.497955 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:13.554775 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:13.576648 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d287f8-a5f2-4d6f-820f-a6f0fe355d65 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:13.615178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ceb4c0-9703-4735-9936-883e312d5256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:13.615886 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceb4c0-9703-4735-9936-883e312d5256 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:13.616163 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceb4c0-9703-4735-9936-883e312d5256 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:13.616438 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceb4c0-9703-4735-9936-883e312d5256 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:13.621264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e678fd-a7cc-4975-b738-012c2073dfeb None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:13.629247 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ceb4c0-9703-4735-9936-883e312d5256 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:13.635675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-57ceb4c0-9703-4735-9936-883e312d5256 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:13.635675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:13.635675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:13.635675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:13.635675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:13.635675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:13.635675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:13.635675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:13.635675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:13.635675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:13.635675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:13.635675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:13.635675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:13.635675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:13.635675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:13.635675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:13.636530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:13.636530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:13.636530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:13.636530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:13.636530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:13.636530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:13.636530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:13.636530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:13.636530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:13.636530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:13.636530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:13.636530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:13.636530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:13.636530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:13.636530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:13.636530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:13.637739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:13.637739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:13.637739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:13.637739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:13.637739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:13.637739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:13.637739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:13.637739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:13.637739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:13.637739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:13.637739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:13.637739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:13.637739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 145/283] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:44:13.638613 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ceb4c0-9703-4735-9936-883e312d5256 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:13.662617 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497115a-aef1-4fcb-a0bd-5918e5952188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:13.663238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497115a-aef1-4fcb-a0bd-5918e5952188 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:13.663552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497115a-aef1-4fcb-a0bd-5918e5952188 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:13.663829 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497115a-aef1-4fcb-a0bd-5918e5952188 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:13.664718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497115a-aef1-4fcb-a0bd-5918e5952188 None admin] RBAC: Adding query filter params (role.id=7f855c6f817f4a64a1e635407de8bfb0, user.id=f49d4aecc0464d7a954796ffcef73645, scope.system=all) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:13.665031 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497115a-aef1-4fcb-a0bd-5918e5952188 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:13.666487 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497115a-aef1-4fcb-a0bd-5918e5952188 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:13.671766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 139/284] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Aug 30 11:44:13 2022] GET /identity/v3/role_assignments?user.id=f49d4aecc0464d7a954796ffcef73645&scope.system=all&role.id=7f855c6f817f4a64a1e635407de8bfb0 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:13.673150 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497115a-aef1-4fcb-a0bd-5918e5952188 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:13.755692 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ceb4c0-9703-4735-9936-883e312d5256 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:13.793315 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8607f9-52c5-4a9a-8236-86940b504a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:13.794103 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8607f9-52c5-4a9a-8236-86940b504a1e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:13.794372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8607f9-52c5-4a9a-8236-86940b504a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:13.794640 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8607f9-52c5-4a9a-8236-86940b504a1e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:13.806881 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8607f9-52c5-4a9a-8236-86940b504a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:13.812019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-cd8607f9-52c5-4a9a-8236-86940b504a1e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:44:13.812019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:13.812019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:13.812019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:13.812019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:13.812019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:13.812019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:13.812019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:13.812019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:13.812019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:13.812019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:13.812019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:13.812019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:13.812019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:13.812019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:13.812019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:13.814232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:13.814232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:13.814232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:13.814232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:13.814232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:13.814232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:13.814232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:13.814232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:13.814232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:13.814232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:13.814232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:13.814232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:13.814232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:13.814232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:13.814232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:13.814232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:13.815230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:13.815230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:13.815230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:13.815230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:13.815230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:13.815230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:13.815230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:13.815230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:13.815230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:13.815230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:13.815230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:44:13.815230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:13.815230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 146/285] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:13.820010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:13.821208 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8607f9-52c5-4a9a-8236-86940b504a1e None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:13.830905 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:13.870807 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497115a-aef1-4fcb-a0bd-5918e5952188 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:13.932086 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24eaa92-8cc5-4467-8631-9fb72a6cab80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:13.933133 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24eaa92-8cc5-4467-8631-9fb72a6cab80 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:13.933600 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24eaa92-8cc5-4467-8631-9fb72a6cab80 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:13.934100 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24eaa92-8cc5-4467-8631-9fb72a6cab80 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:13.934972 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24eaa92-8cc5-4467-8631-9fb72a6cab80 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:13.935279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24eaa92-8cc5-4467-8631-9fb72a6cab80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:13.936744 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24eaa92-8cc5-4467-8631-9fb72a6cab80 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:13.946220 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 140/286] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:44:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:13.952649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24eaa92-8cc5-4467-8631-9fb72a6cab80 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:13.971304 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8607f9-52c5-4a9a-8236-86940b504a1e None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:14.011133 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfe97c-5f59-45bd-8a68-0fc01c840354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:14.012358 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfe97c-5f59-45bd-8a68-0fc01c840354 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:14.012830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfe97c-5f59-45bd-8a68-0fc01c840354 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:14.013327 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfe97c-5f59-45bd-8a68-0fc01c840354 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:14.014176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfe97c-5f59-45bd-8a68-0fc01c840354 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:14.014719 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfe97c-5f59-45bd-8a68-0fc01c840354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:14.017729 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfe97c-5f59-45bd-8a68-0fc01c840354 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:14.027383 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 147/287] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:44:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:14.033881 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfe97c-5f59-45bd-8a68-0fc01c840354 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:14.112235 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24eaa92-8cc5-4467-8631-9fb72a6cab80 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:14.127191 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:14.144655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:14.151384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21bca93-0614-4449-8378-fa41a3f226d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:14.152361 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21bca93-0614-4449-8378-fa41a3f226d9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:14.152860 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21bca93-0614-4449-8378-fa41a3f226d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:14.153337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21bca93-0614-4449-8378-fa41a3f226d9 None admin] PATH_INFO: `/v3/users/b96f1c942b3640578bfabac7ce07728c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:14.154799 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21bca93-0614-4449-8378-fa41a3f226d9 None admin] RBAC: Authorizing `identity:get_user(user_id=b96f1c942b3640578bfabac7ce07728c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:14.156509 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21bca93-0614-4449-8378-fa41a3f226d9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:14.158578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 141/288] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:44:13 2022] GET /identity/v3/users/b96f1c942b3640578bfabac7ce07728c => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:14.168380 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21bca93-0614-4449-8378-fa41a3f226d9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:14.183388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfe97c-5f59-45bd-8a68-0fc01c840354 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:14.231336 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863b03d-c4e5-42fc-a627-e5debee5aaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:14.232011 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863b03d-c4e5-42fc-a627-e5debee5aaa1 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:14.232269 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863b03d-c4e5-42fc-a627-e5debee5aaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:14.232548 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863b03d-c4e5-42fc-a627-e5debee5aaa1 None admin] PATH_INFO: `/v3/users/ee7ed666b20f41489cb8c5fd9925397c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:14.233683 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863b03d-c4e5-42fc-a627-e5debee5aaa1 None admin] RBAC: Authorizing `identity:get_user(user_id=ee7ed666b20f41489cb8c5fd9925397c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:14.235735 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863b03d-c4e5-42fc-a627-e5debee5aaa1 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:14.237711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 148/289] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:44:14 2022] GET /identity/v3/users/ee7ed666b20f41489cb8c5fd9925397c => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:14.244174 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863b03d-c4e5-42fc-a627-e5debee5aaa1 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:14.378296 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863b03d-c4e5-42fc-a627-e5debee5aaa1 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:14.421080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:14.422328 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21bca93-0614-4449-8378-fa41a3f226d9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:14.440061 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a633f-5240-4d7d-83f2-c3945b59d845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:14.440717 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a633f-5240-4d7d-83f2-c3945b59d845 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:14.441003 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a633f-5240-4d7d-83f2-c3945b59d845 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:14.441269 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a633f-5240-4d7d-83f2-c3945b59d845 None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:14.442424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a633f-5240-4d7d-83f2-c3945b59d845 None admin] RBAC: Authorizing `identity:get_project(project_id=f6e02d64fae241a7912706aa95544b4c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:14.443933 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a633f-5240-4d7d-83f2-c3945b59d845 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:14.445891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 149/290] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:14 2022] GET /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:14.451433 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a633f-5240-4d7d-83f2-c3945b59d845 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:14.463518 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817bfd64-ccbb-419e-96e2-d5af474d1e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:14.464221 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bfd64-ccbb-419e-96e2-d5af474d1e35 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:14.464548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bfd64-ccbb-419e-96e2-d5af474d1e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:14.465184 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bfd64-ccbb-419e-96e2-d5af474d1e35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:14.555671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:14.558971 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817bfd64-ccbb-419e-96e2-d5af474d1e35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:14.560932 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817bfd64-ccbb-419e-96e2-d5af474d1e35 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:14.674880 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 142/291] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:14.680790 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817bfd64-ccbb-419e-96e2-d5af474d1e35 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:14.711101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a633f-5240-4d7d-83f2-c3945b59d845 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:14.790634 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:14.794604 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817bfd64-ccbb-419e-96e2-d5af474d1e35 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:14.804635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c33fdd-fdb2-4e5e-8b6c-add305a60f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:14.805320 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c33fdd-fdb2-4e5e-8b6c-add305a60f06 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:14.805599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c33fdd-fdb2-4e5e-8b6c-add305a60f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:14.805872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c33fdd-fdb2-4e5e-8b6c-add305a60f06 None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c/users/ee7ed666b20f41489cb8c5fd9925397c/roles/0c933d29c2794fad8da4b91509d53aba` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:14.812645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c33fdd-fdb2-4e5e-8b6c-add305a60f06 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e02d64fae241a7912706aa95544b4c, user_id=ee7ed666b20f41489cb8c5fd9925397c, role_id=0c933d29c2794fad8da4b91509d53aba)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:14.814380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c33fdd-fdb2-4e5e-8b6c-add305a60f06 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:14.835653 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a57d6-811f-4b6c-94fe-db5c429a747e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:14.836639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a57d6-811f-4b6c-94fe-db5c429a747e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:14.837134 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a57d6-811f-4b6c-94fe-db5c429a747e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:14.837651 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a57d6-811f-4b6c-94fe-db5c429a747e None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:14.839411 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a57d6-811f-4b6c-94fe-db5c429a747e None admin] RBAC: Authorizing `identity:get_project(project_id=f6e02d64fae241a7912706aa95544b4c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:14.841578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a57d6-811f-4b6c-94fe-db5c429a747e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:14.845029 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 143/292] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:14 2022] GET /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:14.849448 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 150/293] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:44:14 2022] PUT /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c/users/ee7ed666b20f41489cb8c5fd9925397c/roles/0c933d29c2794fad8da4b91509d53aba => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:44:14.850510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a57d6-811f-4b6c-94fe-db5c429a747e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:14.971106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a57d6-811f-4b6c-94fe-db5c429a747e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:15.011806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ccbe3-f812-49e2-8627-e80093136775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:15.012896 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ccbe3-f812-49e2-8627-e80093136775 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:15.013395 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ccbe3-f812-49e2-8627-e80093136775 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:15.013871 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ccbe3-f812-49e2-8627-e80093136775 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:15.014827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ccbe3-f812-49e2-8627-e80093136775 None admin] RBAC: Adding query filter params (role.id=7f855c6f817f4a64a1e635407de8bfb0, scope.project.id=f6e02d64fae241a7912706aa95544b4c, user.id=b96f1c942b3640578bfabac7ce07728c) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:15.015462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ccbe3-f812-49e2-8627-e80093136775 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:15.017961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ccbe3-f812-49e2-8627-e80093136775 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:15.025527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 144/294] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:44:14 2022] GET /identity/v3/role_assignments?user.id=b96f1c942b3640578bfabac7ce07728c&scope.project.id=f6e02d64fae241a7912706aa95544b4c&role.id=7f855c6f817f4a64a1e635407de8bfb0 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:15.473148 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5746b-003d-4a66-bb7c-b864151219d0 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:15.474198 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5746b-003d-4a66-bb7c-b864151219d0 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:15.474673 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5746b-003d-4a66-bb7c-b864151219d0 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:15.476641 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 151/295] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:15.481799 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a52163-877b-419a-935c-5e95cc3d4643 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:15.482215 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a52163-877b-419a-935c-5e95cc3d4643 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:15.482387 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a52163-877b-419a-935c-5e95cc3d4643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:15.504733 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-99a52163-877b-419a-935c-5e95cc3d4643 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:15.505904 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-99a52163-877b-419a-935c-5e95cc3d4643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:15.538640 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:15.582863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 145/296] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:15.706359 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cba889-2385-4dea-8e36-f2f199f41041 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:15.706685 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cba889-2385-4dea-8e36-f2f199f41041 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:15.706907 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cba889-2385-4dea-8e36-f2f199f41041 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:15.708431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 152/297] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:15.713539 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0a424-5296-424a-99fb-274793b0d86b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:15.713822 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0a424-5296-424a-99fb-274793b0d86b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:15.714093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0a424-5296-424a-99fb-274793b0d86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:15.733051 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4ae0a424-5296-424a-99fb-274793b0d86b None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:15.734149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4ae0a424-5296-424a-99fb-274793b0d86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:15.800602 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 146/298] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:15.854695 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cba889-2385-4dea-8e36-f2f199f41041 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:15.916528 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:15.961816 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cba889-2385-4dea-8e36-f2f199f41041 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:15.963311 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49703876-8ea2-414b-91f7-59e9cfa1c98d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:15.963614 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49703876-8ea2-414b-91f7-59e9cfa1c98d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:15.963891 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49703876-8ea2-414b-91f7-59e9cfa1c98d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:15.965751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 147/299] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:15.970831 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd7408-d21b-4f19-bc1d-9d6d8dee0cd5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:15.971110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd7408-d21b-4f19-bc1d-9d6d8dee0cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:15.971404 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd7408-d21b-4f19-bc1d-9d6d8dee0cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:15.991232 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b6cd7408-d21b-4f19-bc1d-9d6d8dee0cd5 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:15.992379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b6cd7408-d21b-4f19-bc1d-9d6d8dee0cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:16.001825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bad1bc-5bdc-4d92-80cb-1ae769a405fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:16.002816 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bad1bc-5bdc-4d92-80cb-1ae769a405fe None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:16.003086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bad1bc-5bdc-4d92-80cb-1ae769a405fe None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:16.003352 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bad1bc-5bdc-4d92-80cb-1ae769a405fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:16.014782 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bad1bc-5bdc-4d92-80cb-1ae769a405fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:16.020715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-c3bad1bc-5bdc-4d92-80cb-1ae769a405fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:44:16.020715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:16.020715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:16.020715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:16.020715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:16.020715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:16.020715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:16.020715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:16.020715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:16.020715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:16.020715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:16.020715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:16.020715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:16.020715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:16.020715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:16.020715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:16.021600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:16.021600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:16.021600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:16.021600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:16.021600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:16.021600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:16.021600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:16.021600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:16.021600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:16.021600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:16.021600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:16.021600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:16.021600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:16.021600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:16.021600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:16.021600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:16.022372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:16.022372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:16.022372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:16.022372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:16.022372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:16.022372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:16.022372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:16.022372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:16.022372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:16.022372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:16.022372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:44:16.022372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:16.022372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 153/300] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:16.028868 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bad1bc-5bdc-4d92-80cb-1ae769a405fe None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:16.071611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 148/301] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:16.095175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd7408-d21b-4f19-bc1d-9d6d8dee0cd5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:16.132777 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:16.152745 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bad1bc-5bdc-4d92-80cb-1ae769a405fe None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:16.179712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:16.194318 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6ab28-547e-46b8-8ce4-533748ac5cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:16.194967 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6ab28-547e-46b8-8ce4-533748ac5cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:16.195252 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6ab28-547e-46b8-8ce4-533748ac5cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:16.195576 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6ab28-547e-46b8-8ce4-533748ac5cd4 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:16.196253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6ab28-547e-46b8-8ce4-533748ac5cd4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:16.196548 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6ab28-547e-46b8-8ce4-533748ac5cd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:16.198106 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6ab28-547e-46b8-8ce4-533748ac5cd4 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:16.209665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 154/302] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:44:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:16.215577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6ab28-547e-46b8-8ce4-533748ac5cd4 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:16.233444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd7408-d21b-4f19-bc1d-9d6d8dee0cd5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:16.274184 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987bd7f-a705-42a8-8527-1ac300818017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:16.275150 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987bd7f-a705-42a8-8527-1ac300818017 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:16.275454 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987bd7f-a705-42a8-8527-1ac300818017 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:16.275722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987bd7f-a705-42a8-8527-1ac300818017 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:16.277064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987bd7f-a705-42a8-8527-1ac300818017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:16.279132 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987bd7f-a705-42a8-8527-1ac300818017 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:16.281327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 149/303] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:16.287937 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987bd7f-a705-42a8-8527-1ac300818017 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:16.330357 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6ab28-547e-46b8-8ce4-533748ac5cd4 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:16.365157 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b91265-a35e-490e-8c32-106530b5996f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:16.365793 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b91265-a35e-490e-8c32-106530b5996f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:16.366070 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b91265-a35e-490e-8c32-106530b5996f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:16.366338 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b91265-a35e-490e-8c32-106530b5996f None admin] PATH_INFO: `/v3/users/8cf9b5bf1ef442d69f71fe821811d9de` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:16.380588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b91265-a35e-490e-8c32-106530b5996f None admin] RBAC: Authorizing `identity:get_user(user_id=8cf9b5bf1ef442d69f71fe821811d9de)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:16.382052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b91265-a35e-490e-8c32-106530b5996f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:16.383739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 155/304] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:44:16 2022] GET /identity/v3/users/8cf9b5bf1ef442d69f71fe821811d9de => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:16.388728 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b91265-a35e-490e-8c32-106530b5996f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:16.398600 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:16.409974 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987bd7f-a705-42a8-8527-1ac300818017 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:16.431057 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:16.448027 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e82325-3b7e-4d4e-85a7-7705dbe06744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:16.448767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e82325-3b7e-4d4e-85a7-7705dbe06744 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:16.449175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e82325-3b7e-4d4e-85a7-7705dbe06744 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:16.449404 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e82325-3b7e-4d4e-85a7-7705dbe06744 None admin] PATH_INFO: `/v3/groups` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:16.450086 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e82325-3b7e-4d4e-85a7-7705dbe06744 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:16.451571 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e82325-3b7e-4d4e-85a7-7705dbe06744 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:16.479923 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 150/305] 10.222.0.27 () {60 vars in 1134 bytes} [Tue Aug 30 11:44:16 2022] POST /identity/v3/groups => generated 229 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:44:16.482172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e82325-3b7e-4d4e-85a7-7705dbe06744 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:16.500461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b91265-a35e-490e-8c32-106530b5996f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:16.542990 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bbdf0-10ed-4928-9ec7-cd15c016c39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:16.544745 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bbdf0-10ed-4928-9ec7-cd15c016c39d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:16.545252 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bbdf0-10ed-4928-9ec7-cd15c016c39d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:16.545711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bbdf0-10ed-4928-9ec7-cd15c016c39d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:16.562066 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0bbdf0-10ed-4928-9ec7-cd15c016c39d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:16.569342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-7f0bbdf0-10ed-4928-9ec7-cd15c016c39d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:16.569342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:16.569342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:16.569342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:16.569342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:16.569342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:16.569342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:16.569342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:16.569342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:16.569342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:16.569342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:16.569342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:16.569342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:16.569342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:16.569342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:16.569342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:16.570280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:16.570280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:16.570280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:16.570280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:16.570280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:16.570280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:16.570280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:16.570280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:16.570280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:16.570280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:16.570280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:16.570280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:16.570280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:16.570280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:16.570280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:16.570280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:16.571056 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:16.571056 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:16.571056 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:16.571056 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:16.571056 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:16.571056 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:16.571056 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:16.571056 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:16.571056 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:16.571056 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:16.571056 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:16.571056 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:16.578246 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 156/306] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:16.579525 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bbdf0-10ed-4928-9ec7-cd15c016c39d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:16.631174 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e82325-3b7e-4d4e-85a7-7705dbe06744 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:16.674130 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e461c9e-81fa-4213-a66d-ee1742570865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:16.674749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e461c9e-81fa-4213-a66d-ee1742570865 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:16.675024 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e461c9e-81fa-4213-a66d-ee1742570865 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:16.675291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e461c9e-81fa-4213-a66d-ee1742570865 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:16.676992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e461c9e-81fa-4213-a66d-ee1742570865 None admin] RBAC: Adding query filter params (role.id=0c933d29c2794fad8da4b91509d53aba, user.id=8cf9b5bf1ef442d69f71fe821811d9de, scope.system=all) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:16.677301 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e461c9e-81fa-4213-a66d-ee1742570865 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:16.678742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e461c9e-81fa-4213-a66d-ee1742570865 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:16.685475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 151/307] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Aug 30 11:44:16 2022] GET /identity/v3/role_assignments?user.id=8cf9b5bf1ef442d69f71fe821811d9de&scope.system=all&role.id=0c933d29c2794fad8da4b91509d53aba => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:16.709421 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:16.712905 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bbdf0-10ed-4928-9ec7-cd15c016c39d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:16.753831 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842a7a4-329b-41f7-b249-b58e0a008b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:16.754718 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842a7a4-329b-41f7-b249-b58e0a008b29 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:16.755137 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842a7a4-329b-41f7-b249-b58e0a008b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:16.755575 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842a7a4-329b-41f7-b249-b58e0a008b29 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:16.756390 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842a7a4-329b-41f7-b249-b58e0a008b29 None admin] RBAC: Adding query filter params (name=member) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:16.756861 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842a7a4-329b-41f7-b249-b58e0a008b29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:16.758456 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842a7a4-329b-41f7-b249-b58e0a008b29 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:16.768712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 157/308] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:44:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:16.774450 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e461c9e-81fa-4213-a66d-ee1742570865 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:16.797106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:16.886052 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e461c9e-81fa-4213-a66d-ee1742570865 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:16.921446 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae14685-a902-4985-b74f-57fa3212f615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:16.922091 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae14685-a902-4985-b74f-57fa3212f615 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:16.922430 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae14685-a902-4985-b74f-57fa3212f615 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:16.923127 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae14685-a902-4985-b74f-57fa3212f615 None admin] PATH_INFO: `/v3/users/f49d4aecc0464d7a954796ffcef73645` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:16.923941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae14685-a902-4985-b74f-57fa3212f615 None admin] RBAC: Authorizing `identity:get_user(user_id=f49d4aecc0464d7a954796ffcef73645)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:16.925388 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae14685-a902-4985-b74f-57fa3212f615 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:16.927432 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 152/309] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:44:16 2022] GET /identity/v3/users/f49d4aecc0464d7a954796ffcef73645 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:16.936684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842a7a4-329b-41f7-b249-b58e0a008b29 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:17.025494 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4460c-3717-491f-8ff7-66881917cf7b None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:17.025847 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4460c-3717-491f-8ff7-66881917cf7b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:17.026045 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4460c-3717-491f-8ff7-66881917cf7b None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:17.027581 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 153/310] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:44:17.033024 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f6ff9-9604-4f34-84e8-8dcae2225a69 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:17.033550 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f6ff9-9604-4f34-84e8-8dcae2225a69 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:17.034011 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f6ff9-9604-4f34-84e8-8dcae2225a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:17.053496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c33f6ff9-9604-4f34-84e8-8dcae2225a69 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:17.054995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c33f6ff9-9604-4f34-84e8-8dcae2225a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:17.055743 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842a7a4-329b-41f7-b249-b58e0a008b29 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:17.100141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc87d3d-f4b2-4767-a1c6-1ea239aaf197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:17.100801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc87d3d-f4b2-4767-a1c6-1ea239aaf197 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:17.101080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc87d3d-f4b2-4767-a1c6-1ea239aaf197 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:17.101354 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc87d3d-f4b2-4767-a1c6-1ea239aaf197 None admin] PATH_INFO: `/v3/system/users/f49d4aecc0464d7a954796ffcef73645/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:17.103244 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc87d3d-f4b2-4767-a1c6-1ea239aaf197 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f49d4aecc0464d7a954796ffcef73645, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:17.105196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc87d3d-f4b2-4767-a1c6-1ea239aaf197 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:17.123262 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 158/311] 10.222.0.27 () {58 vars in 1334 bytes} [Tue Aug 30 11:44:16 2022] PUT /identity/v3/system/users/f49d4aecc0464d7a954796ffcef73645/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:44:17.133239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 154/312] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:44:17.398133 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc87d3d-f4b2-4767-a1c6-1ea239aaf197 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:17.426809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:17.502676 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc87d3d-f4b2-4767-a1c6-1ea239aaf197 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:17.537579 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a201d-11cf-4268-afa4-2b909ec62a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:17.538217 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a201d-11cf-4268-afa4-2b909ec62a44 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:17.538501 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a201d-11cf-4268-afa4-2b909ec62a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:17.538776 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a201d-11cf-4268-afa4-2b909ec62a44 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:17.549525 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a201d-11cf-4268-afa4-2b909ec62a44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:17.554845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-a87a201d-11cf-4268-afa4-2b909ec62a44 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:44:17.554845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:17.554845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:17.554845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:17.554845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:17.554845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:17.554845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:17.554845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:17.554845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:17.554845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:17.554845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:17.554845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:17.554845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:17.554845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:17.554845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:17.554845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:17.555730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:17.555730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:17.555730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:17.555730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:17.555730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:17.555730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:17.555730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:17.555730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:17.555730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:17.555730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:17.555730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:17.555730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:17.555730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:17.555730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:17.555730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:17.555730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:17.556526 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:17.556526 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:17.556526 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:17.556526 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:17.556526 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:17.556526 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:17.556526 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:17.556526 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:17.556526 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:17.556526 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:17.556526 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:44:17.556526 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:17.556526 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 159/313] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:17.564038 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f6ff9-9604-4f34-84e8-8dcae2225a69 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:17.586568 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:17.667929 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f6ff9-9604-4f34-84e8-8dcae2225a69 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:17.703713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37fc74-7cdc-47e5-91fb-c70a25ee1f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:17.704558 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37fc74-7cdc-47e5-91fb-c70a25ee1f1b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:17.704988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37fc74-7cdc-47e5-91fb-c70a25ee1f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:17.705261 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37fc74-7cdc-47e5-91fb-c70a25ee1f1b None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:17.705933 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37fc74-7cdc-47e5-91fb-c70a25ee1f1b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:17.706236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37fc74-7cdc-47e5-91fb-c70a25ee1f1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:17.707645 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37fc74-7cdc-47e5-91fb-c70a25ee1f1b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:17.717367 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 155/314] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:44:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:17.723376 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a201d-11cf-4268-afa4-2b909ec62a44 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:17.811286 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:17.826809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a201d-11cf-4268-afa4-2b909ec62a44 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:17.862572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455820f-5242-41cc-8922-d4de20f84641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:17.863616 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455820f-5242-41cc-8922-d4de20f84641 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:17.864087 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455820f-5242-41cc-8922-d4de20f84641 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:17.864546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455820f-5242-41cc-8922-d4de20f84641 None admin] PATH_INFO: `/v3/users/ee7ed666b20f41489cb8c5fd9925397c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:17.865927 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455820f-5242-41cc-8922-d4de20f84641 None admin] RBAC: Authorizing `identity:get_user(user_id=ee7ed666b20f41489cb8c5fd9925397c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:17.867637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455820f-5242-41cc-8922-d4de20f84641 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:17.874189 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 160/315] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:44:17 2022] GET /identity/v3/users/ee7ed666b20f41489cb8c5fd9925397c => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:17.875881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37fc74-7cdc-47e5-91fb-c70a25ee1f1b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:17.953073 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:17.980105 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37fc74-7cdc-47e5-91fb-c70a25ee1f1b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:18.016980 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab2594-9dff-46e7-84ee-7eb6a597c0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:18.017578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab2594-9dff-46e7-84ee-7eb6a597c0bb None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:18.017852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab2594-9dff-46e7-84ee-7eb6a597c0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:18.018117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab2594-9dff-46e7-84ee-7eb6a597c0bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:18.085697 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab2594-9dff-46e7-84ee-7eb6a597c0bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:18.087163 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab2594-9dff-46e7-84ee-7eb6a597c0bb None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:18.171462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:18.202677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 156/316] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:18.208520 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455820f-5242-41cc-8922-d4de20f84641 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:18.315395 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455820f-5242-41cc-8922-d4de20f84641 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:18.346486 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f10c9-9cf2-46ad-a516-d64682ddd979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:18.347132 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f10c9-9cf2-46ad-a516-d64682ddd979 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:18.347443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f10c9-9cf2-46ad-a516-d64682ddd979 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:18.347722 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f10c9-9cf2-46ad-a516-d64682ddd979 None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:18.348863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f10c9-9cf2-46ad-a516-d64682ddd979 None admin] RBAC: Authorizing `identity:get_project(project_id=f6e02d64fae241a7912706aa95544b4c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:18.350352 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f10c9-9cf2-46ad-a516-d64682ddd979 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:18.352262 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 161/317] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:18 2022] GET /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:18.358472 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab2594-9dff-46e7-84ee-7eb6a597c0bb None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:18.457706 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab2594-9dff-46e7-84ee-7eb6a597c0bb None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:18.492392 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af00cd-95af-4205-ae41-5e05c067c052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:18.493363 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af00cd-95af-4205-ae41-5e05c067c052 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:18.493842 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af00cd-95af-4205-ae41-5e05c067c052 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:18.494296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af00cd-95af-4205-ae41-5e05c067c052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:18.495202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af00cd-95af-4205-ae41-5e05c067c052 None admin] RBAC: Adding query filter params (role.id=0c933d29c2794fad8da4b91509d53aba, scope.project.id=f6e02d64fae241a7912706aa95544b4c, user.id=ee7ed666b20f41489cb8c5fd9925397c) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:18.495734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af00cd-95af-4205-ae41-5e05c067c052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:18.497345 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af00cd-95af-4205-ae41-5e05c067c052 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:18.507463 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 157/318] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:44:18 2022] GET /identity/v3/role_assignments?user.id=ee7ed666b20f41489cb8c5fd9925397c&scope.project.id=f6e02d64fae241a7912706aa95544b4c&role.id=0c933d29c2794fad8da4b91509d53aba => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:18.638760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61609e5f-bb7d-4fea-911a-52dc68205827 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:18.639289 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61609e5f-bb7d-4fea-911a-52dc68205827 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:18.639289 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61609e5f-bb7d-4fea-911a-52dc68205827 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:18.641113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 162/319] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:18.646783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11016bf0-4e7d-4ea7-a4be-8c22c318b82b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:18.647221 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11016bf0-4e7d-4ea7-a4be-8c22c318b82b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:18.647417 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11016bf0-4e7d-4ea7-a4be-8c22c318b82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:18.666936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-11016bf0-4e7d-4ea7-a4be-8c22c318b82b None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:18.668504 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-11016bf0-4e7d-4ea7-a4be-8c22c318b82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:18.700525 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:18.740218 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 158/320] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:18.770241 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d409cb-f3cf-4ac0-b539-77a1b567cad3 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:18.770532 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d409cb-f3cf-4ac0-b539-77a1b567cad3 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:18.770716 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d409cb-f3cf-4ac0-b539-77a1b567cad3 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:18.772121 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 163/321] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:18.777243 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa39d8-bf03-461a-9f77-bfe70fc18995 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:18.777527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa39d8-bf03-461a-9f77-bfe70fc18995 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:18.777822 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa39d8-bf03-461a-9f77-bfe70fc18995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:18.796071 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3ffa39d8-bf03-461a-9f77-bfe70fc18995 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:18.797295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3ffa39d8-bf03-461a-9f77-bfe70fc18995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:18.864777 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 159/322] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:19.005619 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d409cb-f3cf-4ac0-b539-77a1b567cad3 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:19.028708 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb0aad-5c03-4f44-8d25-e177389e0947 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:19.029008 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb0aad-5c03-4f44-8d25-e177389e0947 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:19.029195 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb0aad-5c03-4f44-8d25-e177389e0947 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:19.031133 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 160/323] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:44:19.034011 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:19.036527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416fcac-2e9e-4bc2-9fd6-0049c23e65b0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:19.036876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416fcac-2e9e-4bc2-9fd6-0049c23e65b0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:19.037203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416fcac-2e9e-4bc2-9fd6-0049c23e65b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:19.056428 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7416fcac-2e9e-4bc2-9fd6-0049c23e65b0 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:19.058690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7416fcac-2e9e-4bc2-9fd6-0049c23e65b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:19.127148 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d409cb-f3cf-4ac0-b539-77a1b567cad3 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:19.134367 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 161/324] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:44:19.137012 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416fcac-2e9e-4bc2-9fd6-0049c23e65b0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:19.164128 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:19.165793 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95478f-39d0-42ba-bc4a-e22118d18262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:19.166590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95478f-39d0-42ba-bc4a-e22118d18262 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:19.166927 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95478f-39d0-42ba-bc4a-e22118d18262 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:19.167645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95478f-39d0-42ba-bc4a-e22118d18262 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:19.169020 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95478f-39d0-42ba-bc4a-e22118d18262 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:19.170503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95478f-39d0-42ba-bc4a-e22118d18262 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:19.173259 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 164/325] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:19.178618 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95478f-39d0-42ba-bc4a-e22118d18262 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:19.240143 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416fcac-2e9e-4bc2-9fd6-0049c23e65b0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:19.273187 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8a3bb-7374-4b85-8aaf-1aed4681c0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:19.273828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8a3bb-7374-4b85-8aaf-1aed4681c0dc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:19.274105 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8a3bb-7374-4b85-8aaf-1aed4681c0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:19.274373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8a3bb-7374-4b85-8aaf-1aed4681c0dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:19.275382 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:19.285229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8a3bb-7374-4b85-8aaf-1aed4681c0dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:19.286521 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95478f-39d0-42ba-bc4a-e22118d18262 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:19.290064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-bbd8a3bb-7374-4b85-8aaf-1aed4681c0dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:44:19.290064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:19.290064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:19.290064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:19.290064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:19.290064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:19.290064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:19.290064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:19.290064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:19.290064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:19.290064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:19.290064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:19.290064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:19.290064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:19.290064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:19.290064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:19.291106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:19.291106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:19.291106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:19.291106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:19.291106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:19.291106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:19.291106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:19.291106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:19.291106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:19.291106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:19.291106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:19.291106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:19.291106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:19.291106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:19.291106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:19.291106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:19.292015 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:19.292015 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:19.292015 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:19.292015 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:19.292015 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:19.292015 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:19.292015 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:19.292015 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:19.292015 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:19.292015 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:19.292015 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:44:19.292015 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:19.292015 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 162/326] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:19.296972 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8a3bb-7374-4b85-8aaf-1aed4681c0dc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:19.324826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df45c8c-b0d3-497f-b980-53964b162bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:19.325647 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df45c8c-b0d3-497f-b980-53964b162bee None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:19.326092 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df45c8c-b0d3-497f-b980-53964b162bee None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:19.326576 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df45c8c-b0d3-497f-b980-53964b162bee None admin] PATH_INFO: `/v3/groups` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:19.327465 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df45c8c-b0d3-497f-b980-53964b162bee None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:19.329308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df45c8c-b0d3-497f-b980-53964b162bee None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:19.348206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 165/327] 10.222.0.27 () {60 vars in 1134 bytes} [Tue Aug 30 11:44:19 2022] POST /identity/v3/groups => generated 226 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:44:19.396316 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:19.400020 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df45c8c-b0d3-497f-b980-53964b162bee None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:19.412773 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8a3bb-7374-4b85-8aaf-1aed4681c0dc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:19.449794 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65fd51-535e-42b5-9c0a-f5361f4f147d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:19.450401 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65fd51-535e-42b5-9c0a-f5361f4f147d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:19.450697 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65fd51-535e-42b5-9c0a-f5361f4f147d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:19.451077 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65fd51-535e-42b5-9c0a-f5361f4f147d None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:19.451936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65fd51-535e-42b5-9c0a-f5361f4f147d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:19.452123 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65fd51-535e-42b5-9c0a-f5361f4f147d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:19.453714 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65fd51-535e-42b5-9c0a-f5361f4f147d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:19.462717 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 163/328] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:44:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:19.468892 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65fd51-535e-42b5-9c0a-f5361f4f147d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:19.530815 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df45c8c-b0d3-497f-b980-53964b162bee None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:19.574508 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695c654-506f-4dac-a8e2-3a0a1b0c0f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:19.575438 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695c654-506f-4dac-a8e2-3a0a1b0c0f7b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:19.575721 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695c654-506f-4dac-a8e2-3a0a1b0c0f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:19.575991 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695c654-506f-4dac-a8e2-3a0a1b0c0f7b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:19.583999 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65fd51-535e-42b5-9c0a-f5361f4f147d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:19.591839 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695c654-506f-4dac-a8e2-3a0a1b0c0f7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:19.597599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-3695c654-506f-4dac-a8e2-3a0a1b0c0f7b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:19.597599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:19.597599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:19.597599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:19.597599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:19.597599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:19.597599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:19.597599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:19.597599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:19.597599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:19.597599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:19.597599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:19.597599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:19.597599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:19.597599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:19.597599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:19.598680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:19.598680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:19.598680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:19.598680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:19.598680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:19.598680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:19.598680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:19.598680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:19.598680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:19.598680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:19.598680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:19.598680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:19.598680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:19.598680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:19.598680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:19.598680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:19.599689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:19.599689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:19.599689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:19.599689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:19.599689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:19.599689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:19.599689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:19.599689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:19.599689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:19.599689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:19.599689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:19.599689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:19.606144 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 166/329] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:44:19.606144 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695c654-506f-4dac-a8e2-3a0a1b0c0f7b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:19.621690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:19.632112 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04200e0c-4cc8-45bd-b78f-17001e281432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:19.632769 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04200e0c-4cc8-45bd-b78f-17001e281432 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:19.633048 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04200e0c-4cc8-45bd-b78f-17001e281432 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:19.633322 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04200e0c-4cc8-45bd-b78f-17001e281432 None admin] PATH_INFO: `/v3/users/8cf9b5bf1ef442d69f71fe821811d9de` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:19.634492 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04200e0c-4cc8-45bd-b78f-17001e281432 None admin] RBAC: Authorizing `identity:get_user(user_id=8cf9b5bf1ef442d69f71fe821811d9de)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:19.636245 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04200e0c-4cc8-45bd-b78f-17001e281432 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:19.637802 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 164/330] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:44:19 2022] GET /identity/v3/users/8cf9b5bf1ef442d69f71fe821811d9de => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:19.644579 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04200e0c-4cc8-45bd-b78f-17001e281432 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:19.670113 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:19.751171 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695c654-506f-4dac-a8e2-3a0a1b0c0f7b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:19.775751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04200e0c-4cc8-45bd-b78f-17001e281432 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:19.801788 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a683447-782d-4e9b-942b-8c91ed365c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:19.802398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a683447-782d-4e9b-942b-8c91ed365c51 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:19.802691 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a683447-782d-4e9b-942b-8c91ed365c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:19.802953 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a683447-782d-4e9b-942b-8c91ed365c51 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:19.805009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a683447-782d-4e9b-942b-8c91ed365c51 None admin] RBAC: Adding query filter params (name=member) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:19.805009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a683447-782d-4e9b-942b-8c91ed365c51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:19.805383 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a683447-782d-4e9b-942b-8c91ed365c51 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:19.814771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 167/331] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:44:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:19.818555 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbd17d-b743-4df3-ad48-4f40dcbeada6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:19.819218 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbd17d-b743-4df3-ad48-4f40dcbeada6 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:19.819523 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbd17d-b743-4df3-ad48-4f40dcbeada6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:19.819862 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbd17d-b743-4df3-ad48-4f40dcbeada6 None admin] PATH_INFO: `/v3/system/users/8cf9b5bf1ef442d69f71fe821811d9de/roles/0c933d29c2794fad8da4b91509d53aba` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:19.821007 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a683447-782d-4e9b-942b-8c91ed365c51 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:19.821245 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbd17d-b743-4df3-ad48-4f40dcbeada6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8cf9b5bf1ef442d69f71fe821811d9de, role_id=0c933d29c2794fad8da4b91509d53aba)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:19.822621 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbd17d-b743-4df3-ad48-4f40dcbeada6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:19.835386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 165/332] 10.222.0.27 () {58 vars in 1334 bytes} [Tue Aug 30 11:44:19 2022] PUT /identity/v3/system/users/8cf9b5bf1ef442d69f71fe821811d9de/roles/0c933d29c2794fad8da4b91509d53aba => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:44:19.914869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:19.948604 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a683447-782d-4e9b-942b-8c91ed365c51 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:19.985785 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55556c-2000-4535-8d5c-07917ccf5230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:19.986448 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55556c-2000-4535-8d5c-07917ccf5230 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:19.986725 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55556c-2000-4535-8d5c-07917ccf5230 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:19.986991 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55556c-2000-4535-8d5c-07917ccf5230 None admin] PATH_INFO: `/v3/users/f49d4aecc0464d7a954796ffcef73645` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:19.988215 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55556c-2000-4535-8d5c-07917ccf5230 None admin] RBAC: Authorizing `identity:get_user(user_id=f49d4aecc0464d7a954796ffcef73645)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:19.989715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55556c-2000-4535-8d5c-07917ccf5230 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:19.991704 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 168/333] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:44:19 2022] GET /identity/v3/users/f49d4aecc0464d7a954796ffcef73645 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:19.997926 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbd17d-b743-4df3-ad48-4f40dcbeada6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:20.101333 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:20.121645 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbd17d-b743-4df3-ad48-4f40dcbeada6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:20.157520 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21594b9e-7121-4db5-98aa-64da87e19382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:20.158139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21594b9e-7121-4db5-98aa-64da87e19382 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:20.158413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21594b9e-7121-4db5-98aa-64da87e19382 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:20.158681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21594b9e-7121-4db5-98aa-64da87e19382 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:20.159428 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21594b9e-7121-4db5-98aa-64da87e19382 None admin] RBAC: Adding query filter params (role.id=7f855c6f817f4a64a1e635407de8bfb0, user.id=f49d4aecc0464d7a954796ffcef73645, scope.system=all) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:20.159738 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21594b9e-7121-4db5-98aa-64da87e19382 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:20.161200 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21594b9e-7121-4db5-98aa-64da87e19382 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:20.175793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 166/334] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Aug 30 11:44:19 2022] GET /identity/v3/role_assignments?user.id=f49d4aecc0464d7a954796ffcef73645&scope.system=all&role.id=7f855c6f817f4a64a1e635407de8bfb0 => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:21.682812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a32d0-0ada-44ed-ab40-caa1cb81b705 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:21.683752 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a32d0-0ada-44ed-ab40-caa1cb81b705 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:21.684202 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a32d0-0ada-44ed-ab40-caa1cb81b705 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:21.686024 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 169/335] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:21.703248 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e71e56-7b39-4eb1-b2e8-2d0ebafedb9d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:21.703974 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e71e56-7b39-4eb1-b2e8-2d0ebafedb9d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:21.703974 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e71e56-7b39-4eb1-b2e8-2d0ebafedb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:21.730502 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-37e71e56-7b39-4eb1-b2e8-2d0ebafedb9d None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:21.731749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-37e71e56-7b39-4eb1-b2e8-2d0ebafedb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:21.736147 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f7c07-82fc-4f2e-b981-efb0dec845fd None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:21.736724 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f7c07-82fc-4f2e-b981-efb0dec845fd None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:21.737196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f7c07-82fc-4f2e-b981-efb0dec845fd None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:21.738752 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 170/336] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:44:21.744488 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9a2d9-3637-4e14-84c0-9a3c69e6d650 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:21.745076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9a2d9-3637-4e14-84c0-9a3c69e6d650 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:21.745580 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9a2d9-3637-4e14-84c0-9a3c69e6d650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:21.772410 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-84b9a2d9-3637-4e14-84c0-9a3c69e6d650 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:21.773978 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-84b9a2d9-3637-4e14-84c0-9a3c69e6d650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:21.820294 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 167/337] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:44:21.860583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 171/338] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:44:22.383034 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e71e56-7b39-4eb1-b2e8-2d0ebafedb9d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:22.391911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9a2d9-3637-4e14-84c0-9a3c69e6d650 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:22.529661 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:22.540391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:22.583533 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9a2d9-3637-4e14-84c0-9a3c69e6d650 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:22.609564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e71e56-7b39-4eb1-b2e8-2d0ebafedb9d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:22.626951 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64fe4e-b57d-4354-bf82-815ed92f908c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:22.627860 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64fe4e-b57d-4354-bf82-815ed92f908c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:22.628299 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64fe4e-b57d-4354-bf82-815ed92f908c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:22.628699 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64fe4e-b57d-4354-bf82-815ed92f908c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:22.641654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64fe4e-b57d-4354-bf82-815ed92f908c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:22.647224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-bd64fe4e-b57d-4354-bf82-815ed92f908c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:44:22.647224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:22.647224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:22.647224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:22.647224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:22.647224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:22.647224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:22.647224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:22.647224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:22.647224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:22.647224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:22.647224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:22.647224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:22.647224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:22.647224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:22.647224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:22.648176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:22.648176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:22.648176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:22.648176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:22.648176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:22.648176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:22.648176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:22.648176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:22.648176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:22.648176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:22.648176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:22.648176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:22.648176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:22.648176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:22.648176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:22.648176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:22.648970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:22.648970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:22.648970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:22.648970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:22.648970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:22.648970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:22.648970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:22.648970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:22.648970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:22.648970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:22.648970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:44:22.648970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:22.649555 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b5bff-0a20-4768-9d06-b7ee2692fe0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:22.649555 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b5bff-0a20-4768-9d06-b7ee2692fe0b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:22.649555 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b5bff-0a20-4768-9d06-b7ee2692fe0b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:22.649555 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b5bff-0a20-4768-9d06-b7ee2692fe0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:22.651968 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 172/339] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Aug 30 11:44:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:22.653256 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096d27c-6fb7-4815-b6d7-8e1ad2917da1 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:22.653501 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096d27c-6fb7-4815-b6d7-8e1ad2917da1 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:22.654004 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096d27c-6fb7-4815-b6d7-8e1ad2917da1 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:22.655741 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 173/340] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:22.657563 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37993675-aa36-4d2a-9304-4018667cedf9 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:22.657984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37993675-aa36-4d2a-9304-4018667cedf9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:22.658386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37993675-aa36-4d2a-9304-4018667cedf9 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:22.659895 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 174/341] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:22.662361 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37993675-aa36-4d2a-9304-4018667cedf9 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:22.667491 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b5bff-0a20-4768-9d06-b7ee2692fe0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:22.674310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-389b5bff-0a20-4768-9d06-b7ee2692fe0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:22.674310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:22.674310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:22.674310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:22.674310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:22.674310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:22.674310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:22.674310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:22.674310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:22.674310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:22.674310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:22.674310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:22.674310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:22.674310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:22.674310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:22.674310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:22.675202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:22.675202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:22.675202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:22.675202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:22.675202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:22.675202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:22.675202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:22.675202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:22.675202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:22.675202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:22.675202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:22.675202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:22.675202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:22.675202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:22.675202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:22.675202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:22.676172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:22.676172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:22.676172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:22.676172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:22.676172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:22.676172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:22.676172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:22.676172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:22.676172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:22.676172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:22.676172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:22.676172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:22.676172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 168/342] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:22.678115 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb0285-3074-4a54-a627-d4fe88637a57 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:22.678461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb0285-3074-4a54-a627-d4fe88637a57 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:22.678749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb0285-3074-4a54-a627-d4fe88637a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:22.708279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-34bb0285-3074-4a54-a627-d4fe88637a57 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:22.709808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-34bb0285-3074-4a54-a627-d4fe88637a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:22.792587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37993675-aa36-4d2a-9304-4018667cedf9 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:22.803415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 169/343] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:22.805012 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ae532-393e-4a92-adea-3293c154a2d1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:22.805477 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ae532-393e-4a92-adea-3293c154a2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:22.805930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ae532-393e-4a92-adea-3293c154a2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:22.829139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-011ae532-393e-4a92-adea-3293c154a2d1 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:22.831638 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-011ae532-393e-4a92-adea-3293c154a2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:22.833042 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:22.840625 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b60af-2cda-48ca-ba5c-88a5080a5393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:22.841656 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b60af-2cda-48ca-ba5c-88a5080a5393 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:22.842151 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b60af-2cda-48ca-ba5c-88a5080a5393 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:22.842652 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b60af-2cda-48ca-ba5c-88a5080a5393 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:22.843543 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b60af-2cda-48ca-ba5c-88a5080a5393 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:22.844107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b60af-2cda-48ca-ba5c-88a5080a5393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:22.845708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b60af-2cda-48ca-ba5c-88a5080a5393 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:22.855170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 175/344] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:44:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:22.856321 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b60af-2cda-48ca-ba5c-88a5080a5393 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:22.911277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:22.927977 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 170/345] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:22.929128 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ae532-393e-4a92-adea-3293c154a2d1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:22.978271 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b60af-2cda-48ca-ba5c-88a5080a5393 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:23.014959 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4f12b-ee14-4b3a-b5e3-d463499a6b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:23.015599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4f12b-ee14-4b3a-b5e3-d463499a6b78 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:23.015916 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4f12b-ee14-4b3a-b5e3-d463499a6b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:23.017245 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4f12b-ee14-4b3a-b5e3-d463499a6b78 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:23.018092 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4f12b-ee14-4b3a-b5e3-d463499a6b78 None admin] RBAC: Adding query filter params (name=member) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:23.018402 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4f12b-ee14-4b3a-b5e3-d463499a6b78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:23.019833 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4f12b-ee14-4b3a-b5e3-d463499a6b78 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:23.039416 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 176/346] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:44:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:23.046218 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4f12b-ee14-4b3a-b5e3-d463499a6b78 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:23.164788 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:23.174921 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ae532-393e-4a92-adea-3293c154a2d1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:23.233993 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f44795-5360-4781-9903-065bec10c590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:23.235325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f44795-5360-4781-9903-065bec10c590 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:23.236271 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f44795-5360-4781-9903-065bec10c590 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:23.236907 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f44795-5360-4781-9903-065bec10c590 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:23.262143 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4f12b-ee14-4b3a-b5e3-d463499a6b78 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:23.337666 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745e57b-73a3-4ed5-a039-62f66c7445b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:23.338704 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745e57b-73a3-4ed5-a039-62f66c7445b3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:23.341294 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745e57b-73a3-4ed5-a039-62f66c7445b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:23.341796 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745e57b-73a3-4ed5-a039-62f66c7445b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:23.357052 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:23.374108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f44795-5360-4781-9903-065bec10c590 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:23.375764 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f44795-5360-4781-9903-065bec10c590 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:23.467662 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745e57b-73a3-4ed5-a039-62f66c7445b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:23.469177 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745e57b-73a3-4ed5-a039-62f66c7445b3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:23.504994 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 171/347] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:23.505988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f44795-5360-4781-9903-065bec10c590 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:23.534279 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:23.593719 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 177/348] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:23.594600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745e57b-73a3-4ed5-a039-62f66c7445b3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:23.616595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:23.626795 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f44795-5360-4781-9903-065bec10c590 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:23.669530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7c98f-def1-47e7-b266-c43c25db091e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:23.670177 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7c98f-def1-47e7-b266-c43c25db091e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:23.670454 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7c98f-def1-47e7-b266-c43c25db091e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:23.670730 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7c98f-def1-47e7-b266-c43c25db091e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:23.686612 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7c98f-def1-47e7-b266-c43c25db091e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:23.692391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-d1a7c98f-def1-47e7-b266-c43c25db091e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:44:23.692391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:23.692391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:23.692391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:23.692391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:23.692391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:23.692391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:23.692391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:23.692391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:23.692391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:23.692391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:23.692391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:23.692391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:23.692391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:23.692391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:23.692391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:23.693293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:23.693293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:23.693293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:23.693293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:23.693293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:23.693293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:23.693293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:23.693293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:23.693293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:23.693293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:23.693293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:23.693293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:23.693293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:23.693293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:23.693293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:23.693293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:23.694135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:23.694135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:23.694135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:23.694135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:23.694135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:23.694135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:23.694135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:23.694135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:23.694135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:23.694135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:23.694135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 11:44:23.694135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:23.694135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 172/349] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:23.694836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7c98f-def1-47e7-b266-c43c25db091e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:23.720734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745e57b-73a3-4ed5-a039-62f66c7445b3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:23.769991 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19783f10-43e2-4149-9322-f8cc565047b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:23.771147 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19783f10-43e2-4149-9322-f8cc565047b2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:23.771410 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19783f10-43e2-4149-9322-f8cc565047b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:23.771659 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19783f10-43e2-4149-9322-f8cc565047b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:23.784204 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19783f10-43e2-4149-9322-f8cc565047b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:23.789109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-19783f10-43e2-4149-9322-f8cc565047b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:23.789109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:23.789109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:23.789109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:23.789109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:23.789109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:23.789109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:23.789109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:23.789109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:23.789109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:23.789109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:23.789109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:23.789109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:23.789109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:23.789109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:23.789109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:23.789996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:23.789996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:23.789996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:23.789996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:23.789996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:23.789996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:23.789996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:23.789996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:23.789996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:23.789996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:23.789996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:23.789996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:23.789996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:23.789996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:23.789996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:23.789996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:23.790771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:23.790771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:23.790771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:23.790771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:23.790771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:23.790771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:23.790771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:23.790771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:23.790771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:23.790771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:23.790771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:23.790771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:23.790771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 178/350] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:23.791443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19783f10-43e2-4149-9322-f8cc565047b2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:23.811334 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:23.830622 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7c98f-def1-47e7-b266-c43c25db091e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:23.873252 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8c59b-fa93-4d24-8594-370de8af302b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:23.874203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8c59b-fa93-4d24-8594-370de8af302b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:23.874451 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8c59b-fa93-4d24-8594-370de8af302b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:23.874731 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8c59b-fa93-4d24-8594-370de8af302b None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:23.875995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8c59b-fa93-4d24-8594-370de8af302b None admin] RBAC: Authorizing `identity:get_project(project_id=1e107e4257e749cdbbc856b69ced1cc1)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:23.877762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8c59b-fa93-4d24-8594-370de8af302b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:23.880558 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 173/351] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:23 2022] GET /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:23.881771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63692b17-6481-4786-9a0d-d0b9d3efe45c None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:23.882794 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63692b17-6481-4786-9a0d-d0b9d3efe45c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:23.883087 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63692b17-6481-4786-9a0d-d0b9d3efe45c None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:23.884348 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 174/352] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:23.885049 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63692b17-6481-4786-9a0d-d0b9d3efe45c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:23.905562 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:23.925568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19783f10-43e2-4149-9322-f8cc565047b2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:23.963153 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599088e-535d-48bb-b9bf-2191779abacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:23.963836 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599088e-535d-48bb-b9bf-2191779abacf None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:23.964117 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599088e-535d-48bb-b9bf-2191779abacf None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:23.964392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599088e-535d-48bb-b9bf-2191779abacf None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:23.965928 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599088e-535d-48bb-b9bf-2191779abacf None admin] RBAC: Authorizing `identity:get_project(project_id=1e107e4257e749cdbbc856b69ced1cc1)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:23.967348 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599088e-535d-48bb-b9bf-2191779abacf None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:23.969107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 179/353] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:23 2022] GET /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:23.969921 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599088e-535d-48bb-b9bf-2191779abacf None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:24.006575 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63692b17-6481-4786-9a0d-d0b9d3efe45c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:24.044157 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a04d4f-7093-4816-86fd-c223b19a3853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:24.044779 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a04d4f-7093-4816-86fd-c223b19a3853 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:24.045055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a04d4f-7093-4816-86fd-c223b19a3853 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:24.045327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a04d4f-7093-4816-86fd-c223b19a3853 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:24.045986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a04d4f-7093-4816-86fd-c223b19a3853 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:24.046291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a04d4f-7093-4816-86fd-c223b19a3853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:24.049013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a04d4f-7093-4816-86fd-c223b19a3853 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:24.058705 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 175/354] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:44:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:24.059349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a04d4f-7093-4816-86fd-c223b19a3853 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:24.073615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:24.096661 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599088e-535d-48bb-b9bf-2191779abacf None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:24.143794 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74694d-fcff-4e54-88da-f13d9a6ac4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:24.144430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74694d-fcff-4e54-88da-f13d9a6ac4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:24.144967 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74694d-fcff-4e54-88da-f13d9a6ac4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:24.145243 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74694d-fcff-4e54-88da-f13d9a6ac4f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:24.146363 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74694d-fcff-4e54-88da-f13d9a6ac4f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:24.146817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74694d-fcff-4e54-88da-f13d9a6ac4f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:24.148457 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74694d-fcff-4e54-88da-f13d9a6ac4f8 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:24.161426 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 180/355] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:44:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:24.163829 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27d06d-b067-4561-b2ac-a1caaef285bd None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:24.164330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27d06d-b067-4561-b2ac-a1caaef285bd None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:24.164798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27d06d-b067-4561-b2ac-a1caaef285bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:24.173009 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:24.185566 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-0e27d06d-b067-4561-b2ac-a1caaef285bd None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:24.186797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0e27d06d-b067-4561-b2ac-a1caaef285bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:24.196053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a04d4f-7093-4816-86fd-c223b19a3853 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:24.243118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f846f7-2612-4e2f-9205-fe3a325de180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:24.243902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f846f7-2612-4e2f-9205-fe3a325de180 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:24.244071 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f846f7-2612-4e2f-9205-fe3a325de180 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:24.244343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f846f7-2612-4e2f-9205-fe3a325de180 None admin] PATH_INFO: `/v3/groups/16c409d9c97447df9384d7478dd2e048` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:24.251508 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f846f7-2612-4e2f-9205-fe3a325de180 None admin] RBAC: Authorizing `identity:get_group(group_id=16c409d9c97447df9384d7478dd2e048)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:24.253231 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f846f7-2612-4e2f-9205-fe3a325de180 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:24.259483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 176/356] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Aug 30 11:44:24 2022] GET /identity/v3/groups/16c409d9c97447df9384d7478dd2e048 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:24.259483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f846f7-2612-4e2f-9205-fe3a325de180 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:24.279816 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 181/357] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:24.280677 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27d06d-b067-4561-b2ac-a1caaef285bd None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:24.367477 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:24.383164 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f846f7-2612-4e2f-9205-fe3a325de180 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:24.399159 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27d06d-b067-4561-b2ac-a1caaef285bd None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:24.420180 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c22490-dbbb-49fb-94ea-3da172abad9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:24.420180 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c22490-dbbb-49fb-94ea-3da172abad9f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:24.420706 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c22490-dbbb-49fb-94ea-3da172abad9f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:24.420801 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c22490-dbbb-49fb-94ea-3da172abad9f None admin] PATH_INFO: `/v3/groups/16c409d9c97447df9384d7478dd2e048` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:24.424403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c22490-dbbb-49fb-94ea-3da172abad9f None admin] RBAC: Authorizing `identity:get_group(group_id=16c409d9c97447df9384d7478dd2e048)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:24.425888 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c22490-dbbb-49fb-94ea-3da172abad9f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:24.427563 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 177/358] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Aug 30 11:44:24 2022] GET /identity/v3/groups/16c409d9c97447df9384d7478dd2e048 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:24.428375 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c22490-dbbb-49fb-94ea-3da172abad9f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:24.440288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57020808-565d-49d2-920f-539261a98f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:24.441731 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57020808-565d-49d2-920f-539261a98f88 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:24.442605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57020808-565d-49d2-920f-539261a98f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:24.442889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57020808-565d-49d2-920f-539261a98f88 None admin] PATH_INFO: `/v3/users/8cf9b5bf1ef442d69f71fe821811d9de` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:24.444070 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57020808-565d-49d2-920f-539261a98f88 None admin] RBAC: Authorizing `identity:get_user(user_id=8cf9b5bf1ef442d69f71fe821811d9de)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:24.445258 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:24.445524 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57020808-565d-49d2-920f-539261a98f88 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:24.447259 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 182/359] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:44:24 2022] GET /identity/v3/users/8cf9b5bf1ef442d69f71fe821811d9de => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:24.450737 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a762cb-7559-4c22-b2a1-de5d90d600be None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:24.450737 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a762cb-7559-4c22-b2a1-de5d90d600be None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:24.450737 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a762cb-7559-4c22-b2a1-de5d90d600be None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:24.450737 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 183/360] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:24.454536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a762cb-7559-4c22-b2a1-de5d90d600be None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:24.574440 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c22490-dbbb-49fb-94ea-3da172abad9f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:24.581778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a762cb-7559-4c22-b2a1-de5d90d600be None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:24.618114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5f8ee-3a30-4caf-bdd3-110283d42204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:24.618114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5f8ee-3a30-4caf-bdd3-110283d42204 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:24.618407 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5f8ee-3a30-4caf-bdd3-110283d42204 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:24.618706 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5f8ee-3a30-4caf-bdd3-110283d42204 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:24.622029 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf90229-817f-4b47-9433-045b9773e15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:24.622880 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf90229-817f-4b47-9433-045b9773e15a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:24.623390 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf90229-817f-4b47-9433-045b9773e15a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:24.623665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf90229-817f-4b47-9433-045b9773e15a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:24.624402 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf90229-817f-4b47-9433-045b9773e15a None admin] RBAC: Adding query filter params (group.id=16c409d9c97447df9384d7478dd2e048, role.id=30c5b9fbbb564c6dafe66f759683738b, scope.project.id=1e107e4257e749cdbbc856b69ced1cc1) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:24.624708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf90229-817f-4b47-9433-045b9773e15a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:24.626539 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf90229-817f-4b47-9433-045b9773e15a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:24.632360 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 184/361] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Aug 30 11:44:24 2022] GET /identity/v3/role_assignments?group.id=16c409d9c97447df9384d7478dd2e048&scope.project.id=1e107e4257e749cdbbc856b69ced1cc1&role.id=30c5b9fbbb564c6dafe66f759683738b => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:24.633146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf90229-817f-4b47-9433-045b9773e15a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:24.653908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:24.718810 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5f8ee-3a30-4caf-bdd3-110283d42204 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:24.720440 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5f8ee-3a30-4caf-bdd3-110283d42204 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:24.745330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:24.804876 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf90229-817f-4b47-9433-045b9773e15a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:24.847482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd99ae-da19-4780-994f-db35a698c3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:24.848157 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd99ae-da19-4780-994f-db35a698c3af None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:24.848390 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd99ae-da19-4780-994f-db35a698c3af None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:24.848655 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd99ae-da19-4780-994f-db35a698c3af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:24.849379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd99ae-da19-4780-994f-db35a698c3af None admin] RBAC: Adding query filter params (group.id=16c409d9c97447df9384d7478dd2e048, role.id=7f855c6f817f4a64a1e635407de8bfb0, scope.project.id=1e107e4257e749cdbbc856b69ced1cc1) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:24.849797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd99ae-da19-4780-994f-db35a698c3af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:24.851396 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd99ae-da19-4780-994f-db35a698c3af None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:24.858376 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 185/362] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Aug 30 11:44:24 2022] GET /identity/v3/role_assignments?group.id=16c409d9c97447df9384d7478dd2e048&scope.project.id=1e107e4257e749cdbbc856b69ced1cc1&role.id=7f855c6f817f4a64a1e635407de8bfb0 => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:24.859154 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd99ae-da19-4780-994f-db35a698c3af None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:24.863519 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 178/363] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:24.863519 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea30e4e-27bb-4ef9-bc31-0dd116815858 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:24.863519 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea30e4e-27bb-4ef9-bc31-0dd116815858 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:24.863519 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea30e4e-27bb-4ef9-bc31-0dd116815858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:24.891130 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6ea30e4e-27bb-4ef9-bc31-0dd116815858 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:24.892532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6ea30e4e-27bb-4ef9-bc31-0dd116815858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:24.966073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:24.981635 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 179/364] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:24.982626 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea30e4e-27bb-4ef9-bc31-0dd116815858 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:25.012275 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd99ae-da19-4780-994f-db35a698c3af None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:25.059617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ed206-2430-48da-9b45-a2118f08731e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:25.059850 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:25.060241 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ed206-2430-48da-9b45-a2118f08731e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:25.060515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ed206-2430-48da-9b45-a2118f08731e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:25.060786 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ed206-2430-48da-9b45-a2118f08731e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:25.061519 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ed206-2430-48da-9b45-a2118f08731e None admin] RBAC: Adding query filter params (role.id=0c933d29c2794fad8da4b91509d53aba, user.id=8cf9b5bf1ef442d69f71fe821811d9de, scope.system=all) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:25.061811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ed206-2430-48da-9b45-a2118f08731e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:25.064062 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ed206-2430-48da-9b45-a2118f08731e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:25.080736 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 186/365] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Aug 30 11:44:24 2022] GET /identity/v3/role_assignments?user.id=8cf9b5bf1ef442d69f71fe821811d9de&scope.system=all&role.id=0c933d29c2794fad8da4b91509d53aba => generated 510 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:25.081724 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ed206-2430-48da-9b45-a2118f08731e None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:25.199234 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea30e4e-27bb-4ef9-bc31-0dd116815858 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:25.270132 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ed206-2430-48da-9b45-a2118f08731e None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:25.287842 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c9977-63d0-4fae-87e6-b60132527a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:25.288511 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c9977-63d0-4fae-87e6-b60132527a5c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:25.288790 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c9977-63d0-4fae-87e6-b60132527a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:25.289050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c9977-63d0-4fae-87e6-b60132527a5c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:25.307903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c9977-63d0-4fae-87e6-b60132527a5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:25.314740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-747c9977-63d0-4fae-87e6-b60132527a5c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:44:25.314740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:25.314740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:25.314740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:25.314740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:25.314740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:25.314740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:25.314740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:25.314740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:25.314740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:25.314740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:25.314740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:25.314740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:25.314740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:25.314740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:25.314740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:25.315681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:25.315681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:25.315681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:25.315681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:25.315681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:25.315681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:25.315681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:25.315681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:25.315681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:25.315681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:25.315681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:25.315681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:25.315681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:25.315681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:25.315681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:25.315681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:25.316471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:25.316471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:25.316471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:25.316471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:25.316471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:25.316471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:25.316471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:25.316471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:25.316471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:25.316471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:25.316471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:44:25.316471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:25.316471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 180/366] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Aug 30 11:44:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:25.322827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c9977-63d0-4fae-87e6-b60132527a5c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:25.328750 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:25.346386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac08015-d07e-48ad-a767-a298fbd68c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:25.347045 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac08015-d07e-48ad-a767-a298fbd68c2a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:25.347322 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac08015-d07e-48ad-a767-a298fbd68c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:25.347646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac08015-d07e-48ad-a767-a298fbd68c2a None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:25.348818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac08015-d07e-48ad-a767-a298fbd68c2a None admin] RBAC: Authorizing `identity:get_project(project_id=f6e02d64fae241a7912706aa95544b4c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:25.350290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac08015-d07e-48ad-a767-a298fbd68c2a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:25.353855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 187/367] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:25 2022] GET /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:25.360378 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac08015-d07e-48ad-a767-a298fbd68c2a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:25.509249 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c9977-63d0-4fae-87e6-b60132527a5c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:25.511447 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:25.538915 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac08015-d07e-48ad-a767-a298fbd68c2a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:25.552917 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f2e7a-11b6-474e-aee1-4f4c87aba098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:25.553543 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f2e7a-11b6-474e-aee1-4f4c87aba098 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:25.553818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f2e7a-11b6-474e-aee1-4f4c87aba098 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:25.554088 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f2e7a-11b6-474e-aee1-4f4c87aba098 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:25.555167 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f2e7a-11b6-474e-aee1-4f4c87aba098 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:25.555620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f2e7a-11b6-474e-aee1-4f4c87aba098 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:25.557381 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f2e7a-11b6-474e-aee1-4f4c87aba098 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:25.575557 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 181/368] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:44:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:25.576909 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f2e7a-11b6-474e-aee1-4f4c87aba098 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:25.597372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84290eee-0857-454a-a295-ed2855cd9a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:25.598318 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84290eee-0857-454a-a295-ed2855cd9a9b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:25.598734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84290eee-0857-454a-a295-ed2855cd9a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:25.599205 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84290eee-0857-454a-a295-ed2855cd9a9b None admin] PATH_INFO: `/v3/groups/16c409d9c97447df9384d7478dd2e048` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:25.601029 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84290eee-0857-454a-a295-ed2855cd9a9b None admin] RBAC: Authorizing `identity:get_group(group_id=16c409d9c97447df9384d7478dd2e048)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:25.602832 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84290eee-0857-454a-a295-ed2855cd9a9b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:25.605240 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 188/369] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Aug 30 11:44:25 2022] GET /identity/v3/groups/16c409d9c97447df9384d7478dd2e048 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:25.606176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84290eee-0857-454a-a295-ed2855cd9a9b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:25.679863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:25.699883 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f2e7a-11b6-474e-aee1-4f4c87aba098 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:25.723657 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84290eee-0857-454a-a295-ed2855cd9a9b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:25.737815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece79463-b299-4f43-a8c2-9ba545ec0e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:25.738460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece79463-b299-4f43-a8c2-9ba545ec0e2b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:25.738746 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece79463-b299-4f43-a8c2-9ba545ec0e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:25.739015 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece79463-b299-4f43-a8c2-9ba545ec0e2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:25.749760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece79463-b299-4f43-a8c2-9ba545ec0e2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:25.755239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ece79463-b299-4f43-a8c2-9ba545ec0e2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:44:25.755239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:25.755239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:25.755239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:25.755239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:25.755239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:25.755239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:25.755239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:25.755239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:25.755239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:25.755239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:25.755239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:25.755239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:25.755239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:25.755239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:25.755239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:25.756320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:25.756320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:25.756320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:25.756320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:25.756320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:25.756320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:25.756320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:25.756320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:25.756320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:25.756320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:25.756320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:25.756320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:25.756320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:25.756320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:25.756320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:25.756320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:25.761768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:25.761768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:25.761768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:25.761768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:25.761768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:25.761768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:25.761768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:25.761768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:25.761768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:25.761768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:25.761768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:44:25.761768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:25.761768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 182/370] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:44:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:25.761768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece79463-b299-4f43-a8c2-9ba545ec0e2b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:25.770494 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2295a41-3c55-4878-894e-25dbbea9f0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:25.771478 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2295a41-3c55-4878-894e-25dbbea9f0c3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:25.771888 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2295a41-3c55-4878-894e-25dbbea9f0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:25.772357 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2295a41-3c55-4878-894e-25dbbea9f0c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:25.789293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:25.848542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2295a41-3c55-4878-894e-25dbbea9f0c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:25.850688 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2295a41-3c55-4878-894e-25dbbea9f0c3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:25.868189 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece79463-b299-4f43-a8c2-9ba545ec0e2b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:25.902829 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5ff55-5e0c-469d-8e2f-7b8fafaab6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:25.903744 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5ff55-5e0c-469d-8e2f-7b8fafaab6da None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:25.903744 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5ff55-5e0c-469d-8e2f-7b8fafaab6da None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:25.904024 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5ff55-5e0c-469d-8e2f-7b8fafaab6da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:25.904978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5ff55-5e0c-469d-8e2f-7b8fafaab6da None admin] RBAC: Adding query filter params (group.id=16c409d9c97447df9384d7478dd2e048, role.id=7f855c6f817f4a64a1e635407de8bfb0, scope.project.id=f6e02d64fae241a7912706aa95544b4c) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:25.905295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5ff55-5e0c-469d-8e2f-7b8fafaab6da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:25.906825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5ff55-5e0c-469d-8e2f-7b8fafaab6da None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:25.912789 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 183/371] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Aug 30 11:44:25 2022] GET /identity/v3/role_assignments?group.id=16c409d9c97447df9384d7478dd2e048&scope.project.id=f6e02d64fae241a7912706aa95544b4c&role.id=7f855c6f817f4a64a1e635407de8bfb0 => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:25.913606 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5ff55-5e0c-469d-8e2f-7b8fafaab6da None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:25.919732 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:25.970912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 189/372] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:25.974833 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2295a41-3c55-4878-894e-25dbbea9f0c3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:26.040864 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:26.056327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5ff55-5e0c-469d-8e2f-7b8fafaab6da None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:26.091630 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2295a41-3c55-4878-894e-25dbbea9f0c3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:26.098545 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45ce4e-11ef-44f0-9bad-a5b226c2cf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:26.099180 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45ce4e-11ef-44f0-9bad-a5b226c2cf28 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:26.099496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45ce4e-11ef-44f0-9bad-a5b226c2cf28 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:26.099771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45ce4e-11ef-44f0-9bad-a5b226c2cf28 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:26.100440 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45ce4e-11ef-44f0-9bad-a5b226c2cf28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:26.100745 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45ce4e-11ef-44f0-9bad-a5b226c2cf28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:26.102131 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45ce4e-11ef-44f0-9bad-a5b226c2cf28 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:26.115410 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 184/373] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:26.136545 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45ce4e-11ef-44f0-9bad-a5b226c2cf28 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:26.140114 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f30a1-683d-42ff-8cb3-609f5fbfe5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:26.141138 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f30a1-683d-42ff-8cb3-609f5fbfe5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:26.141554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f30a1-683d-42ff-8cb3-609f5fbfe5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:26.142084 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f30a1-683d-42ff-8cb3-609f5fbfe5d3 None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:26.143382 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f30a1-683d-42ff-8cb3-609f5fbfe5d3 None admin] RBAC: Authorizing `identity:get_project(project_id=f6e02d64fae241a7912706aa95544b4c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:26.145984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f30a1-683d-42ff-8cb3-609f5fbfe5d3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:26.151248 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 190/374] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:25 2022] GET /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:26.154964 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f30a1-683d-42ff-8cb3-609f5fbfe5d3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:26.191201 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:26.257739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45ce4e-11ef-44f0-9bad-a5b226c2cf28 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:26.271540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f30a1-683d-42ff-8cb3-609f5fbfe5d3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:26.297912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b9337-fc61-457a-b7dd-09a5e7e3aba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:26.298472 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b9337-fc61-457a-b7dd-09a5e7e3aba1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:26.298752 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b9337-fc61-457a-b7dd-09a5e7e3aba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:26.299022 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b9337-fc61-457a-b7dd-09a5e7e3aba1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:26.313352 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02373b-77ba-4f46-a25c-3c29cbbfb9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:26.314433 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02373b-77ba-4f46-a25c-3c29cbbfb9df None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:26.314897 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02373b-77ba-4f46-a25c-3c29cbbfb9df None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:26.315435 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02373b-77ba-4f46-a25c-3c29cbbfb9df None admin] PATH_INFO: `/v3/groups/16c409d9c97447df9384d7478dd2e048` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:26.316770 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02373b-77ba-4f46-a25c-3c29cbbfb9df None admin] RBAC: Authorizing `identity:get_group(group_id=16c409d9c97447df9384d7478dd2e048)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:26.318583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02373b-77ba-4f46-a25c-3c29cbbfb9df None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:26.322256 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 191/375] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Aug 30 11:44:26 2022] GET /identity/v3/groups/16c409d9c97447df9384d7478dd2e048 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:26.325079 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:26.328193 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02373b-77ba-4f46-a25c-3c29cbbfb9df None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:26.377056 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b9337-fc61-457a-b7dd-09a5e7e3aba1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:26.378541 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b9337-fc61-457a-b7dd-09a5e7e3aba1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:26.435046 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:26.438512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02373b-77ba-4f46-a25c-3c29cbbfb9df None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:26.480679 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00685d0d-f8d3-4d67-835d-f5cf3e907217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:26.481822 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00685d0d-f8d3-4d67-835d-f5cf3e907217 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:26.482289 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00685d0d-f8d3-4d67-835d-f5cf3e907217 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:26.482744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00685d0d-f8d3-4d67-835d-f5cf3e907217 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:26.483763 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00685d0d-f8d3-4d67-835d-f5cf3e907217 None admin] RBAC: Adding query filter params (group.id=16c409d9c97447df9384d7478dd2e048, role.id=30c5b9fbbb564c6dafe66f759683738b, scope.project.id=f6e02d64fae241a7912706aa95544b4c) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:26.484368 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00685d0d-f8d3-4d67-835d-f5cf3e907217 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:26.486144 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00685d0d-f8d3-4d67-835d-f5cf3e907217 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:26.492346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 185/376] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:26.496070 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 192/377] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Aug 30 11:44:26 2022] GET /identity/v3/role_assignments?group.id=16c409d9c97447df9384d7478dd2e048&scope.project.id=f6e02d64fae241a7912706aa95544b4c&role.id=30c5b9fbbb564c6dafe66f759683738b => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:26.501367 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b9337-fc61-457a-b7dd-09a5e7e3aba1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:26.577043 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:26.642526 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b9337-fc61-457a-b7dd-09a5e7e3aba1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:26.688653 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512807a-3a0c-4cc1-ad2b-d888c92cf233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:26.689303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512807a-3a0c-4cc1-ad2b-d888c92cf233 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:26.689577 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512807a-3a0c-4cc1-ad2b-d888c92cf233 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:26.689844 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512807a-3a0c-4cc1-ad2b-d888c92cf233 None admin] PATH_INFO: `/v3/projects/801a00d9234a4360978c5c3ff97e0dc2` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:26.690990 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512807a-3a0c-4cc1-ad2b-d888c92cf233 None admin] RBAC: Authorizing `identity:get_project(project_id=801a00d9234a4360978c5c3ff97e0dc2)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:26.692491 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512807a-3a0c-4cc1-ad2b-d888c92cf233 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:26.694434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 186/378] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:26 2022] GET /identity/v3/projects/801a00d9234a4360978c5c3ff97e0dc2 => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:26.700028 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00685d0d-f8d3-4d67-835d-f5cf3e907217 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:26.829725 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00685d0d-f8d3-4d67-835d-f5cf3e907217 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:26.874389 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d7821-6249-4b5b-95e5-1d74574e70ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:26.875169 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d7821-6249-4b5b-95e5-1d74574e70ce None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:26.875411 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d7821-6249-4b5b-95e5-1d74574e70ce None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:26.875690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d7821-6249-4b5b-95e5-1d74574e70ce None admin] PATH_INFO: `/v3/groups/182f33b3142d4d529c1a8873b7c8b425` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:26.882233 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d7821-6249-4b5b-95e5-1d74574e70ce None admin] RBAC: Authorizing `identity:get_group(group_id=182f33b3142d4d529c1a8873b7c8b425)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:26.883734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d7821-6249-4b5b-95e5-1d74574e70ce None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:26.885757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 193/379] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Aug 30 11:44:26 2022] GET /identity/v3/groups/182f33b3142d4d529c1a8873b7c8b425 => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:26.891667 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512807a-3a0c-4cc1-ad2b-d888c92cf233 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:27.043950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512807a-3a0c-4cc1-ad2b-d888c92cf233 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:27.061921 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:27.083974 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab99cc-448f-4c22-a470-608ba8ccae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:27.084512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab99cc-448f-4c22-a470-608ba8ccae37 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:27.084791 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab99cc-448f-4c22-a470-608ba8ccae37 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:27.085059 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab99cc-448f-4c22-a470-608ba8ccae37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:27.085791 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab99cc-448f-4c22-a470-608ba8ccae37 None admin] RBAC: Adding query filter params (group.id=182f33b3142d4d529c1a8873b7c8b425, role.id=4f4d8a6881ca496bb2d4845a6592fea8, scope.project.id=801a00d9234a4360978c5c3ff97e0dc2) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:27.086097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab99cc-448f-4c22-a470-608ba8ccae37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:27.087564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab99cc-448f-4c22-a470-608ba8ccae37 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:27.097156 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 187/380] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Aug 30 11:44:26 2022] GET /identity/v3/role_assignments?group.id=182f33b3142d4d529c1a8873b7c8b425&scope.project.id=801a00d9234a4360978c5c3ff97e0dc2&role.id=4f4d8a6881ca496bb2d4845a6592fea8 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:27.127976 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663b288-0f41-4ce3-b8d4-cdc5828e072a None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:27.128296 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663b288-0f41-4ce3-b8d4-cdc5828e072a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:27.128520 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663b288-0f41-4ce3-b8d4-cdc5828e072a None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:27.129885 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 194/381] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:27.135660 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c0dd7-4abc-41a5-9727-c03a8e9ac4e3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:27.135959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c0dd7-4abc-41a5-9727-c03a8e9ac4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:27.136216 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c0dd7-4abc-41a5-9727-c03a8e9ac4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:27.159343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ab5c0dd7-4abc-41a5-9727-c03a8e9ac4e3 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:27.160609 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ab5c0dd7-4abc-41a5-9727-c03a8e9ac4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:27.244268 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 188/382] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:27.445096 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab880ef8-a359-437f-82f1-68e87056e11f None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:27.445444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab880ef8-a359-437f-82f1-68e87056e11f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:27.445611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab880ef8-a359-437f-82f1-68e87056e11f None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:27.446909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 195/383] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:44:27.463393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd3fa6-f651-44e2-9373-6d036c7f1cb6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:27.463393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd3fa6-f651-44e2-9373-6d036c7f1cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:27.463393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd3fa6-f651-44e2-9373-6d036c7f1cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:27.485646 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-dbcd3fa6-f651-44e2-9373-6d036c7f1cb6 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:27.487166 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dbcd3fa6-f651-44e2-9373-6d036c7f1cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:27.564905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 189/384] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:27.586506 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab880ef8-a359-437f-82f1-68e87056e11f None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:27.617013 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:27.702304 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab880ef8-a359-437f-82f1-68e87056e11f None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:27.737705 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a9faa-bb75-4293-b7e8-c9e62516dd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:27.738340 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a9faa-bb75-4293-b7e8-c9e62516dd49 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:27.738618 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a9faa-bb75-4293-b7e8-c9e62516dd49 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:27.738885 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a9faa-bb75-4293-b7e8-c9e62516dd49 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:27.753028 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a9faa-bb75-4293-b7e8-c9e62516dd49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:27.757914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-7e6a9faa-bb75-4293-b7e8-c9e62516dd49 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:44:27.757914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:27.757914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:27.757914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:27.757914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:27.757914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:27.757914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:27.757914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:27.757914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:27.757914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:27.757914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:27.757914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:27.757914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:27.757914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:27.757914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:27.757914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:27.758768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:27.758768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:27.758768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:27.758768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:27.758768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:27.758768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:27.758768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:27.758768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:27.758768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:27.758768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:27.758768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:27.758768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:27.758768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:27.758768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:27.758768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:27.758768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:27.759578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:27.759578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:27.759578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:27.759578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:27.759578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:27.759578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:27.759578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:27.759578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:27.759578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:27.759578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:27.759578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:44:27.759578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:27.759578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 196/385] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Aug 30 11:44:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:27.766728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd3fa6-f651-44e2-9373-6d036c7f1cb6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:27.836090 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:27.905873 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd3fa6-f651-44e2-9373-6d036c7f1cb6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:27.909576 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a9faa-bb75-4293-b7e8-c9e62516dd49 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:27.961059 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d48a1-3020-4fa4-8e61-f3e787abf10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:27.962259 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d48a1-3020-4fa4-8e61-f3e787abf10f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:27.966136 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d48a1-3020-4fa4-8e61-f3e787abf10f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:27.966614 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d48a1-3020-4fa4-8e61-f3e787abf10f None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:27.967509 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d48a1-3020-4fa4-8e61-f3e787abf10f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:27.968006 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d48a1-3020-4fa4-8e61-f3e787abf10f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:27.971177 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d48a1-3020-4fa4-8e61-f3e787abf10f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:27.985275 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 190/386] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:44:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:27.990818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d48a1-3020-4fa4-8e61-f3e787abf10f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:28.073205 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:28.100574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a9faa-bb75-4293-b7e8-c9e62516dd49 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:28.187804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad342f2-be17-4393-9b71-3f9c0efe471c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:28.188738 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad342f2-be17-4393-9b71-3f9c0efe471c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:28.189024 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad342f2-be17-4393-9b71-3f9c0efe471c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:28.189500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad342f2-be17-4393-9b71-3f9c0efe471c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:28.222632 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d48a1-3020-4fa4-8e61-f3e787abf10f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:28.224914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad342f2-be17-4393-9b71-3f9c0efe471c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:28.232089 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:28.241108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-3ad342f2-be17-4393-9b71-3f9c0efe471c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:28.241108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:28.241108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:28.241108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:28.241108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:28.241108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:28.241108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:28.241108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:28.241108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:28.241108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:28.241108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:28.241108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:28.241108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:28.241108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:28.241108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:28.241108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:28.242036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:28.242036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:28.242036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:28.242036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:28.242036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:28.242036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:28.242036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:28.242036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:28.242036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:28.242036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:28.242036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:28.242036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:28.242036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:28.242036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:28.242036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:28.242036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:28.242836 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:28.242836 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:28.242836 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:28.242836 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:28.242836 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:28.242836 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:28.242836 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:28.242836 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:28.242836 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:28.242836 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:28.242836 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:28.242836 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:28.245667 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 197/387] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:28.251865 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad342f2-be17-4393-9b71-3f9c0efe471c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:28.295561 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66a91a-06ad-4a95-a48f-465bf4e461b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:28.296215 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66a91a-06ad-4a95-a48f-465bf4e461b9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:28.296499 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66a91a-06ad-4a95-a48f-465bf4e461b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:28.296772 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66a91a-06ad-4a95-a48f-465bf4e461b9 None admin] PATH_INFO: `/v3/groups/16c409d9c97447df9384d7478dd2e048` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:28.299710 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66a91a-06ad-4a95-a48f-465bf4e461b9 None admin] RBAC: Authorizing `identity:get_group(group_id=16c409d9c97447df9384d7478dd2e048)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:28.301220 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66a91a-06ad-4a95-a48f-465bf4e461b9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:28.303764 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 191/388] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Aug 30 11:44:27 2022] GET /identity/v3/groups/16c409d9c97447df9384d7478dd2e048 => generated 226 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:28.309250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66a91a-06ad-4a95-a48f-465bf4e461b9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:28.421491 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad342f2-be17-4393-9b71-3f9c0efe471c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:28.457563 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66a91a-06ad-4a95-a48f-465bf4e461b9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:28.480706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142aead-d1b2-4455-a3fb-1c513022c8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:28.481258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142aead-d1b2-4455-a3fb-1c513022c8ed None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:28.481541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142aead-d1b2-4455-a3fb-1c513022c8ed None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:28.481820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142aead-d1b2-4455-a3fb-1c513022c8ed None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:28.482492 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142aead-d1b2-4455-a3fb-1c513022c8ed None admin] RBAC: Adding query filter params (name=member) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:28.482801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142aead-d1b2-4455-a3fb-1c513022c8ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:28.484291 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142aead-d1b2-4455-a3fb-1c513022c8ed None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:28.499236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196df44-700e-4bd6-a015-5c2e5a48fdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:28.499904 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196df44-700e-4bd6-a015-5c2e5a48fdfa None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:28.501133 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196df44-700e-4bd6-a015-5c2e5a48fdfa None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:28.501418 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196df44-700e-4bd6-a015-5c2e5a48fdfa None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:28.502570 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196df44-700e-4bd6-a015-5c2e5a48fdfa None admin] RBAC: Authorizing `identity:get_project(project_id=1e107e4257e749cdbbc856b69ced1cc1)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:28.504054 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196df44-700e-4bd6-a015-5c2e5a48fdfa None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:28.506040 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 192/389] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:28 2022] GET /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:28.511250 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 198/390] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:44:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:28.512186 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196df44-700e-4bd6-a015-5c2e5a48fdfa None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:28.520186 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142aead-d1b2-4455-a3fb-1c513022c8ed None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:28.550208 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:28.560243 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:28.628511 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196df44-700e-4bd6-a015-5c2e5a48fdfa None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:28.674820 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6cc24-db3d-43e6-8f1e-cb0bb7aa9eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:28.675782 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6cc24-db3d-43e6-8f1e-cb0bb7aa9eab None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:28.676066 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6cc24-db3d-43e6-8f1e-cb0bb7aa9eab None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:28.676336 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6cc24-db3d-43e6-8f1e-cb0bb7aa9eab None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1/groups/16c409d9c97447df9384d7478dd2e048/roles/30c5b9fbbb564c6dafe66f759683738b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:28.679453 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6cc24-db3d-43e6-8f1e-cb0bb7aa9eab None admin] RBAC: Authorizing `identity:create_grant(project_id=1e107e4257e749cdbbc856b69ced1cc1, group_id=16c409d9c97447df9384d7478dd2e048, role_id=30c5b9fbbb564c6dafe66f759683738b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:28.680932 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6cc24-db3d-43e6-8f1e-cb0bb7aa9eab None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:28.681063 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142aead-d1b2-4455-a3fb-1c513022c8ed None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:28.701270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 193/391] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Aug 30 11:44:28 2022] PUT /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1/groups/16c409d9c97447df9384d7478dd2e048/roles/30c5b9fbbb564c6dafe66f759683738b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:44:28.705276 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed5586-038f-477c-b698-d29c196ec40b None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:28.705566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed5586-038f-477c-b698-d29c196ec40b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:28.705896 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed5586-038f-477c-b698-d29c196ec40b None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:28.709112 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 194/392] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:28.725793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb9c56-66b2-4b98-903c-c80bca765c25 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:28.726111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb9c56-66b2-4b98-903c-c80bca765c25 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:28.726341 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb9c56-66b2-4b98-903c-c80bca765c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:28.749171 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a3681-95eb-4db2-b36a-48c10662fe64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:28.749749 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a3681-95eb-4db2-b36a-48c10662fe64 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:28.750032 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a3681-95eb-4db2-b36a-48c10662fe64 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:28.750457 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a3681-95eb-4db2-b36a-48c10662fe64 None admin] PATH_INFO: `/v3/groups/16c409d9c97447df9384d7478dd2e048` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:28.755805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a3681-95eb-4db2-b36a-48c10662fe64 None admin] RBAC: Authorizing `identity:get_group(group_id=16c409d9c97447df9384d7478dd2e048)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:28.757512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a3681-95eb-4db2-b36a-48c10662fe64 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:28.759682 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-dceb9c56-66b2-4b98-903c-c80bca765c25 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:28.761865 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 199/393] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Aug 30 11:44:28 2022] GET /identity/v3/groups/16c409d9c97447df9384d7478dd2e048 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:28.762070 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dceb9c56-66b2-4b98-903c-c80bca765c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:28.767724 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a3681-95eb-4db2-b36a-48c10662fe64 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:28.873035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 195/394] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:44:28.944260 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:28.991221 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a3681-95eb-4db2-b36a-48c10662fe64 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:29.031214 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b317e-c71e-4e02-9959-cce768ec3a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:29.032247 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b317e-c71e-4e02-9959-cce768ec3a02 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:29.032755 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b317e-c71e-4e02-9959-cce768ec3a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:29.033264 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b317e-c71e-4e02-9959-cce768ec3a02 None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:29.034630 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b317e-c71e-4e02-9959-cce768ec3a02 None admin] RBAC: Authorizing `identity:get_project(project_id=1e107e4257e749cdbbc856b69ced1cc1)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:29.036340 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b317e-c71e-4e02-9959-cce768ec3a02 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:29.038194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 200/395] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:28 2022] GET /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:29.044135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb9c56-66b2-4b98-903c-c80bca765c25 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:29.076384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:29.168079 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb9c56-66b2-4b98-903c-c80bca765c25 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:29.212272 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b317e-c71e-4e02-9959-cce768ec3a02 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:29.225438 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3117f-7053-4bf1-8afe-3955a43e7c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:29.226118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3117f-7053-4bf1-8afe-3955a43e7c39 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:29.226396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3117f-7053-4bf1-8afe-3955a43e7c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:29.226680 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3117f-7053-4bf1-8afe-3955a43e7c39 None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1/groups/16c409d9c97447df9384d7478dd2e048/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:29.230513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3117f-7053-4bf1-8afe-3955a43e7c39 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e107e4257e749cdbbc856b69ced1cc1, group_id=16c409d9c97447df9384d7478dd2e048, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:29.232004 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3117f-7053-4bf1-8afe-3955a43e7c39 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:29.256878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 196/396] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Aug 30 11:44:29 2022] PUT /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1/groups/16c409d9c97447df9384d7478dd2e048/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:44:29.259062 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfec8b-f434-4e3a-9432-e60b29556c0e None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:29.263503 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfec8b-f434-4e3a-9432-e60b29556c0e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:29.264232 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfec8b-f434-4e3a-9432-e60b29556c0e None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:29.268735 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 197/397] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:29 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:29.283976 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722beb4-8a04-49cb-a4e2-c3b47a7577ef None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:29.284745 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722beb4-8a04-49cb-a4e2-c3b47a7577ef None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:29.285204 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722beb4-8a04-49cb-a4e2-c3b47a7577ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:29.308778 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6722beb4-8a04-49cb-a4e2-c3b47a7577ef None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:29.310477 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6722beb4-8a04-49cb-a4e2-c3b47a7577ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:29.388738 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 198/398] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:44:29.395612 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b317e-c71e-4e02-9959-cce768ec3a02 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:29.437121 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb94616-81fa-4753-b031-12036ec2fcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:29.438469 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb94616-81fa-4753-b031-12036ec2fcda None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:29.438951 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb94616-81fa-4753-b031-12036ec2fcda None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:29.439472 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb94616-81fa-4753-b031-12036ec2fcda None admin] PATH_INFO: `/v3/roles/member` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:29.452282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb94616-81fa-4753-b031-12036ec2fcda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:29.458545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-bdb94616-81fa-4753-b031-12036ec2fcda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:29.458545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:29.458545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:29.458545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:29.458545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:29.458545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:29.458545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:29.458545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:29.458545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:29.458545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:29.458545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:29.458545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:29.458545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:29.458545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:29.458545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:29.458545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:29.459583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:29.459583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:29.459583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:29.459583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:29.459583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:29.459583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:29.459583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:29.459583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:29.459583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:29.459583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:29.459583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:29.459583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:29.459583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:29.459583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:29.459583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:29.459583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:29.460371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:29.460371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:29.460371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:29.460371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:29.460371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:29.460371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:29.460371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:29.460371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:29.460371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:29.460371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:29.460371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:29.460371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:29.463085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 201/399] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:44:29.469988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722beb4-8a04-49cb-a4e2-c3b47a7577ef None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:29.493696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:29.505451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf40eaa-d836-46b6-8c13-eb5ac294ba26 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:29.506417 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf40eaa-d836-46b6-8c13-eb5ac294ba26 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:29.506914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf40eaa-d836-46b6-8c13-eb5ac294ba26 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:29.508977 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 202/400] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:44:29.518079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267f1df-8b98-40ed-8236-804c1b535075 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:29.518683 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267f1df-8b98-40ed-8236-804c1b535075 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:29.519145 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267f1df-8b98-40ed-8236-804c1b535075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:29.533881 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:29.541546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-6267f1df-8b98-40ed-8236-804c1b535075 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:29.543590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6267f1df-8b98-40ed-8236-804c1b535075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:29.608425 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722beb4-8a04-49cb-a4e2-c3b47a7577ef None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:29.645197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 203/401] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:29.656073 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7db84a-092f-4fb9-bad6-99f8f8733c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:29.657051 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7db84a-092f-4fb9-bad6-99f8f8733c0c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:29.657528 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7db84a-092f-4fb9-bad6-99f8f8733c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:29.658010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7db84a-092f-4fb9-bad6-99f8f8733c0c None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:29.658862 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7db84a-092f-4fb9-bad6-99f8f8733c0c None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:29.659381 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7db84a-092f-4fb9-bad6-99f8f8733c0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:29.661007 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7db84a-092f-4fb9-bad6-99f8f8733c0c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:29.670263 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 199/402] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:44:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:29.676190 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267f1df-8b98-40ed-8236-804c1b535075 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:29.735474 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7db84a-092f-4fb9-bad6-99f8f8733c0c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:29.814308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267f1df-8b98-40ed-8236-804c1b535075 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:29.872090 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5dd0f-d2eb-4a88-9b34-4d3cd57b9696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:29.874334 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:29.875159 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5dd0f-d2eb-4a88-9b34-4d3cd57b9696 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:29.875789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5dd0f-d2eb-4a88-9b34-4d3cd57b9696 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:29.876485 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5dd0f-d2eb-4a88-9b34-4d3cd57b9696 None admin] PATH_INFO: `/v3/groups/16c409d9c97447df9384d7478dd2e048` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:29.883542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5dd0f-d2eb-4a88-9b34-4d3cd57b9696 None admin] RBAC: Authorizing `identity:get_group(group_id=16c409d9c97447df9384d7478dd2e048)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:29.883542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5dd0f-d2eb-4a88-9b34-4d3cd57b9696 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:29.884671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 204/403] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Aug 30 11:44:29 2022] GET /identity/v3/groups/16c409d9c97447df9384d7478dd2e048 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:29.892742 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5dd0f-d2eb-4a88-9b34-4d3cd57b9696 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:29.898726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:29.926669 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7db84a-092f-4fb9-bad6-99f8f8733c0c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:29.993908 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8500a-5284-412e-bcfd-f709e4f64a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:29.995712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8500a-5284-412e-bcfd-f709e4f64a8b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:29.996940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8500a-5284-412e-bcfd-f709e4f64a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:29.997407 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8500a-5284-412e-bcfd-f709e4f64a8b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:30.012146 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8500a-5284-412e-bcfd-f709e4f64a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:30.018629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-a2d8500a-5284-412e-bcfd-f709e4f64a8b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:44:30.018629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:30.018629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:30.018629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:30.018629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:30.018629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:30.018629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:30.018629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:30.018629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:30.018629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:30.018629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:30.018629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:30.018629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:30.018629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:30.018629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:30.018629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:30.019722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:30.019722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:30.019722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:30.019722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:30.019722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:30.019722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:30.019722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:30.019722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:30.019722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:30.019722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:30.019722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:30.019722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:30.019722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:30.019722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:30.019722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:30.019722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:30.020524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:30.020524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:30.020524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:30.020524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:30.020524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:30.020524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:30.020524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:30.020524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:30.020524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:30.020524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:30.020524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:44:30.020524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:30.027554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 200/404] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Aug 30 11:44:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:44:30.028567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8500a-5284-412e-bcfd-f709e4f64a8b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:30.062551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5dd0f-d2eb-4a88-9b34-4d3cd57b9696 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:30.115080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79960d-d06e-499a-9216-d85e8a41a115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:30.115754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79960d-d06e-499a-9216-d85e8a41a115 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:30.116070 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79960d-d06e-499a-9216-d85e8a41a115 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:30.116340 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79960d-d06e-499a-9216-d85e8a41a115 None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:30.117465 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79960d-d06e-499a-9216-d85e8a41a115 None admin] RBAC: Authorizing `identity:get_project(project_id=f6e02d64fae241a7912706aa95544b4c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:30.118916 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79960d-d06e-499a-9216-d85e8a41a115 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:30.120932 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 205/405] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:29 2022] GET /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:30.121729 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79960d-d06e-499a-9216-d85e8a41a115 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:30.147038 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8500a-5284-412e-bcfd-f709e4f64a8b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:30.183185 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd362178-6355-4f67-9692-3d652b365457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:30.184191 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd362178-6355-4f67-9692-3d652b365457 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:30.184748 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd362178-6355-4f67-9692-3d652b365457 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:30.185324 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd362178-6355-4f67-9692-3d652b365457 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:30.193927 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:30.197690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd362178-6355-4f67-9692-3d652b365457 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:30.203399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-fd362178-6355-4f67-9692-3d652b365457 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:44:30.203399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:30.203399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:30.203399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:30.203399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:30.203399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:30.203399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:30.203399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:30.203399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:30.203399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:30.203399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:30.203399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:30.203399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:30.203399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:30.203399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:30.203399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:30.204303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:30.204303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:30.204303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:30.204303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:30.204303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:30.204303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:30.204303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:30.204303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:30.204303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:30.204303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:30.204303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:30.204303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:30.204303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:30.204303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:30.204303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:30.204303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:30.205213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:30.205213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:30.205213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:30.205213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:30.205213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:30.205213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:30.205213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:30.205213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:30.205213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:30.205213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:30.205213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:44:30.205213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:30.212172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 201/406] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:44:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:30.213422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd362178-6355-4f67-9692-3d652b365457 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:30.218353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:30.230646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79960d-d06e-499a-9216-d85e8a41a115 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:30.270758 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3832db-6f84-41c0-93b2-a18def628730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:30.271644 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3832db-6f84-41c0-93b2-a18def628730 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:30.272014 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3832db-6f84-41c0-93b2-a18def628730 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:30.272396 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3832db-6f84-41c0-93b2-a18def628730 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:30.273148 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3832db-6f84-41c0-93b2-a18def628730 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:30.273541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3832db-6f84-41c0-93b2-a18def628730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:30.275013 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3832db-6f84-41c0-93b2-a18def628730 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:30.288063 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 206/407] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:44:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:30.288063 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3832db-6f84-41c0-93b2-a18def628730 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:30.331282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd362178-6355-4f67-9692-3d652b365457 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:30.369011 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe7b26-439e-4c62-a761-d041ead52a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:30.370001 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe7b26-439e-4c62-a761-d041ead52a2d None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:30.370437 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe7b26-439e-4c62-a761-d041ead52a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:30.370845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe7b26-439e-4c62-a761-d041ead52a2d None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c/groups/16c409d9c97447df9384d7478dd2e048/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:30.373008 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe7b26-439e-4c62-a761-d041ead52a2d None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e02d64fae241a7912706aa95544b4c, group_id=16c409d9c97447df9384d7478dd2e048, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:30.374691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe7b26-439e-4c62-a761-d041ead52a2d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:30.391721 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3832db-6f84-41c0-93b2-a18def628730 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:30.392478 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 202/408] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Aug 30 11:44:30 2022] PUT /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c/groups/16c409d9c97447df9384d7478dd2e048/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:44:30.393743 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe7b26-439e-4c62-a761-d041ead52a2d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:30.442183 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0227065-1f11-4f31-9da9-3630f0acd666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:30.442818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0227065-1f11-4f31-9da9-3630f0acd666 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:30.443097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0227065-1f11-4f31-9da9-3630f0acd666 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:30.443390 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0227065-1f11-4f31-9da9-3630f0acd666 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:30.444073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0227065-1f11-4f31-9da9-3630f0acd666 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:30.444375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0227065-1f11-4f31-9da9-3630f0acd666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:30.445948 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0227065-1f11-4f31-9da9-3630f0acd666 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:30.448298 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:30.461169 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 207/409] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:30.471812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0227065-1f11-4f31-9da9-3630f0acd666 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:30.487245 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:30.541388 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe7b26-439e-4c62-a761-d041ead52a2d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:30.585956 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95907716-73bf-4f4c-bc88-bde763f757df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:30.586916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95907716-73bf-4f4c-bc88-bde763f757df None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:30.587390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95907716-73bf-4f4c-bc88-bde763f757df None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:30.587808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95907716-73bf-4f4c-bc88-bde763f757df None admin] PATH_INFO: `/v3/groups/16c409d9c97447df9384d7478dd2e048` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:30.590506 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95907716-73bf-4f4c-bc88-bde763f757df None admin] RBAC: Authorizing `identity:get_group(group_id=16c409d9c97447df9384d7478dd2e048)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:30.593153 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95907716-73bf-4f4c-bc88-bde763f757df None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:30.596201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 203/410] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Aug 30 11:44:30 2022] GET /identity/v3/groups/16c409d9c97447df9384d7478dd2e048 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:30.604155 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95907716-73bf-4f4c-bc88-bde763f757df None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:30.661222 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0227065-1f11-4f31-9da9-3630f0acd666 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:30.697992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a5bad-0dba-4b99-868a-a91fa825cb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:30.698877 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a5bad-0dba-4b99-868a-a91fa825cb84 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:30.699320 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a5bad-0dba-4b99-868a-a91fa825cb84 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:30.699765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a5bad-0dba-4b99-868a-a91fa825cb84 None admin] PATH_INFO: `/v3/groups/182f33b3142d4d529c1a8873b7c8b425` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:30.701006 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a5bad-0dba-4b99-868a-a91fa825cb84 None admin] RBAC: Authorizing `identity:get_group(group_id=182f33b3142d4d529c1a8873b7c8b425)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:30.702632 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a5bad-0dba-4b99-868a-a91fa825cb84 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:30.704534 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 208/411] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Aug 30 11:44:30 2022] GET /identity/v3/groups/182f33b3142d4d529c1a8873b7c8b425 => generated 229 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:30.717195 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a5bad-0dba-4b99-868a-a91fa825cb84 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:30.767787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95907716-73bf-4f4c-bc88-bde763f757df None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:30.815901 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:30.821023 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:30.832939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eae82d-20b0-4c77-b5f4-9603bce7e678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:30.833677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eae82d-20b0-4c77-b5f4-9603bce7e678 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:30.833954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eae82d-20b0-4c77-b5f4-9603bce7e678 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:30.834271 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eae82d-20b0-4c77-b5f4-9603bce7e678 None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:30.837898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eae82d-20b0-4c77-b5f4-9603bce7e678 None admin] RBAC: Authorizing `identity:get_project(project_id=f6e02d64fae241a7912706aa95544b4c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:30.839446 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eae82d-20b0-4c77-b5f4-9603bce7e678 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:30.841774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 204/412] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:30 2022] GET /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:30.849166 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eae82d-20b0-4c77-b5f4-9603bce7e678 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:30.860409 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a5bad-0dba-4b99-868a-a91fa825cb84 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:30.896828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa307c2-6390-438b-8260-5604fe3e9fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:30.897743 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa307c2-6390-438b-8260-5604fe3e9fef None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:30.898158 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa307c2-6390-438b-8260-5604fe3e9fef None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:30.898577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa307c2-6390-438b-8260-5604fe3e9fef None admin] PATH_INFO: `/v3/projects/801a00d9234a4360978c5c3ff97e0dc2` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:30.899856 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa307c2-6390-438b-8260-5604fe3e9fef None admin] RBAC: Authorizing `identity:get_project(project_id=801a00d9234a4360978c5c3ff97e0dc2)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:30.901467 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa307c2-6390-438b-8260-5604fe3e9fef None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:30.903584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 209/413] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:30 2022] GET /identity/v3/projects/801a00d9234a4360978c5c3ff97e0dc2 => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:30.909588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa307c2-6390-438b-8260-5604fe3e9fef None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:31.001800 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eae82d-20b0-4c77-b5f4-9603bce7e678 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:31.044813 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa307c2-6390-438b-8260-5604fe3e9fef None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:31.066742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d89f27-2b92-4eaa-9e7a-ef25ee14bba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:31.067708 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d89f27-2b92-4eaa-9e7a-ef25ee14bba6 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:31.067984 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d89f27-2b92-4eaa-9e7a-ef25ee14bba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:31.068254 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d89f27-2b92-4eaa-9e7a-ef25ee14bba6 None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c/groups/16c409d9c97447df9384d7478dd2e048/roles/30c5b9fbbb564c6dafe66f759683738b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:31.071244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d89f27-2b92-4eaa-9e7a-ef25ee14bba6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e02d64fae241a7912706aa95544b4c, group_id=16c409d9c97447df9384d7478dd2e048, role_id=30c5b9fbbb564c6dafe66f759683738b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:31.073616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d89f27-2b92-4eaa-9e7a-ef25ee14bba6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:31.075786 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:31.081944 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a164ac7-e9a1-40f6-9a9d-3dfd1ba119b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:31.082615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a164ac7-e9a1-40f6-9a9d-3dfd1ba119b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:31.082897 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a164ac7-e9a1-40f6-9a9d-3dfd1ba119b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:31.083177 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a164ac7-e9a1-40f6-9a9d-3dfd1ba119b3 None admin] PATH_INFO: `/v3/projects/801a00d9234a4360978c5c3ff97e0dc2/groups/182f33b3142d4d529c1a8873b7c8b425/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:31.085621 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a164ac7-e9a1-40f6-9a9d-3dfd1ba119b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=801a00d9234a4360978c5c3ff97e0dc2, group_id=182f33b3142d4d529c1a8873b7c8b425, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:31.087152 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a164ac7-e9a1-40f6-9a9d-3dfd1ba119b3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:31.093155 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 205/414] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Aug 30 11:44:30 2022] PUT /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c/groups/16c409d9c97447df9384d7478dd2e048/roles/30c5b9fbbb564c6dafe66f759683738b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:44:31.095348 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3bce8-88c9-4355-b307-0c0a986bba70 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:31.095709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3bce8-88c9-4355-b307-0c0a986bba70 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:31.095989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3bce8-88c9-4355-b307-0c0a986bba70 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:31.097504 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 206/415] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:31.113291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b8df3-502b-432c-9700-d0cc72a7c2c8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:31.113291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b8df3-502b-432c-9700-d0cc72a7c2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:31.113291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b8df3-502b-432c-9700-d0cc72a7c2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:31.115515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 210/416] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Aug 30 11:44:30 2022] PUT /identity/v3/projects/801a00d9234a4360978c5c3ff97e0dc2/groups/182f33b3142d4d529c1a8873b7c8b425/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:44:31.138642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b60b8df3-502b-432c-9700-d0cc72a7c2c8 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:31.140068 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b60b8df3-502b-432c-9700-d0cc72a7c2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:31.205516 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:31.227510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 207/417] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:31.488352 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25711255-2c86-411b-b17d-1e5af4536cef None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:31.488712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25711255-2c86-411b-b17d-1e5af4536cef None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:31.489016 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25711255-2c86-411b-b17d-1e5af4536cef None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:31.490750 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 211/418] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:31.496108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb70836-5ab9-4d95-9e84-40a83be546a2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:31.496399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb70836-5ab9-4d95-9e84-40a83be546a2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:31.496677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb70836-5ab9-4d95-9e84-40a83be546a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:31.515185 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-deb70836-5ab9-4d95-9e84-40a83be546a2 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:31.516560 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-deb70836-5ab9-4d95-9e84-40a83be546a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:31.523976 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25711255-2c86-411b-b17d-1e5af4536cef None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:31.620626 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 208/419] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:31.647272 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25711255-2c86-411b-b17d-1e5af4536cef None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:31.681779 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d308d-25e2-416d-80a5-6298ffe7a534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:31.682413 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d308d-25e2-416d-80a5-6298ffe7a534 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:31.682691 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d308d-25e2-416d-80a5-6298ffe7a534 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:31.682957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d308d-25e2-416d-80a5-6298ffe7a534 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:31.693474 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d308d-25e2-416d-80a5-6298ffe7a534 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:31.698760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-586d308d-25e2-416d-80a5-6298ffe7a534 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:44:31.698760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:31.698760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:31.698760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:31.698760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:31.698760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:31.698760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:31.698760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:31.698760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:31.698760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:31.698760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:31.698760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:31.698760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:31.698760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:31.698760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:31.698760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:31.699730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:31.699730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:31.699730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:31.699730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:31.699730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:31.699730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:31.699730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:31.699730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:31.699730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:31.699730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:31.699730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:31.699730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:31.699730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:31.699730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:31.699730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:31.699730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:31.700588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:31.700588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:31.700588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:31.700588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:31.700588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:31.700588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:31.700588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:31.700588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:31.700588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:31.700588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:31.700588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:44:31.700588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:31.700588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 212/420] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Aug 30 11:44:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:44:31.706689 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb70836-5ab9-4d95-9e84-40a83be546a2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:31.811223 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb70836-5ab9-4d95-9e84-40a83be546a2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:31.829892 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:31.849492 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcbbcb-6f72-4998-af77-c47d9b6eb512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:31.850444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcbbcb-6f72-4998-af77-c47d9b6eb512 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:31.850928 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcbbcb-6f72-4998-af77-c47d9b6eb512 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:31.851439 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcbbcb-6f72-4998-af77-c47d9b6eb512 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:31.852282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcbbcb-6f72-4998-af77-c47d9b6eb512 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:31.852759 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcbbcb-6f72-4998-af77-c47d9b6eb512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:31.854307 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcbbcb-6f72-4998-af77-c47d9b6eb512 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:31.863894 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 209/421] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:44:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:31.869696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d308d-25e2-416d-80a5-6298ffe7a534 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:31.926467 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:31.968899 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcbbcb-6f72-4998-af77-c47d9b6eb512 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:32.003885 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d308d-25e2-416d-80a5-6298ffe7a534 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:32.081034 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269faee-194f-4bdb-912a-c2461ce8109e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:32.081664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269faee-194f-4bdb-912a-c2461ce8109e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:32.081857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269faee-194f-4bdb-912a-c2461ce8109e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:32.082251 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269faee-194f-4bdb-912a-c2461ce8109e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:32.132627 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcbbcb-6f72-4998-af77-c47d9b6eb512 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:32.174174 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e96ece-19b8-4bd1-8f79-61af3a715e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:32.174818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e96ece-19b8-4bd1-8f79-61af3a715e4d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:32.175094 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e96ece-19b8-4bd1-8f79-61af3a715e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:32.175402 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e96ece-19b8-4bd1-8f79-61af3a715e4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:32.202269 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e96ece-19b8-4bd1-8f79-61af3a715e4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:32.208277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-f7e96ece-19b8-4bd1-8f79-61af3a715e4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:32.208277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:32.208277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:32.208277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:32.208277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:32.208277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:32.208277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:32.208277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:32.208277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:32.208277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:32.208277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:32.208277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:32.208277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:32.208277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:32.208277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:32.208277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:32.209596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:32.209596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:32.209596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:32.209596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:32.209596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:32.209596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:32.209596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:32.209596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:32.209596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:32.209596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:32.209596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:32.209596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:32.209596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:32.209596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:32.209596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:32.209596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:32.210393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:32.210393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:32.210393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:32.210393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:32.210393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:32.210393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:32.210393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:32.210393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:32.210393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:32.210393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:32.210393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:32.210393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:32.219857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269faee-194f-4bdb-912a-c2461ce8109e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:32.219857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269faee-194f-4bdb-912a-c2461ce8109e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:32.221786 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 210/422] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:44:32.227175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e96ece-19b8-4bd1-8f79-61af3a715e4d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:32.276436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:32.313148 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:32.337345 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 213/423] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:32.343804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269faee-194f-4bdb-912a-c2461ce8109e None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:32.460824 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269faee-194f-4bdb-912a-c2461ce8109e None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:32.477300 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e96ece-19b8-4bd1-8f79-61af3a715e4d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:32.503215 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538453b-fab4-4f87-bece-b7aa08f8c6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:32.504236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538453b-fab4-4f87-bece-b7aa08f8c6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:32.504690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538453b-fab4-4f87-bece-b7aa08f8c6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:32.505129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538453b-fab4-4f87-bece-b7aa08f8c6a1 None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:32.506504 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538453b-fab4-4f87-bece-b7aa08f8c6a1 None admin] RBAC: Authorizing `identity:get_project(project_id=1e107e4257e749cdbbc856b69ced1cc1)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:32.508249 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538453b-fab4-4f87-bece-b7aa08f8c6a1 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:32.511386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 214/424] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:32 2022] GET /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:32.517759 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538453b-fab4-4f87-bece-b7aa08f8c6a1 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:32.545682 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:32.576768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbcc3f-ae8e-4bfb-a912-7e51eb16ceca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:32.577424 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbcc3f-ae8e-4bfb-a912-7e51eb16ceca None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:32.577660 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbcc3f-ae8e-4bfb-a912-7e51eb16ceca None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:32.577931 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbcc3f-ae8e-4bfb-a912-7e51eb16ceca None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:32.578654 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbcc3f-ae8e-4bfb-a912-7e51eb16ceca None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:32.579203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbcc3f-ae8e-4bfb-a912-7e51eb16ceca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:32.580889 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbcc3f-ae8e-4bfb-a912-7e51eb16ceca None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:32.601824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 211/425] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:44:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:32.607156 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbcc3f-ae8e-4bfb-a912-7e51eb16ceca None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:32.637094 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538453b-fab4-4f87-bece-b7aa08f8c6a1 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:32.677515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f423ae9-cae4-4948-a0eb-d6f8c864ed2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:32.678496 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f423ae9-cae4-4948-a0eb-d6f8c864ed2a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:32.678953 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f423ae9-cae4-4948-a0eb-d6f8c864ed2a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:32.679416 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f423ae9-cae4-4948-a0eb-d6f8c864ed2a None admin] PATH_INFO: `/v3/groups/16c409d9c97447df9384d7478dd2e048` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:32.681061 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f423ae9-cae4-4948-a0eb-d6f8c864ed2a None admin] RBAC: Authorizing `identity:get_group(group_id=16c409d9c97447df9384d7478dd2e048)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:32.682910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f423ae9-cae4-4948-a0eb-d6f8c864ed2a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:32.685342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 215/426] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Aug 30 11:44:32 2022] GET /identity/v3/groups/16c409d9c97447df9384d7478dd2e048 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:32.691851 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f423ae9-cae4-4948-a0eb-d6f8c864ed2a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:32.791954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:32.807973 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f423ae9-cae4-4948-a0eb-d6f8c864ed2a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:32.855440 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c0c7c-51fb-4c8e-a28e-52ba1374ae4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:32.856376 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c0c7c-51fb-4c8e-a28e-52ba1374ae4f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:32.856834 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c0c7c-51fb-4c8e-a28e-52ba1374ae4f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:32.857277 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c0c7c-51fb-4c8e-a28e-52ba1374ae4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:32.858169 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c0c7c-51fb-4c8e-a28e-52ba1374ae4f None admin] RBAC: Adding query filter params (group.id=16c409d9c97447df9384d7478dd2e048, role.id=30c5b9fbbb564c6dafe66f759683738b, scope.project.id=1e107e4257e749cdbbc856b69ced1cc1) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:32.858639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c0c7c-51fb-4c8e-a28e-52ba1374ae4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:32.860628 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c0c7c-51fb-4c8e-a28e-52ba1374ae4f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:32.868472 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 216/427] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Aug 30 11:44:32 2022] GET /identity/v3/role_assignments?group.id=16c409d9c97447df9384d7478dd2e048&scope.project.id=1e107e4257e749cdbbc856b69ced1cc1&role.id=30c5b9fbbb564c6dafe66f759683738b => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:32.908507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbcc3f-ae8e-4bfb-a912-7e51eb16ceca None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:32.910578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:32.935419 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77e822-de70-49d3-9e54-bbc4890a5538 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:32.935924 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77e822-de70-49d3-9e54-bbc4890a5538 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:32.936291 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77e822-de70-49d3-9e54-bbc4890a5538 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:32.938550 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 217/428] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:44:32.944002 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5296c-5176-4dab-ae95-ebbd42431751 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:32.944410 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5296c-5176-4dab-ae95-ebbd42431751 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:32.944775 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5296c-5176-4dab-ae95-ebbd42431751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:32.967211 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f1613-8c3a-45ed-b23e-6636732b584c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:32.967886 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f1613-8c3a-45ed-b23e-6636732b584c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:32.968164 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f1613-8c3a-45ed-b23e-6636732b584c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:32.968546 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f1613-8c3a-45ed-b23e-6636732b584c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:32.969563 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-79d5296c-5176-4dab-ae95-ebbd42431751 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:32.970881 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-79d5296c-5176-4dab-ae95-ebbd42431751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:33.057015 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 218/429] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:33.088936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f1613-8c3a-45ed-b23e-6636732b584c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:33.091016 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f1613-8c3a-45ed-b23e-6636732b584c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:33.205889 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 212/430] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 11:44:33.212397 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5296c-5176-4dab-ae95-ebbd42431751 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:33.309496 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:33.328345 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5296c-5176-4dab-ae95-ebbd42431751 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:33.362944 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae80245-d46f-44d5-a5ff-09e66b410486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:33.363664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae80245-d46f-44d5-a5ff-09e66b410486 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:33.363879 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae80245-d46f-44d5-a5ff-09e66b410486 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:33.364149 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae80245-d46f-44d5-a5ff-09e66b410486 None admin] PATH_INFO: `/v3/projects/1e107e4257e749cdbbc856b69ced1cc1` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:33.365251 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae80245-d46f-44d5-a5ff-09e66b410486 None admin] RBAC: Authorizing `identity:get_project(project_id=1e107e4257e749cdbbc856b69ced1cc1)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:33.366727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae80245-d46f-44d5-a5ff-09e66b410486 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:33.368681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 219/431] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:33 2022] GET /identity/v3/projects/1e107e4257e749cdbbc856b69ced1cc1 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:33.376527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f1613-8c3a-45ed-b23e-6636732b584c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:33.378429 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae80245-d46f-44d5-a5ff-09e66b410486 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:33.379074 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:33.489191 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae80245-d46f-44d5-a5ff-09e66b410486 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:33.490256 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f1613-8c3a-45ed-b23e-6636732b584c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:33.522712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603880b-7db1-48f2-ba91-31f7e7ea8dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:33.523341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603880b-7db1-48f2-ba91-31f7e7ea8dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:33.523647 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603880b-7db1-48f2-ba91-31f7e7ea8dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:33.523919 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603880b-7db1-48f2-ba91-31f7e7ea8dc5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:33.525331 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf5ab5-5624-46c9-884b-0a2bf046f917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:33.525967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf5ab5-5624-46c9-884b-0a2bf046f917 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:33.526245 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf5ab5-5624-46c9-884b-0a2bf046f917 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:33.526517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf5ab5-5624-46c9-884b-0a2bf046f917 None admin] PATH_INFO: `/v3/groups/16c409d9c97447df9384d7478dd2e048` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:33.527656 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf5ab5-5624-46c9-884b-0a2bf046f917 None admin] RBAC: Authorizing `identity:get_group(group_id=16c409d9c97447df9384d7478dd2e048)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:33.529104 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf5ab5-5624-46c9-884b-0a2bf046f917 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:33.530684 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 213/432] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Aug 30 11:44:33 2022] GET /identity/v3/groups/16c409d9c97447df9384d7478dd2e048 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:33.532387 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3384d-188a-48dd-9c14-61bbb9f38c3a None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:33.532387 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3384d-188a-48dd-9c14-61bbb9f38c3a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:33.532635 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3384d-188a-48dd-9c14-61bbb9f38c3a None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:33.534799 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 214/433] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:33.535928 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efeb9a-84ab-4e95-80b3-88792c577d98 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:33.536212 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efeb9a-84ab-4e95-80b3-88792c577d98 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:33.536315 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0603880b-7db1-48f2-ba91-31f7e7ea8dc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:33.536485 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efeb9a-84ab-4e95-80b3-88792c577d98 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:33.537846 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 215/434] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:33.538535 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efeb9a-84ab-4e95-80b3-88792c577d98 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:33.542684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-0603880b-7db1-48f2-ba91-31f7e7ea8dc5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:33.542684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:33.542684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:33.542684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:33.542684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:33.542684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:33.542684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:33.542684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:33.542684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:33.542684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:33.542684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:33.542684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:33.542684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:33.542684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:33.542684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:33.542684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:33.543617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:33.543617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:33.543617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:33.543617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:33.543617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:33.543617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:33.543617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:33.543617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:33.543617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:33.543617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:33.543617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:33.543617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:33.543617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:33.543617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:33.543617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:33.543617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:33.544420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:33.544420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:33.544420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:33.544420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:33.544420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:33.544420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:33.544420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:33.544420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:33.544420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:33.544420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:33.544420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 11:44:33.544420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:33.544420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 220/435] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:44:33.545053 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6c567-cc0f-4601-bf20-e095cc5ea079 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:33.545529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6c567-cc0f-4601-bf20-e095cc5ea079 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:33.545529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6c567-cc0f-4601-bf20-e095cc5ea079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:33.565445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-63a6c567-cc0f-4601-bf20-e095cc5ea079 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:33.566659 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-63a6c567-cc0f-4601-bf20-e095cc5ea079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:33.569573 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:33.609035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:33.638018 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 221/436] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:33.639377 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b65f8-e3d8-4c4f-b370-721126b0139c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:33.639675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b65f8-e3d8-4c4f-b370-721126b0139c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:33.639951 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b65f8-e3d8-4c4f-b370-721126b0139c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:33.641114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efeb9a-84ab-4e95-80b3-88792c577d98 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:33.658392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d38b65f8-e3d8-4c4f-b370-721126b0139c None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:33.659621 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d38b65f8-e3d8-4c4f-b370-721126b0139c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:33.678368 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d688add-cfa1-44d7-8571-714cd816331d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:33.679011 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d688add-cfa1-44d7-8571-714cd816331d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:33.679270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d688add-cfa1-44d7-8571-714cd816331d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:33.679572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d688add-cfa1-44d7-8571-714cd816331d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:33.680292 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d688add-cfa1-44d7-8571-714cd816331d None admin] RBAC: Adding query filter params (group.id=16c409d9c97447df9384d7478dd2e048, role.id=7f855c6f817f4a64a1e635407de8bfb0, scope.project.id=1e107e4257e749cdbbc856b69ced1cc1) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:33.681010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d688add-cfa1-44d7-8571-714cd816331d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:33.682457 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d688add-cfa1-44d7-8571-714cd816331d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:33.688745 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 216/437] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Aug 30 11:44:33 2022] GET /identity/v3/role_assignments?group.id=16c409d9c97447df9384d7478dd2e048&scope.project.id=1e107e4257e749cdbbc856b69ced1cc1&role.id=7f855c6f817f4a64a1e635407de8bfb0 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:33.689526 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d688add-cfa1-44d7-8571-714cd816331d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:33.730140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 222/438] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:33.806594 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d688add-cfa1-44d7-8571-714cd816331d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:33.845389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56211bb2-32cd-462c-aba2-9ad8231b97b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:33.846390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56211bb2-32cd-462c-aba2-9ad8231b97b6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:33.846665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56211bb2-32cd-462c-aba2-9ad8231b97b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:33.846935 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56211bb2-32cd-462c-aba2-9ad8231b97b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:33.847626 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56211bb2-32cd-462c-aba2-9ad8231b97b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:33.847924 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56211bb2-32cd-462c-aba2-9ad8231b97b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:33.849390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56211bb2-32cd-462c-aba2-9ad8231b97b6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:33.850975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:33.860654 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 217/439] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:44:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:33.866135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b65f8-e3d8-4c4f-b370-721126b0139c None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:33.924184 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56211bb2-32cd-462c-aba2-9ad8231b97b6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:33.944897 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:33.985469 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b65f8-e3d8-4c4f-b370-721126b0139c None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:34.026541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14acc9-2961-42cd-972c-b94a6604514b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:34.027284 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14acc9-2961-42cd-972c-b94a6604514b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:34.027592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14acc9-2961-42cd-972c-b94a6604514b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:34.028674 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14acc9-2961-42cd-972c-b94a6604514b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:34.048571 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56211bb2-32cd-462c-aba2-9ad8231b97b6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:34.089412 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2d3a4-9eb9-4666-a74d-3489cb8a20ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:34.090793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2d3a4-9eb9-4666-a74d-3489cb8a20ac None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:34.091076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2d3a4-9eb9-4666-a74d-3489cb8a20ac None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:34.091342 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2d3a4-9eb9-4666-a74d-3489cb8a20ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:34.102391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2d3a4-9eb9-4666-a74d-3489cb8a20ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:34.108244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-05b2d3a4-9eb9-4666-a74d-3489cb8a20ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:44:34.108244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:34.108244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:34.108244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:34.108244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:34.108244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:34.108244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:34.108244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:34.108244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:34.108244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:34.108244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:34.108244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:34.108244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:34.108244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:34.108244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:34.108244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:34.109149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:34.109149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:34.109149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:34.109149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:34.109149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:34.109149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:34.109149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:34.109149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:34.109149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:34.109149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:34.109149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:34.109149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:34.109149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:34.109149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:34.109149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:34.109149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:34.110481 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:34.110481 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:34.110481 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:34.110481 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:34.110481 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:34.110481 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:34.110481 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:34.110481 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:34.110481 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:34.110481 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:34.110481 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:44:34.110481 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:34.113621 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 218/440] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:44:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:44:34.114344 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2d3a4-9eb9-4666-a74d-3489cb8a20ac None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:34.117466 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14acc9-2961-42cd-972c-b94a6604514b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:34.118307 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14acc9-2961-42cd-972c-b94a6604514b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:34.178922 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:34.196346 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:34.233671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2d3a4-9eb9-4666-a74d-3489cb8a20ac None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:34.237664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 223/441] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 11:44:34.238417 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14acc9-2961-42cd-972c-b94a6604514b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:34.281671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28bd8d-ff79-46bd-af14-bc047ee4d709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:34.282313 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28bd8d-ff79-46bd-af14-bc047ee4d709 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:34.282589 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28bd8d-ff79-46bd-af14-bc047ee4d709 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:34.282860 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28bd8d-ff79-46bd-af14-bc047ee4d709 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:34.293544 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28bd8d-ff79-46bd-af14-bc047ee4d709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:34.298467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-7e28bd8d-ff79-46bd-af14-bc047ee4d709 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:44:34.298467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:34.298467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:34.298467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:34.298467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:34.298467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:34.298467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:34.298467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:34.298467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:34.298467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:34.298467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:34.298467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:34.298467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:34.298467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:34.298467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:34.298467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:34.299413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:34.299413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:34.299413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:34.299413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:34.299413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:34.299413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:34.299413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:34.299413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:34.299413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:34.299413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:34.299413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:34.299413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:34.299413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:34.299413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:34.299413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:34.299413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:34.300224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:34.300224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:34.300224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:34.300224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:34.300224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:34.300224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:34.300224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:34.300224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:34.300224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:34.300224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:34.300224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:44:34.300224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:34.300224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 219/442] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Aug 30 11:44:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:34.300868 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28bd8d-ff79-46bd-af14-bc047ee4d709 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:34.344735 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14acc9-2961-42cd-972c-b94a6604514b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:34.379537 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401906d9-351d-4565-be28-dbebbf11594f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:34.380147 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401906d9-351d-4565-be28-dbebbf11594f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:34.380424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401906d9-351d-4565-be28-dbebbf11594f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:34.380709 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401906d9-351d-4565-be28-dbebbf11594f None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:34.381366 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401906d9-351d-4565-be28-dbebbf11594f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:34.381671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401906d9-351d-4565-be28-dbebbf11594f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:34.383067 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401906d9-351d-4565-be28-dbebbf11594f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:34.391370 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 224/443] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:34.392168 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401906d9-351d-4565-be28-dbebbf11594f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:34.404440 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28bd8d-ff79-46bd-af14-bc047ee4d709 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:34.422024 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:34.425323 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:34.440776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a87a3-ce6a-4f78-bd5a-a0d4d25b0263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:34.441422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a87a3-ce6a-4f78-bd5a-a0d4d25b0263 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:34.441731 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a87a3-ce6a-4f78-bd5a-a0d4d25b0263 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:34.441982 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a87a3-ce6a-4f78-bd5a-a0d4d25b0263 None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:34.443193 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a87a3-ce6a-4f78-bd5a-a0d4d25b0263 None admin] RBAC: Authorizing `identity:get_project(project_id=f6e02d64fae241a7912706aa95544b4c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:34.444685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a87a3-ce6a-4f78-bd5a-a0d4d25b0263 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:34.446303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 220/444] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:34 2022] GET /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:34.447066 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a87a3-ce6a-4f78-bd5a-a0d4d25b0263 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:34.498887 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401906d9-351d-4565-be28-dbebbf11594f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:34.534571 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd83b88-f8de-4f46-8846-83631ae78d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:34.535177 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd83b88-f8de-4f46-8846-83631ae78d6d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:34.535483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd83b88-f8de-4f46-8846-83631ae78d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:34.535755 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd83b88-f8de-4f46-8846-83631ae78d6d None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:34.536414 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd83b88-f8de-4f46-8846-83631ae78d6d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:34.536704 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd83b88-f8de-4f46-8846-83631ae78d6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:34.538101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd83b88-f8de-4f46-8846-83631ae78d6d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:34.545975 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 225/445] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:44:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:34.546721 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd83b88-f8de-4f46-8846-83631ae78d6d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:34.554285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a87a3-ce6a-4f78-bd5a-a0d4d25b0263 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:34.588445 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4c409-ccae-4905-a651-61757fdadb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:34.589052 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4c409-ccae-4905-a651-61757fdadb86 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:34.589330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4c409-ccae-4905-a651-61757fdadb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:34.589598 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4c409-ccae-4905-a651-61757fdadb86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:34.639234 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:34.639940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:34.646844 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd83b88-f8de-4f46-8846-83631ae78d6d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:34.655449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4c409-ccae-4905-a651-61757fdadb86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:34.656991 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4c409-ccae-4905-a651-61757fdadb86 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:34.680148 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2673501-0b16-4012-b4b1-14de6fde76a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:34.680789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2673501-0b16-4012-b4b1-14de6fde76a6 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:34.681051 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2673501-0b16-4012-b4b1-14de6fde76a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:34.681338 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2673501-0b16-4012-b4b1-14de6fde76a6 None admin] PATH_INFO: `/v3/groups/16c409d9c97447df9384d7478dd2e048` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:34.682424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2673501-0b16-4012-b4b1-14de6fde76a6 None admin] RBAC: Authorizing `identity:get_group(group_id=16c409d9c97447df9384d7478dd2e048)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:34.683909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2673501-0b16-4012-b4b1-14de6fde76a6 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:34.685448 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 226/446] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Aug 30 11:44:34 2022] GET /identity/v3/groups/16c409d9c97447df9384d7478dd2e048 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:34.686204 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2673501-0b16-4012-b4b1-14de6fde76a6 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:34.758982 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 221/447] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:34.759610 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4c409-ccae-4905-a651-61757fdadb86 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:34.786530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2673501-0b16-4012-b4b1-14de6fde76a6 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:34.819615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30aa874-1056-4b92-9df3-0fef315e3396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:34.820220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30aa874-1056-4b92-9df3-0fef315e3396 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:34.820493 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30aa874-1056-4b92-9df3-0fef315e3396 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:34.820759 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30aa874-1056-4b92-9df3-0fef315e3396 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:34.844159 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:34.851178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:34.859934 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4c409-ccae-4905-a651-61757fdadb86 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:34.888886 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30aa874-1056-4b92-9df3-0fef315e3396 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:34.890373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30aa874-1056-4b92-9df3-0fef315e3396 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:34.894804 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d27c3b-ff7b-4fb5-b7a9-4b68955e6a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:34.895543 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d27c3b-ff7b-4fb5-b7a9-4b68955e6a56 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:34.895823 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d27c3b-ff7b-4fb5-b7a9-4b68955e6a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:34.896094 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d27c3b-ff7b-4fb5-b7a9-4b68955e6a56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:34.896817 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d27c3b-ff7b-4fb5-b7a9-4b68955e6a56 None admin] RBAC: Adding query filter params (group.id=16c409d9c97447df9384d7478dd2e048, role.id=7f855c6f817f4a64a1e635407de8bfb0, scope.project.id=f6e02d64fae241a7912706aa95544b4c) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:34.897122 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d27c3b-ff7b-4fb5-b7a9-4b68955e6a56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:34.898560 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d27c3b-ff7b-4fb5-b7a9-4b68955e6a56 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:34.916010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 222/448] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Aug 30 11:44:34 2022] GET /identity/v3/role_assignments?group.id=16c409d9c97447df9384d7478dd2e048&scope.project.id=f6e02d64fae241a7912706aa95544b4c&role.id=7f855c6f817f4a64a1e635407de8bfb0 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:34.916010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d27c3b-ff7b-4fb5-b7a9-4b68955e6a56 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:34.997557 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 227/449] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:35.003572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30aa874-1056-4b92-9df3-0fef315e3396 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:35.038987 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d27c3b-ff7b-4fb5-b7a9-4b68955e6a56 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:35.071756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:35.080179 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487600b0-dc47-4b86-b6be-86f140cd517e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:35.081002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487600b0-dc47-4b86-b6be-86f140cd517e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:35.081002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487600b0-dc47-4b86-b6be-86f140cd517e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:35.081290 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487600b0-dc47-4b86-b6be-86f140cd517e None admin] PATH_INFO: `/v3/projects/801a00d9234a4360978c5c3ff97e0dc2` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:35.083401 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487600b0-dc47-4b86-b6be-86f140cd517e None admin] RBAC: Authorizing `identity:get_project(project_id=801a00d9234a4360978c5c3ff97e0dc2)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:35.084504 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487600b0-dc47-4b86-b6be-86f140cd517e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:35.086312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 223/450] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:34 2022] GET /identity/v3/projects/801a00d9234a4360978c5c3ff97e0dc2 => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:35.092897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487600b0-dc47-4b86-b6be-86f140cd517e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:35.116129 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:35.124594 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30aa874-1056-4b92-9df3-0fef315e3396 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:35.163906 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ae6d1-a248-465d-8651-021ec02091c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:35.164555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ae6d1-a248-465d-8651-021ec02091c4 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:35.164835 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ae6d1-a248-465d-8651-021ec02091c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:35.165107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ae6d1-a248-465d-8651-021ec02091c4 None admin] PATH_INFO: `/v3/projects/f6e02d64fae241a7912706aa95544b4c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:35.166232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ae6d1-a248-465d-8651-021ec02091c4 None admin] RBAC: Authorizing `identity:get_project(project_id=f6e02d64fae241a7912706aa95544b4c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:35.167717 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ae6d1-a248-465d-8651-021ec02091c4 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:35.170284 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 228/451] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:44:35 2022] GET /identity/v3/projects/f6e02d64fae241a7912706aa95544b4c => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:35.175966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ae6d1-a248-465d-8651-021ec02091c4 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:35.231643 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487600b0-dc47-4b86-b6be-86f140cd517e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:35.270903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388406e-3de9-4cab-a9c0-d3e90ab6526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:35.271716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388406e-3de9-4cab-a9c0-d3e90ab6526b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:35.271879 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388406e-3de9-4cab-a9c0-d3e90ab6526b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:35.272147 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388406e-3de9-4cab-a9c0-d3e90ab6526b None admin] PATH_INFO: `/v3/groups/182f33b3142d4d529c1a8873b7c8b425` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:35.273534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388406e-3de9-4cab-a9c0-d3e90ab6526b None admin] RBAC: Authorizing `identity:get_group(group_id=182f33b3142d4d529c1a8873b7c8b425)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:35.274969 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388406e-3de9-4cab-a9c0-d3e90ab6526b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:35.276572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 224/452] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Aug 30 11:44:35 2022] GET /identity/v3/groups/182f33b3142d4d529c1a8873b7c8b425 => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:35.282703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388406e-3de9-4cab-a9c0-d3e90ab6526b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:35.290208 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ae6d1-a248-465d-8651-021ec02091c4 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:35.319092 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:35.325290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd366a-4f1d-49a1-bfe2-ab57ecfbda2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:35.325915 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd366a-4f1d-49a1-bfe2-ab57ecfbda2b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:35.326191 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd366a-4f1d-49a1-bfe2-ab57ecfbda2b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:35.326452 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd366a-4f1d-49a1-bfe2-ab57ecfbda2b None admin] PATH_INFO: `/v3/groups/16c409d9c97447df9384d7478dd2e048` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:35.327583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd366a-4f1d-49a1-bfe2-ab57ecfbda2b None admin] RBAC: Authorizing `identity:get_group(group_id=16c409d9c97447df9384d7478dd2e048)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:35.329049 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd366a-4f1d-49a1-bfe2-ab57ecfbda2b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:35.330644 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 229/453] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Aug 30 11:44:35 2022] GET /identity/v3/groups/16c409d9c97447df9384d7478dd2e048 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:35.336305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd366a-4f1d-49a1-bfe2-ab57ecfbda2b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:35.382253 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:35.401419 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388406e-3de9-4cab-a9c0-d3e90ab6526b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:35.437001 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923aab8d-a913-4b9c-8d6d-10b435443e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:35.437681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923aab8d-a913-4b9c-8d6d-10b435443e00 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:35.437946 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923aab8d-a913-4b9c-8d6d-10b435443e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:35.438214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923aab8d-a913-4b9c-8d6d-10b435443e00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:35.438939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923aab8d-a913-4b9c-8d6d-10b435443e00 None admin] RBAC: Adding query filter params (group.id=182f33b3142d4d529c1a8873b7c8b425, role.id=4f4d8a6881ca496bb2d4845a6592fea8, scope.project.id=801a00d9234a4360978c5c3ff97e0dc2) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:35.439053 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd366a-4f1d-49a1-bfe2-ab57ecfbda2b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:35.439239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923aab8d-a913-4b9c-8d6d-10b435443e00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:35.440778 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923aab8d-a913-4b9c-8d6d-10b435443e00 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:35.446610 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 225/454] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Aug 30 11:44:35 2022] GET /identity/v3/role_assignments?group.id=182f33b3142d4d529c1a8873b7c8b425&scope.project.id=801a00d9234a4360978c5c3ff97e0dc2&role.id=4f4d8a6881ca496bb2d4845a6592fea8 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:35.477604 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6320c-b0bf-4123-b8a6-019e1fa5b01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:35.478231 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6320c-b0bf-4123-b8a6-019e1fa5b01b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:35.478507 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6320c-b0bf-4123-b8a6-019e1fa5b01b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:35.478809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6320c-b0bf-4123-b8a6-019e1fa5b01b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:35.479567 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6320c-b0bf-4123-b8a6-019e1fa5b01b None admin] RBAC: Adding query filter params (group.id=16c409d9c97447df9384d7478dd2e048, role.id=30c5b9fbbb564c6dafe66f759683738b, scope.project.id=f6e02d64fae241a7912706aa95544b4c) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:35.479869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6320c-b0bf-4123-b8a6-019e1fa5b01b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:35.481384 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6320c-b0bf-4123-b8a6-019e1fa5b01b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:35.488434 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 230/455] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Aug 30 11:44:35 2022] GET /identity/v3/role_assignments?group.id=16c409d9c97447df9384d7478dd2e048&scope.project.id=f6e02d64fae241a7912706aa95544b4c&role.id=30c5b9fbbb564c6dafe66f759683738b => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:37.897524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c9258-3697-41b9-ac6f-15b96467450f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:37.898597 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c9258-3697-41b9-ac6f-15b96467450f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:37.899079 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c9258-3697-41b9-ac6f-15b96467450f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:37.901220 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 226/456] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:37.906869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d8382-ee78-4859-a346-59265127267a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:37.908229 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d8382-ee78-4859-a346-59265127267a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:37.908771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d8382-ee78-4859-a346-59265127267a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:37.936840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-c33d8382-ee78-4859-a346-59265127267a None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:37.938815 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c33d8382-ee78-4859-a346-59265127267a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:38.030469 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:38.048771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 231/457] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:38.075124 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d6873-2a3d-4708-b8c2-2c1743c708f2 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:38.075456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d6873-2a3d-4708-b8c2-2c1743c708f2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:38.075705 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d6873-2a3d-4708-b8c2-2c1743c708f2 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:38.077333 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 227/458] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:38.082589 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f16ca-84b1-45d2-b13c-3b3035e82d36 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:38.082876 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f16ca-84b1-45d2-b13c-3b3035e82d36 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:38.083151 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f16ca-84b1-45d2-b13c-3b3035e82d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:38.117477 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-b81f16ca-84b1-45d2-b13c-3b3035e82d36 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:38.118661 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b81f16ca-84b1-45d2-b13c-3b3035e82d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:38.217305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 232/459] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:38.370024 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d6873-2a3d-4708-b8c2-2c1743c708f2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:38.528559 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d6873-2a3d-4708-b8c2-2c1743c708f2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:38.535007 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f16ca-84b1-45d2-b13c-3b3035e82d36 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:38.574811 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df754faa-b9be-426c-86bb-ebf04f0b9927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:38.575922 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df754faa-b9be-426c-86bb-ebf04f0b9927 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:38.576427 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df754faa-b9be-426c-86bb-ebf04f0b9927 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:38.576890 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df754faa-b9be-426c-86bb-ebf04f0b9927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:38.601558 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df754faa-b9be-426c-86bb-ebf04f0b9927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:38.603443 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df754faa-b9be-426c-86bb-ebf04f0b9927 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:38.616148 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:38.636149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-df754faa-b9be-426c-86bb-ebf04f0b9927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:38.636149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:38.636149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:38.636149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:38.636149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:38.636149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:38.636149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:38.636149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:38.636149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:38.636149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:38.636149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:38.636149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:38.636149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:38.636149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:38.636149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:38.636149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:38.637103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:38.637103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:38.637103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:38.637103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:38.637103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:38.637103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:38.637103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:38.637103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:38.637103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:38.637103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:38.637103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:38.637103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:38.637103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:38.637103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:38.637103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:38.637103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:38.637103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:38.637959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:38.637959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:38.637959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:38.640059 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 228/460] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:38.646485 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df754faa-b9be-426c-86bb-ebf04f0b9927 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:38.648774 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f16ca-84b1-45d2-b13c-3b3035e82d36 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:38.692569 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37728f0f-efbf-496a-8d49-9bed7568313b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:38.693259 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37728f0f-efbf-496a-8d49-9bed7568313b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:38.693535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37728f0f-efbf-496a-8d49-9bed7568313b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:38.693804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37728f0f-efbf-496a-8d49-9bed7568313b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:38.707279 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37728f0f-efbf-496a-8d49-9bed7568313b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:38.707279 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37728f0f-efbf-496a-8d49-9bed7568313b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:38.725542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-37728f0f-efbf-496a-8d49-9bed7568313b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:38.725542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:38.725542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:38.725542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:38.725542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:38.725542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:38.725542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:38.725542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:38.725542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:38.725542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:38.725542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:38.725542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:38.725542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:38.725542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:38.725542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:38.725542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:38.726869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:38.726869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:38.726869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:38.726869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:38.726869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:38.726869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:38.726869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:38.726869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:38.726869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:38.726869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:38.726869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:38.726869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:38.726869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:38.726869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:38.726869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:38.726869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:38.726869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:38.727887 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:38.727887 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:38.727887 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:38.727887 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 233/461] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:38.727887 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:38.729634 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37728f0f-efbf-496a-8d49-9bed7568313b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:38.805591 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df754faa-b9be-426c-86bb-ebf04f0b9927 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:38.847113 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8b8d1-83a5-4532-b76a-d434e500f455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:38.847769 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8b8d1-83a5-4532-b76a-d434e500f455 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:38.848043 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8b8d1-83a5-4532-b76a-d434e500f455 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:38.848313 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8b8d1-83a5-4532-b76a-d434e500f455 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:38.848952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8b8d1-83a5-4532-b76a-d434e500f455 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:38.849249 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8b8d1-83a5-4532-b76a-d434e500f455 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:38.850625 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8b8d1-83a5-4532-b76a-d434e500f455 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:38.871384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 229/462] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:38.871384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbd2e5-14d7-4941-a0eb-e7be82d9ca5f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:38.871384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbd2e5-14d7-4941-a0eb-e7be82d9ca5f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:38.871384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbd2e5-14d7-4941-a0eb-e7be82d9ca5f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:38.871384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 230/463] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:38.871812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbd2e5-14d7-4941-a0eb-e7be82d9ca5f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:38.872163 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37728f0f-efbf-496a-8d49-9bed7568313b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:38.918907 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421fcf9-c352-4f9a-8d82-678ac46d1799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:38.919603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421fcf9-c352-4f9a-8d82-678ac46d1799 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:38.919819 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421fcf9-c352-4f9a-8d82-678ac46d1799 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:38.920092 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421fcf9-c352-4f9a-8d82-678ac46d1799 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:38.920737 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421fcf9-c352-4f9a-8d82-678ac46d1799 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:38.921042 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421fcf9-c352-4f9a-8d82-678ac46d1799 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:38.922974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421fcf9-c352-4f9a-8d82-678ac46d1799 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:38.939868 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 234/464] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:38.939868 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d7d6c-630e-4043-b960-110090e77548 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:38.939868 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d7d6c-630e-4043-b960-110090e77548 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:38.939868 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d7d6c-630e-4043-b960-110090e77548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:38.947547 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:38.959457 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-828d7d6c-630e-4043-b960-110090e77548 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:38.960671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-828d7d6c-630e-4043-b960-110090e77548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:38.989708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:38.994006 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbd2e5-14d7-4941-a0eb-e7be82d9ca5f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:39.034307 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658c0d2-749f-4010-b187-b8f46453f3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:39.034921 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658c0d2-749f-4010-b187-b8f46453f3c8 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:39.035197 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658c0d2-749f-4010-b187-b8f46453f3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:39.035497 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658c0d2-749f-4010-b187-b8f46453f3c8 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:39.036178 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658c0d2-749f-4010-b187-b8f46453f3c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:39.037604 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658c0d2-749f-4010-b187-b8f46453f3c8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:39.053015 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 235/465] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:39.053015 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fa502-db0a-4a82-b463-d77f644e9f7b None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:39.053015 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fa502-db0a-4a82-b463-d77f644e9f7b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:39.053015 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fa502-db0a-4a82-b463-d77f644e9f7b None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:39.053015 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 236/466] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:39.053015 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fa502-db0a-4a82-b463-d77f644e9f7b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:39.069344 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 231/467] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Aug 30 11:44:38 2022] POST /identity/v3/users => generated 246 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:44:39.071125 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6db3aa-0754-48b8-82c0-8968dcccb54b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:39.071486 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6db3aa-0754-48b8-82c0-8968dcccb54b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:39.071802 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6db3aa-0754-48b8-82c0-8968dcccb54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:39.094722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1d6db3aa-0754-48b8-82c0-8968dcccb54b None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:39.096226 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1d6db3aa-0754-48b8-82c0-8968dcccb54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:39.176571 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 232/468] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:39.201356 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fa502-db0a-4a82-b463-d77f644e9f7b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:39.261053 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7481fa-6c18-4a56-a479-6ec824b6db71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:39.261739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7481fa-6c18-4a56-a479-6ec824b6db71 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:39.262015 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7481fa-6c18-4a56-a479-6ec824b6db71 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:39.262292 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7481fa-6c18-4a56-a479-6ec824b6db71 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:39.263015 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7481fa-6c18-4a56-a479-6ec824b6db71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:39.264645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7481fa-6c18-4a56-a479-6ec824b6db71 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:39.294450 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 237/469] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Aug 30 11:44:39 2022] POST /identity/v3/users => generated 248 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:44:39.350518 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459e92e-de6a-4131-9204-a253c546a4c8 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:39.350695 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459e92e-de6a-4131-9204-a253c546a4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:39.351151 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459e92e-de6a-4131-9204-a253c546a4c8 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:39.353012 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 233/470] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:39.359146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aee855-7236-4879-8dd8-95f6d0a0a95e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:39.359524 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aee855-7236-4879-8dd8-95f6d0a0a95e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:39.359992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aee855-7236-4879-8dd8-95f6d0a0a95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:39.382423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-95aee855-7236-4879-8dd8-95f6d0a0a95e None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:39.383681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-95aee855-7236-4879-8dd8-95f6d0a0a95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:39.401947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:39.444367 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459e92e-de6a-4131-9204-a253c546a4c8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:39.473912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 238/471] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:39.474669 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aee855-7236-4879-8dd8-95f6d0a0a95e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:39.519226 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:39.596632 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aee855-7236-4879-8dd8-95f6d0a0a95e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:39.597470 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459e92e-de6a-4131-9204-a253c546a4c8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:39.641462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b8234-7f61-437f-a210-b604fda3a98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:39.642023 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b8234-7f61-437f-a210-b604fda3a98c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:39.642294 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b8234-7f61-437f-a210-b604fda3a98c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:39.642562 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b8234-7f61-437f-a210-b604fda3a98c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:39.644402 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f985cf-c663-426b-ad57-f4a3c8cc8064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:39.645200 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f985cf-c663-426b-ad57-f4a3c8cc8064 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:39.645806 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f985cf-c663-426b-ad57-f4a3c8cc8064 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:39.646076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f985cf-c663-426b-ad57-f4a3c8cc8064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:39.654144 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b8234-7f61-437f-a210-b604fda3a98c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:39.656234 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b8234-7f61-437f-a210-b604fda3a98c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:39.661571 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f985cf-c663-426b-ad57-f4a3c8cc8064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:39.663057 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f985cf-c663-426b-ad57-f4a3c8cc8064 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:39.675776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-503b8234-7f61-437f-a210-b604fda3a98c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:39.675776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:39.675776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:39.675776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:39.675776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:39.675776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:39.675776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:39.675776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:39.675776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:39.675776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:39.675776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:39.675776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:39.675776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:39.675776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:39.675776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:39.675776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:39.676716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:39.676716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:39.676716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:39.676716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:39.676716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:39.676716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:39.676716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:39.676716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:39.676716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:39.676716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:39.676716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:39.676716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:39.676716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:39.676716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:39.676716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:39.676716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:39.676716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:39.677554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:39.677554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:39.677554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:39.677554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 234/472] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:39.680086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-43f985cf-c663-426b-ad57-f4a3c8cc8064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:39.680086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:39.680086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:39.680086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:39.680086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:39.680086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:39.680086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:39.680086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:39.680086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:39.680086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:39.680086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:39.680086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:39.680086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:39.680086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:39.680086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:39.680086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:39.682052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:39.682052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:39.682052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:39.682052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:39.682052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:39.682052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:39.682052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:39.682052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:39.682052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:39.682052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:39.682052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:39.682052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:39.682052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:39.682052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:39.682052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:39.682052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:39.682052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:39.683216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:39.683216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:39.683216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:39.683216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 239/473] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:39.686849 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b8234-7f61-437f-a210-b604fda3a98c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:39.687015 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f985cf-c663-426b-ad57-f4a3c8cc8064 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:39.690831 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:39.818020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b8234-7f61-437f-a210-b604fda3a98c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:39.819665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:39.841942 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f985cf-c663-426b-ad57-f4a3c8cc8064 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:39.854849 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3eb8e-5bb9-4669-9e5a-84a0c110b42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:39.855494 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3eb8e-5bb9-4669-9e5a-84a0c110b42a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:39.855903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3eb8e-5bb9-4669-9e5a-84a0c110b42a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:39.856175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3eb8e-5bb9-4669-9e5a-84a0c110b42a None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:39.856824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3eb8e-5bb9-4669-9e5a-84a0c110b42a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:39.857124 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3eb8e-5bb9-4669-9e5a-84a0c110b42a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:39.858602 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3eb8e-5bb9-4669-9e5a-84a0c110b42a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:39.872745 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 235/474] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:39.873669 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3eb8e-5bb9-4669-9e5a-84a0c110b42a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:39.887075 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48ecfa-c6e9-4b58-89be-9bda74d2a07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:39.887719 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48ecfa-c6e9-4b58-89be-9bda74d2a07a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:39.887992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48ecfa-c6e9-4b58-89be-9bda74d2a07a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:39.888259 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48ecfa-c6e9-4b58-89be-9bda74d2a07a None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:39.888959 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48ecfa-c6e9-4b58-89be-9bda74d2a07a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:39.889258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48ecfa-c6e9-4b58-89be-9bda74d2a07a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:39.890734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48ecfa-c6e9-4b58-89be-9bda74d2a07a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:39.904098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 240/475] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:39.904852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48ecfa-c6e9-4b58-89be-9bda74d2a07a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:39.969535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:39.997637 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3eb8e-5bb9-4669-9e5a-84a0c110b42a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:40.011043 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48ecfa-c6e9-4b58-89be-9bda74d2a07a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:40.039460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94dd40-64ca-4337-b498-daabfb8386da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:40.040549 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94dd40-64ca-4337-b498-daabfb8386da None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:40.041028 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94dd40-64ca-4337-b498-daabfb8386da None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:40.041428 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94dd40-64ca-4337-b498-daabfb8386da None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:40.042230 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94dd40-64ca-4337-b498-daabfb8386da None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:40.043942 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94dd40-64ca-4337-b498-daabfb8386da None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:40.052376 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af110ca3-bbef-4972-aa54-0c3b2d80d3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:40.052981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af110ca3-bbef-4972-aa54-0c3b2d80d3fd None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:40.053257 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af110ca3-bbef-4972-aa54-0c3b2d80d3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:40.053522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af110ca3-bbef-4972-aa54-0c3b2d80d3fd None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:40.054165 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af110ca3-bbef-4972-aa54-0c3b2d80d3fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:40.055672 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af110ca3-bbef-4972-aa54-0c3b2d80d3fd None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:40.056227 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.sql.core [None req-ce94dd40-64ca-4337-b498-daabfb8386da None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 11:44:40.056227 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 11:44:40.056227 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [parameters: {'id': '4bafc65ad9724da787395c604e40b0ad', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 11:44:40.056227 dv-cinder-839768-2-smb devstack@keystone.service[81554]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81554) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 11:44:40.075979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ce94dd40-64ca-4337-b498-daabfb8386da None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 11:44:40.075979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:40.075979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 11:44:40.075979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 11:44:40.075979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 11:44:40.075979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 11:44:40.075979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 11:44:40.075979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 11:44:40.075979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 11:44:40.075979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application conn.query(q) Aug 30 11:44:40.075979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 11:44:40.075979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 11:44:40.075979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 11:44:40.075979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application result.read() Aug 30 11:44:40.075979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 11:44:40.076905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 11:44:40.076905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 11:44:40.076905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 11:44:40.076905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 11:44:40.076905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 11:44:40.076905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 11:44:40.076905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 11:44:40.076905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 11:44:40.076905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:40.076905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 11:44:40.076905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:40.076905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:40.076905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 11:44:40.076905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 11:44:40.076905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 30 11:44:40.076905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return ref.to_dict() Aug 30 11:44:40.076905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 11:44:40.076905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application next(self.gen) Aug 30 11:44:40.077812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 11:44:40.077812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application yield resource Aug 30 11:44:40.077812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 11:44:40.077812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application next(self.gen) Aug 30 11:44:40.077812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 11:44:40.077812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 11:44:40.077812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 11:44:40.077812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 11:44:40.077812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 11:44:40.077812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise self.value Aug 30 11:44:40.077812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 11:44:40.077812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 11:44:40.077812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 11:44:40.077812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application session.commit() Aug 30 11:44:40.077812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 11:44:40.077812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 11:44:40.077812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 11:44:40.078715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 11:44:40.078715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 11:44:40.078715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self.session.flush() Aug 30 11:44:40.078715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 11:44:40.078715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 11:44:40.078715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 11:44:40.078715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 11:44:40.078715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 11:44:40.078715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application compat.raise_( Aug 30 11:44:40.078715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 11:44:40.078715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception Aug 30 11:44:40.078715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 11:44:40.078715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 11:44:40.078715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 11:44:40.078715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 11:44:40.078715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 11:44:40.078715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 11:44:40.079677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 11:44:40.079677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 11:44:40.079677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 11:44:40.079677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 11:44:40.079677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 11:44:40.079677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 11:44:40.079677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 11:44:40.079677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 11:44:40.079677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 11:44:40.079677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 11:44:40.079677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 11:44:40.079677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 11:44:40.079677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 11:44:40.079677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 11:44:40.079677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 11:44:40.079677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception Aug 30 11:44:40.080467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 11:44:40.080467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 11:44:40.080467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 11:44:40.080467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 11:44:40.080467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 11:44:40.080467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 11:44:40.080467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 11:44:40.080467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application conn.query(q) Aug 30 11:44:40.080467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 11:44:40.080467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 11:44:40.080467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 11:44:40.080467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application result.read() Aug 30 11:44:40.080467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 11:44:40.080467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 11:44:40.080467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 11:44:40.080467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 11:44:40.081251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 11:44:40.081251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 11:44:40.081251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 11:44:40.081251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 11:44:40.081251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 11:44:40.081251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 11:44:40.081251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [parameters: {'id': '4bafc65ad9724da787395c604e40b0ad', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 11:44:40.081251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 11:44:40.081251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:40.081251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:44:40.081251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:40.081251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:40.081251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:40.081251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:40.081251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:40.081251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:40.082035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:40.082035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:40.082035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:40.082035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:40.082035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:40.082035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:40.082035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 30 11:44:40.082035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 30 11:44:40.082035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:40.082035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:40.082035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 30 11:44:40.082035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 30 11:44:40.082035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 11:44:40.082035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 11:44:40.082035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 11:44:40.082035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:40.082889 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 236/476] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Aug 30 11:44:39 2022] POST /identity/v3/roles => generated 144 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:40.082889 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94dd40-64ca-4337-b498-daabfb8386da None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:40.091493 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 241/477] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Aug 30 11:44:39 2022] POST /identity/v3/users => generated 249 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:44:40.096498 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af110ca3-bbef-4972-aa54-0c3b2d80d3fd None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:40.134798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:40.284386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94dd40-64ca-4337-b498-daabfb8386da None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:40.291442 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af110ca3-bbef-4972-aa54-0c3b2d80d3fd None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:40.309050 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:40.321001 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0203c8-23dd-4b58-b43c-3f73076ae3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:40.321917 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0203c8-23dd-4b58-b43c-3f73076ae3e0 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:40.322401 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0203c8-23dd-4b58-b43c-3f73076ae3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:40.322853 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0203c8-23dd-4b58-b43c-3f73076ae3e0 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:40.323808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0203c8-23dd-4b58-b43c-3f73076ae3e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:40.325767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0203c8-23dd-4b58-b43c-3f73076ae3e0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:40.327084 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66258a96-f0d9-44ff-9824-81b1651efeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:40.327867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66258a96-f0d9-44ff-9824-81b1651efeaf None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:40.328287 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66258a96-f0d9-44ff-9824-81b1651efeaf None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:40.328624 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66258a96-f0d9-44ff-9824-81b1651efeaf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:40.340080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66258a96-f0d9-44ff-9824-81b1651efeaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:40.346150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-66258a96-f0d9-44ff-9824-81b1651efeaf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:44:40.346150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:40.346150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:40.346150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:40.346150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:40.346150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:40.346150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:40.346150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:40.346150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:40.346150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:40.346150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:40.346150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:40.346150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:40.346150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:40.346150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:40.346150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:40.347054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:40.347054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:40.347054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:40.347054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:40.347054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:40.347054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:40.347054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:40.347054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:40.347054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:40.347054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:40.347054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:40.347054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:40.347054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:40.347054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:40.347054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:40.347054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:40.347904 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:40.347904 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:40.347904 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:40.347904 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:40.347904 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:40.347904 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:40.347904 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:40.347904 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:40.347904 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:40.347904 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:40.347904 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 11:44:40.347904 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:40.350907 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 242/478] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Aug 30 11:44:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:40.355882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66258a96-f0d9-44ff-9824-81b1651efeaf None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:40.365401 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 237/479] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Aug 30 11:44:40 2022] POST /identity/v3/users => generated 248 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:44:40.489045 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66258a96-f0d9-44ff-9824-81b1651efeaf None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:40.532525 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b120a-a536-4bc2-8f08-cb86b2eb09fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:40.533508 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b120a-a536-4bc2-8f08-cb86b2eb09fb None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:40.533994 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b120a-a536-4bc2-8f08-cb86b2eb09fb None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:40.534507 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b120a-a536-4bc2-8f08-cb86b2eb09fb None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:40.535399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b120a-a536-4bc2-8f08-cb86b2eb09fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:40.535909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b120a-a536-4bc2-8f08-cb86b2eb09fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:40.537521 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b120a-a536-4bc2-8f08-cb86b2eb09fb None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:40.548099 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 243/480] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:44:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:41.413142 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb96a7-eb70-4b1f-83f2-18fe88aee8ff None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:41.413653 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb96a7-eb70-4b1f-83f2-18fe88aee8ff None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:41.413653 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb96a7-eb70-4b1f-83f2-18fe88aee8ff None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:41.415242 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 238/481] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:41.420578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4f9e8-2ec2-401f-b8fa-f37210556c09 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:41.420960 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4f9e8-2ec2-401f-b8fa-f37210556c09 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:41.421134 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4f9e8-2ec2-401f-b8fa-f37210556c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:41.443699 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-02c4f9e8-2ec2-401f-b8fa-f37210556c09 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:41.444892 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-02c4f9e8-2ec2-401f-b8fa-f37210556c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:41.484101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:41.527506 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 244/482] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:41.701284 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b56ce-2a9a-48a0-a6cb-af8c9ba18c2b None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:41.701480 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b56ce-2a9a-48a0-a6cb-af8c9ba18c2b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:41.701739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b56ce-2a9a-48a0-a6cb-af8c9ba18c2b None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:41.703583 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 239/483] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:41.708794 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be40694-aca2-4bd2-95d6-9a077e5a3d72 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:41.709145 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be40694-aca2-4bd2-95d6-9a077e5a3d72 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:41.709425 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be40694-aca2-4bd2-95d6-9a077e5a3d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:41.732601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2be40694-aca2-4bd2-95d6-9a077e5a3d72 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:41.733790 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2be40694-aca2-4bd2-95d6-9a077e5a3d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:41.811723 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 245/484] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:41.857533 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b56ce-2a9a-48a0-a6cb-af8c9ba18c2b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:41.957911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:41.988625 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b56ce-2a9a-48a0-a6cb-af8c9ba18c2b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:42.041613 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ce7bb-023a-4795-a3c3-d41370d9859b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:42.042261 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ce7bb-023a-4795-a3c3-d41370d9859b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:42.042532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ce7bb-023a-4795-a3c3-d41370d9859b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:42.042797 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ce7bb-023a-4795-a3c3-d41370d9859b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:42.057493 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ce7bb-023a-4795-a3c3-d41370d9859b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:42.063114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-7b6ce7bb-023a-4795-a3c3-d41370d9859b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:42.063114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:42.063114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:42.063114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:42.063114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:42.063114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:42.063114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:42.063114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:42.063114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:42.063114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:42.063114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:42.063114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:42.063114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:42.063114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:42.063114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:42.063114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:42.064139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:42.064139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:42.064139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:42.064139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:42.064139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:42.064139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:42.064139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:42.064139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:42.064139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:42.064139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:42.064139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:42.064139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:42.064139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:42.064139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:42.064139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:42.064139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:42.064940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:42.064940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:42.064940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:42.064940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:42.064940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:42.064940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:42.064940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:42.064940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:42.064940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:42.064940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:42.064940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:42.064940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:42.064940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 240/485] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:44:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:42.070496 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be40694-aca2-4bd2-95d6-9a077e5a3d72 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:42.132106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ce7bb-023a-4795-a3c3-d41370d9859b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:42.270551 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ce7bb-023a-4795-a3c3-d41370d9859b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:42.304665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:42.307473 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605521d5-3918-4c1d-b32f-1bc224b167b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:42.308099 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605521d5-3918-4c1d-b32f-1bc224b167b7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:42.308392 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605521d5-3918-4c1d-b32f-1bc224b167b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:42.308669 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605521d5-3918-4c1d-b32f-1bc224b167b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:42.309330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be40694-aca2-4bd2-95d6-9a077e5a3d72 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:42.316073 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:42.322775 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605521d5-3918-4c1d-b32f-1bc224b167b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:42.327737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-605521d5-3918-4c1d-b32f-1bc224b167b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:42.327737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:42.327737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:42.327737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:42.327737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:42.327737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:42.327737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:42.327737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:42.327737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:42.327737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:42.327737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:42.327737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:42.327737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:42.327737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:42.327737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:42.327737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:42.328647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:42.328647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:42.328647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:42.328647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:42.328647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:42.328647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:42.328647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:42.328647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:42.328647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:42.328647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:42.328647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:42.328647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:42.328647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:42.328647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:42.328647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:42.328647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:42.329448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:42.329448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:42.329448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:42.329448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:42.329448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:42.329448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:42.329448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:42.329448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:42.329448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:42.329448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:42.329448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:42.329448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:42.329448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 241/486] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:44:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:44:42.336562 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605521d5-3918-4c1d-b32f-1bc224b167b7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:42.391413 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e2c08-c955-49aa-a6dd-0fe305b35ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:42.391413 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e2c08-c955-49aa-a6dd-0fe305b35ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:42.391413 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e2c08-c955-49aa-a6dd-0fe305b35ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:42.391413 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e2c08-c955-49aa-a6dd-0fe305b35ec3 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:42.391836 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e2c08-c955-49aa-a6dd-0fe305b35ec3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:42.391836 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e2c08-c955-49aa-a6dd-0fe305b35ec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:42.393270 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e2c08-c955-49aa-a6dd-0fe305b35ec3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:42.417512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 246/487] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Aug 30 11:44:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:42.423114 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e2c08-c955-49aa-a6dd-0fe305b35ec3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:42.450972 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605521d5-3918-4c1d-b32f-1bc224b167b7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:42.487213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c73556-2e53-47dc-adff-c79068f3c450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:42.487985 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c73556-2e53-47dc-adff-c79068f3c450 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:42.488268 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c73556-2e53-47dc-adff-c79068f3c450 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:42.488630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c73556-2e53-47dc-adff-c79068f3c450 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:42.489259 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c73556-2e53-47dc-adff-c79068f3c450 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:42.489561 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c73556-2e53-47dc-adff-c79068f3c450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:42.491011 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c73556-2e53-47dc-adff-c79068f3c450 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:42.500220 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 242/488] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Aug 30 11:44:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:42.505640 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c73556-2e53-47dc-adff-c79068f3c450 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:42.571925 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:42.618393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e2c08-c955-49aa-a6dd-0fe305b35ec3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:42.618700 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c73556-2e53-47dc-adff-c79068f3c450 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:42.654446 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff1e9f-6a1b-4cd0-9148-381f945fe531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:42.655078 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff1e9f-6a1b-4cd0-9148-381f945fe531 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:42.655347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff1e9f-6a1b-4cd0-9148-381f945fe531 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:42.655638 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff1e9f-6a1b-4cd0-9148-381f945fe531 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:42.655757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074edecc-9393-415b-8ccb-cc061f78c618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:42.656473 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074edecc-9393-415b-8ccb-cc061f78c618 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:42.656952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074edecc-9393-415b-8ccb-cc061f78c618 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:42.657519 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074edecc-9393-415b-8ccb-cc061f78c618 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:42.666938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff1e9f-6a1b-4cd0-9148-381f945fe531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:42.668531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff1e9f-6a1b-4cd0-9148-381f945fe531 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:42.670629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074edecc-9393-415b-8ccb-cc061f78c618 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:42.672337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074edecc-9393-415b-8ccb-cc061f78c618 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:42.683461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-19ff1e9f-6a1b-4cd0-9148-381f945fe531 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:42.683461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:42.683461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:42.683461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:42.683461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:42.683461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:42.683461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:42.683461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:42.683461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:42.683461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:42.683461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:42.683461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:42.683461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:42.683461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:42.683461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:42.683461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:42.684393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:42.684393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:42.684393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:42.684393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:42.684393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:42.684393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:42.684393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:42.684393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:42.684393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:42.684393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:42.684393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:42.684393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:42.684393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:42.684393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:42.684393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:42.684393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:42.684393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:42.685237 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:42.685237 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:42.685237 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:42.688000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-074edecc-9393-415b-8ccb-cc061f78c618 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:42.688000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:42.688000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:42.688000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:42.688000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:42.688000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:42.688000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:42.688000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:42.688000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:42.688000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:42.688000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:42.688000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:42.688000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:42.688000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:42.688000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:42.688000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:42.690262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:42.690262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:42.690262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:42.690262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:42.690262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:42.690262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:42.690262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:42.690262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:42.690262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:42.690262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:42.690262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:42.690262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:42.690262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:42.690262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:42.690262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:42.690262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:42.690262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:42.692381 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:42.692381 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:42.692381 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:42.692734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 247/489] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:42.692876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 243/490] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:42.693013 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc8634-deed-4a54-8e1b-6f59b4a1fe91 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:42.693013 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc8634-deed-4a54-8e1b-6f59b4a1fe91 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:42.693013 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc8634-deed-4a54-8e1b-6f59b4a1fe91 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:42.693390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074edecc-9393-415b-8ccb-cc061f78c618 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:42.693532 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 248/491] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:42.697988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a996f-0108-4dca-aeca-2a2b34cc5207 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:42.698396 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a996f-0108-4dca-aeca-2a2b34cc5207 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:42.699401 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a996f-0108-4dca-aeca-2a2b34cc5207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:42.718652 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d29a996f-0108-4dca-aeca-2a2b34cc5207 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:42.720251 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d29a996f-0108-4dca-aeca-2a2b34cc5207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:42.731055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:42.799624 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 249/492] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:42.800864 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a996f-0108-4dca-aeca-2a2b34cc5207 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:42.802992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074edecc-9393-415b-8ccb-cc061f78c618 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:42.816755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:42.843928 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f90c6-ff7e-47e8-8e3f-7de00134d4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:42.843928 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f90c6-ff7e-47e8-8e3f-7de00134d4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:42.843928 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f90c6-ff7e-47e8-8e3f-7de00134d4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:42.843928 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f90c6-ff7e-47e8-8e3f-7de00134d4b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:42.844445 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f90c6-ff7e-47e8-8e3f-7de00134d4b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:42.844445 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f90c6-ff7e-47e8-8e3f-7de00134d4b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:42.844445 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f90c6-ff7e-47e8-8e3f-7de00134d4b8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:42.856866 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 244/493] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:42.862892 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f90c6-ff7e-47e8-8e3f-7de00134d4b8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:42.977525 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f90c6-ff7e-47e8-8e3f-7de00134d4b8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:43.024114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474dc72-80de-445e-b0d1-63f2b6c5de9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:43.024815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474dc72-80de-445e-b0d1-63f2b6c5de9e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:43.025099 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474dc72-80de-445e-b0d1-63f2b6c5de9e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:43.025424 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474dc72-80de-445e-b0d1-63f2b6c5de9e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:43.026380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a996f-0108-4dca-aeca-2a2b34cc5207 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:43.034200 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474dc72-80de-445e-b0d1-63f2b6c5de9e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:43.036163 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474dc72-80de-445e-b0d1-63f2b6c5de9e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:43.051442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9474dc72-80de-445e-b0d1-63f2b6c5de9e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:44:43.051442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:43.051442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:43.051442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:43.051442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:43.051442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:43.051442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:43.051442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:43.051442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:43.051442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:43.051442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:43.051442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:43.051442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:44:43.051442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:44:43.051442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:44:43.051442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:44:43.052372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:43.052372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:43.052372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:44:43.052372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:43.052372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:44:43.052372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:43.052372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:43.052372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:43.052372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:43.052372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:43.052372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:43.052372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:43.052372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:43.052372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:43.052372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:43.052372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:43.052372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:43.052372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:43.053269 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:43.053269 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:43.053269 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:44:43.053269 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:44:43.053269 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:44:43.053269 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:44:43.053269 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:44:43.053269 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:44:43.053269 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:44:43.053269 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:43.055498 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 245/494] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Aug 30 11:44:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:43.057016 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49406288-c19d-4597-872a-f2c4d5d40146 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:43.057303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49406288-c19d-4597-872a-f2c4d5d40146 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:43.057578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49406288-c19d-4597-872a-f2c4d5d40146 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:43.058993 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 246/495] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:43.062338 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49406288-c19d-4597-872a-f2c4d5d40146 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:43.063885 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7aeed8-c728-4f17-80fd-944271677473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:43.064713 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7aeed8-c728-4f17-80fd-944271677473 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:43.065161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7aeed8-c728-4f17-80fd-944271677473 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:43.065595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7aeed8-c728-4f17-80fd-944271677473 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:43.066410 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7aeed8-c728-4f17-80fd-944271677473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:43.066899 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7aeed8-c728-4f17-80fd-944271677473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:43.068499 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7aeed8-c728-4f17-80fd-944271677473 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:43.080762 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 250/496] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:43.082320 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1990a1-c179-4003-af11-dcebde4670aa None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:43.082774 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1990a1-c179-4003-af11-dcebde4670aa None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:43.083242 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1990a1-c179-4003-af11-dcebde4670aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:43.091341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:43.101078 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:43.102979 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-4b1990a1-c179-4003-af11-dcebde4670aa None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:43.104509 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4b1990a1-c179-4003-af11-dcebde4670aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:43.174346 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 251/497] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:43.175506 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1990a1-c179-4003-af11-dcebde4670aa None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:43.176860 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49406288-c19d-4597-872a-f2c4d5d40146 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:43.212088 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376d33b-21c2-4efd-95f2-e148ec8736a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:43.212700 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376d33b-21c2-4efd-95f2-e148ec8736a6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:43.212975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376d33b-21c2-4efd-95f2-e148ec8736a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:43.213242 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376d33b-21c2-4efd-95f2-e148ec8736a6 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:43.213958 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376d33b-21c2-4efd-95f2-e148ec8736a6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:43.214258 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376d33b-21c2-4efd-95f2-e148ec8736a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:43.216073 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376d33b-21c2-4efd-95f2-e148ec8736a6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:43.257858 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 247/498] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Aug 30 11:44:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:43.257858 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376d33b-21c2-4efd-95f2-e148ec8736a6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:43.294474 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1990a1-c179-4003-af11-dcebde4670aa None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:43.330771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b379c-bcc3-4aea-9136-23b1571d1def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:43.331506 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b379c-bcc3-4aea-9136-23b1571d1def None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:43.331704 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b379c-bcc3-4aea-9136-23b1571d1def None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:43.331974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b379c-bcc3-4aea-9136-23b1571d1def None admin] PATH_INFO: `/v3/users/glance` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:43.333906 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:43.340428 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b379c-bcc3-4aea-9136-23b1571d1def None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:43.341867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b379c-bcc3-4aea-9136-23b1571d1def None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:43.354936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:43.355097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-081b379c-bcc3-4aea-9136-23b1571d1def None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 11:44:43.355097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:43.355097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:43.355097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:43.355097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:43.355097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:43.355097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:43.355097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:43.355097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:43.355097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:43.355097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:43.355097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:43.355097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:44:43.355097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:44:43.355097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:44:43.355097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:44:43.355947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:43.355947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:43.355947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:44:43.355947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:43.355947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:44:43.355947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:43.355947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:43.355947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:43.355947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:43.355947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:43.355947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:43.355947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:43.355947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:43.355947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:43.355947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:43.355947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:43.355947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:43.355947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:43.356826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:43.356826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:43.356826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:44:43.356826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:44:43.356826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:44:43.356826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:44:43.356826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:44:43.356826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:44:43.356826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 11:44:43.356826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:43.359908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 252/499] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:43.361932 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0de4c-ec28-41f9-b7b2-9492747468e5 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:43.362568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0de4c-ec28-41f9-b7b2-9492747468e5 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:43.362848 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0de4c-ec28-41f9-b7b2-9492747468e5 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:43.364159 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 253/500] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:43.364842 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0de4c-ec28-41f9-b7b2-9492747468e5 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:43.372369 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376d33b-21c2-4efd-95f2-e148ec8736a6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:43.412379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809285f1-59d3-4c75-a924-8caa5d7cede2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:43.413029 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809285f1-59d3-4c75-a924-8caa5d7cede2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:43.413311 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809285f1-59d3-4c75-a924-8caa5d7cede2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:43.413581 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809285f1-59d3-4c75-a924-8caa5d7cede2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:43.425201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809285f1-59d3-4c75-a924-8caa5d7cede2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:43.430019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-809285f1-59d3-4c75-a924-8caa5d7cede2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:43.430019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:43.430019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:43.430019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:43.430019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:43.430019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:43.430019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:43.430019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:43.430019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:43.430019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:43.430019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:43.430019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:43.430019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:43.430019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:43.430019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:43.430019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:43.432352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:43.432352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:43.432352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:43.432352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:43.432352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:43.432352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:43.432352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:43.432352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:43.432352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:43.432352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:43.432352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:43.432352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:43.432352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:43.432352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:43.432352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:43.432352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:43.433282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:43.433282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:43.433282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:43.433282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:43.433282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:43.433282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:43.433282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:43.433282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:43.433282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:43.433282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:43.433282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:43.433282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:43.433282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 248/501] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:44:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:43.433282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809285f1-59d3-4c75-a924-8caa5d7cede2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:43.493222 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0de4c-ec28-41f9-b7b2-9492747468e5 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:43.527558 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca70b5-9b0c-4d18-96d1-2f481d5f77ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:43.528166 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca70b5-9b0c-4d18-96d1-2f481d5f77ac None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:43.528442 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca70b5-9b0c-4d18-96d1-2f481d5f77ac None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:43.528709 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca70b5-9b0c-4d18-96d1-2f481d5f77ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:43.532665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809285f1-59d3-4c75-a924-8caa5d7cede2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:43.566570 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06878b3-6e5c-4530-8de8-1ed798a15f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:43.567172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06878b3-6e5c-4530-8de8-1ed798a15f05 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:43.567499 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06878b3-6e5c-4530-8de8-1ed798a15f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:43.567769 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06878b3-6e5c-4530-8de8-1ed798a15f05 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:43.568510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06878b3-6e5c-4530-8de8-1ed798a15f05 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:43.568817 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06878b3-6e5c-4530-8de8-1ed798a15f05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:43.570244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06878b3-6e5c-4530-8de8-1ed798a15f05 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:43.587002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 249/502] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Aug 30 11:44:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:43.588182 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c540b6-994c-4bba-84d1-8452f5a37cd5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:43.588461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c540b6-994c-4bba-84d1-8452f5a37cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:43.588731 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c540b6-994c-4bba-84d1-8452f5a37cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:43.594483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:43.602799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca70b5-9b0c-4d18-96d1-2f481d5f77ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:43.604318 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca70b5-9b0c-4d18-96d1-2f481d5f77ac None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:43.607550 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-93c540b6-994c-4bba-84d1-8452f5a37cd5 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:43.608689 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-93c540b6-994c-4bba-84d1-8452f5a37cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:43.610730 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:43.674897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 250/503] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:43.675758 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c540b6-994c-4bba-84d1-8452f5a37cd5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:43.710459 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 254/504] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:43.711585 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca70b5-9b0c-4d18-96d1-2f481d5f77ac None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:43.793539 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c540b6-994c-4bba-84d1-8452f5a37cd5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:43.814625 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:43.822065 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca70b5-9b0c-4d18-96d1-2f481d5f77ac None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:43.839030 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7bac4-d7d4-42c1-a95c-e133353bf5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:43.840077 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7bac4-d7d4-42c1-a95c-e133353bf5f8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:43.840359 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7bac4-d7d4-42c1-a95c-e133353bf5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:43.840630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7bac4-d7d4-42c1-a95c-e133353bf5f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:43.851049 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:43.854378 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7bac4-d7d4-42c1-a95c-e133353bf5f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:43.860351 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673693e-152e-4810-969b-45d65b2d493a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:43.861185 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673693e-152e-4810-969b-45d65b2d493a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:43.861646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673693e-152e-4810-969b-45d65b2d493a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:43.862078 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673693e-152e-4810-969b-45d65b2d493a None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:43.862620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-eab7bac4-d7d4-42c1-a95c-e133353bf5f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:43.862620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:43.862620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:43.862620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:43.862620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:43.862620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:43.862620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:43.862620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:43.862620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:43.862620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:43.862620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:43.862620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:43.862620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:43.862620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:43.862620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:43.862620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:43.863691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:43.863691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:43.863691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:43.863691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:43.863691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:43.863691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:43.863691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:43.863691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:43.863691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:43.863691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:43.863691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:43.863691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:43.863691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:43.863691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:43.863691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:43.863691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:43.864652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:43.864652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:43.864652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:43.864652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:43.864652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:43.864652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:43.864652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:43.864652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:43.864652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:43.864652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:43.864652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:43.864652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:43.864652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 251/505] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:44:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:43.865429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7bac4-d7d4-42c1-a95c-e133353bf5f8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:43.866104 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673693e-152e-4810-969b-45d65b2d493a None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:43.866415 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673693e-152e-4810-969b-45d65b2d493a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:43.867842 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673693e-152e-4810-969b-45d65b2d493a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:43.878624 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 255/506] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Aug 30 11:44:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:43.879490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673693e-152e-4810-969b-45d65b2d493a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:43.984515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673693e-152e-4810-969b-45d65b2d493a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:43.985598 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7bac4-d7d4-42c1-a95c-e133353bf5f8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:44.017727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9536d0-0625-4225-aeef-c3641a4adb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:44.018350 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9536d0-0625-4225-aeef-c3641a4adb5a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:44.018621 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9536d0-0625-4225-aeef-c3641a4adb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:44.018885 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9536d0-0625-4225-aeef-c3641a4adb5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:44.020712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463aebe-06b8-4ba0-a1cf-9ce95d9c532a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:44.021553 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463aebe-06b8-4ba0-a1cf-9ce95d9c532a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:44.021659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463aebe-06b8-4ba0-a1cf-9ce95d9c532a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:44.021857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463aebe-06b8-4ba0-a1cf-9ce95d9c532a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:44.029149 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9536d0-0625-4225-aeef-c3641a4adb5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:44.030610 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9536d0-0625-4225-aeef-c3641a4adb5a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:44.044707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-7d9536d0-0625-4225-aeef-c3641a4adb5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:44.044707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:44.044707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:44.044707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:44.044707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:44.044707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:44.044707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:44.044707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:44.044707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:44.044707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:44.044707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:44.044707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:44.044707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:44.044707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:44.044707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:44.044707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:44.045808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:44.045808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:44.045808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:44.045808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:44.045808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:44.045808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:44.045808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:44.045808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:44.045808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:44.045808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:44.045808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:44.045808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:44.045808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:44.045808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:44.045808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:44.045808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:44.045808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:44.047341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:44.047341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:44.047341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:44.047341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 256/507] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:44.047341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9536d0-0625-4225-aeef-c3641a4adb5a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:44.057914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:44.088585 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:44.092368 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463aebe-06b8-4ba0-a1cf-9ce95d9c532a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:44.096411 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463aebe-06b8-4ba0-a1cf-9ce95d9c532a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:44.152400 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9536d0-0625-4225-aeef-c3641a4adb5a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:44.189007 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1d8f1-49e7-4e03-a455-0c83ff93af9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:44.189592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1d8f1-49e7-4e03-a455-0c83ff93af9f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:44.189866 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1d8f1-49e7-4e03-a455-0c83ff93af9f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:44.190137 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1d8f1-49e7-4e03-a455-0c83ff93af9f None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:44.190795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1d8f1-49e7-4e03-a455-0c83ff93af9f None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:44.191095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1d8f1-49e7-4e03-a455-0c83ff93af9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:44.192552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1d8f1-49e7-4e03-a455-0c83ff93af9f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:44.200948 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 257/508] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Aug 30 11:44:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:44.201406 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 252/509] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:44.202125 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1d8f1-49e7-4e03-a455-0c83ff93af9f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:44.202225 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463aebe-06b8-4ba0-a1cf-9ce95d9c532a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:44.278025 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:44.302680 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:44.306795 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463aebe-06b8-4ba0-a1cf-9ce95d9c532a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:44.309871 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1d8f1-49e7-4e03-a455-0c83ff93af9f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:44.340034 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc99b0e-754a-40db-8f82-8a745650c087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:44.340664 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc99b0e-754a-40db-8f82-8a745650c087 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:44.340939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc99b0e-754a-40db-8f82-8a745650c087 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:44.341207 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc99b0e-754a-40db-8f82-8a745650c087 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:44.344535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c43f71-3632-4638-b3d0-6acb4297b46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:44.345167 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c43f71-3632-4638-b3d0-6acb4297b46e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:44.345452 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c43f71-3632-4638-b3d0-6acb4297b46e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:44.345730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c43f71-3632-4638-b3d0-6acb4297b46e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:44.351244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc99b0e-754a-40db-8f82-8a745650c087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:44.352726 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc99b0e-754a-40db-8f82-8a745650c087 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:44.356718 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c43f71-3632-4638-b3d0-6acb4297b46e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:44.358164 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c43f71-3632-4638-b3d0-6acb4297b46e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:44.367787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-8cc99b0e-754a-40db-8f82-8a745650c087 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:44.367787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:44.367787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:44.367787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:44.367787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:44.367787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:44.367787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:44.367787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:44.367787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:44.367787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:44.367787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:44.367787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:44.367787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:44.367787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:44.367787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:44.367787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:44.368878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:44.368878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:44.368878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:44.368878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:44.368878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:44.368878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:44.368878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:44.368878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:44.368878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:44.368878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:44.368878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:44.368878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:44.368878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:44.368878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:44.368878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:44.368878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:44.368878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:44.369781 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:44.369781 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:44.369781 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:44.370152 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 253/510] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:44.371114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc99b0e-754a-40db-8f82-8a745650c087 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:44.372744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-40c43f71-3632-4638-b3d0-6acb4297b46e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:44.372744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:44.372744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:44.372744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:44.372744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:44.372744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:44.372744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:44.372744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:44.372744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:44.372744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:44.372744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:44.372744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:44.372744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:44.372744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:44.372744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:44.372744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:44.373611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:44.373611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:44.373611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:44.373611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:44.373611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:44.373611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:44.373611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:44.373611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:44.373611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:44.373611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:44.373611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:44.373611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:44.373611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:44.373611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:44.373611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:44.373611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:44.373611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:44.374451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:44.374451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:44.374451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:44.378987 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 258/511] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:44.379739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c43f71-3632-4638-b3d0-6acb4297b46e None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:44.473383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc99b0e-754a-40db-8f82-8a745650c087 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:44.479418 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c43f71-3632-4638-b3d0-6acb4297b46e None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:44.502097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:44.508430 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81922c-a004-464a-8159-84b3e46c9282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:44.509064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81922c-a004-464a-8159-84b3e46c9282 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:44.509342 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81922c-a004-464a-8159-84b3e46c9282 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:44.509613 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81922c-a004-464a-8159-84b3e46c9282 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:44.510248 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81922c-a004-464a-8159-84b3e46c9282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:44.510549 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81922c-a004-464a-8159-84b3e46c9282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:44.511963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81922c-a004-464a-8159-84b3e46c9282 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:44.513470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cab5c-a2cc-4c82-a17d-c0444ff95a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:44.514100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cab5c-a2cc-4c82-a17d-c0444ff95a91 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:44.514375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cab5c-a2cc-4c82-a17d-c0444ff95a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:44.514628 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cab5c-a2cc-4c82-a17d-c0444ff95a91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:44.523784 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 254/512] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:44.524558 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81922c-a004-464a-8159-84b3e46c9282 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:44.525079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9cab5c-a2cc-4c82-a17d-c0444ff95a91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:44.526526 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9cab5c-a2cc-4c82-a17d-c0444ff95a91 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:44.537875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:44.541381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-9c9cab5c-a2cc-4c82-a17d-c0444ff95a91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:44.541381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:44.541381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:44.541381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:44.541381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:44.541381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:44.541381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:44.541381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:44.541381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:44.541381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:44.541381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:44.541381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:44.541381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:44.541381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:44.541381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:44.541381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:44.542574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:44.542574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:44.542574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:44.542574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:44.542574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:44.542574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:44.542574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:44.542574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:44.542574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:44.542574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:44.542574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:44.542574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:44.542574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:44.542574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:44.542574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:44.542574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:44.542574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:44.543478 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:44.543478 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:44.543478 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:44.543478 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 259/513] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:44.543478 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cab5c-a2cc-4c82-a17d-c0444ff95a91 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:44.631301 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81922c-a004-464a-8159-84b3e46c9282 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:44.644232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cab5c-a2cc-4c82-a17d-c0444ff95a91 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:44.665025 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc0341-c109-40f8-967e-3f4c5544fba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:44.665665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc0341-c109-40f8-967e-3f4c5544fba5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:44.665937 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc0341-c109-40f8-967e-3f4c5544fba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:44.666206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc0341-c109-40f8-967e-3f4c5544fba5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:44.677169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc0341-c109-40f8-967e-3f4c5544fba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:44.678628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc0341-c109-40f8-967e-3f4c5544fba5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:44.679553 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8c056-ad58-4f59-8012-3f690194bbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:44.680166 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8c056-ad58-4f59-8012-3f690194bbbe None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:44.680447 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8c056-ad58-4f59-8012-3f690194bbbe None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:44.680713 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8c056-ad58-4f59-8012-3f690194bbbe None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:44.681348 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8c056-ad58-4f59-8012-3f690194bbbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:44.681648 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8c056-ad58-4f59-8012-3f690194bbbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:44.683018 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8c056-ad58-4f59-8012-3f690194bbbe None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:44.693196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-e6fc0341-c109-40f8-967e-3f4c5544fba5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:44.693196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:44.693196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:44.693196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:44.693196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:44.693196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:44.693196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:44.693196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:44.693196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:44.693196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:44.693196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:44.693196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:44.693196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:44.693196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:44.693196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:44.693196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:44.694169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:44.694169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:44.694169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:44.694169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:44.694169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:44.694169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:44.694169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:44.694169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:44.694169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:44.694169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:44.694169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:44.694169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:44.694169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:44.694169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:44.694169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:44.694169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:44.694169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:44.695007 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:44.695007 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:44.695007 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:44.695007 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 255/514] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:44.695228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc0341-c109-40f8-967e-3f4c5544fba5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:44.696788 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 260/515] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:44.697773 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8c056-ad58-4f59-8012-3f690194bbbe None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:44.734649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:44.756505 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:44.794763 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc0341-c109-40f8-967e-3f4c5544fba5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:44.801801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8c056-ad58-4f59-8012-3f690194bbbe None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:44.826935 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4953d1-b262-4162-8240-5ba8db0abacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:44.827578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4953d1-b262-4162-8240-5ba8db0abacb None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:44.827854 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4953d1-b262-4162-8240-5ba8db0abacb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:44.828168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4953d1-b262-4162-8240-5ba8db0abacb None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:44.828800 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4953d1-b262-4162-8240-5ba8db0abacb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:44.829096 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4953d1-b262-4162-8240-5ba8db0abacb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:44.830490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4953d1-b262-4162-8240-5ba8db0abacb None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:44.835024 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d590e-8dad-4580-9dc3-47bf8fea2822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:44.835681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d590e-8dad-4580-9dc3-47bf8fea2822 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:44.835957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d590e-8dad-4580-9dc3-47bf8fea2822 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:44.836223 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d590e-8dad-4580-9dc3-47bf8fea2822 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:44.842298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 256/516] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:44.842881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4953d1-b262-4162-8240-5ba8db0abacb None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:44.844409 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d590e-8dad-4580-9dc3-47bf8fea2822 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:44.846117 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d590e-8dad-4580-9dc3-47bf8fea2822 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:44.858288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-8f2d590e-8dad-4580-9dc3-47bf8fea2822 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:44.858288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:44.858288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:44.858288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:44.858288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:44.858288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:44.858288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:44.858288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:44.858288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:44.858288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:44.858288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:44.858288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:44.858288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:44:44.858288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:44:44.858288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:44:44.859239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:44:44.859239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:44.859239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:44.859239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:44.859239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:44.859239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:44.859239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:44.859239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:44.859239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:44.859239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:44.859239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:44.859239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:44.859239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:44.859239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:44.859239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:44.859239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:44.859239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:44.860333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:44:44.860333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:44:44.860333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:44:44.860333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:44:44.860333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:44:44.860333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:44:44.860333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:44.860333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:44.860333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 261/517] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:44:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:44.860333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d590e-8dad-4580-9dc3-47bf8fea2822 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:44.943208 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4953d1-b262-4162-8240-5ba8db0abacb None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:44.953982 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:44.961483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d590e-8dad-4580-9dc3-47bf8fea2822 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:44.966199 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:44.977905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d841d51-874a-4982-94f9-024be73570b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:44.978522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d841d51-874a-4982-94f9-024be73570b1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:44.978799 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d841d51-874a-4982-94f9-024be73570b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:44.979068 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d841d51-874a-4982-94f9-024be73570b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:44.979739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d841d51-874a-4982-94f9-024be73570b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:44.980040 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d841d51-874a-4982-94f9-024be73570b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:44.981424 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d841d51-874a-4982-94f9-024be73570b1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:44.993194 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 257/518] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:44.993877 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d841d51-874a-4982-94f9-024be73570b1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:44.995730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d8bdc-f336-45db-a97d-202094ec7b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:44.996449 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d8bdc-f336-45db-a97d-202094ec7b01 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:44.996723 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d8bdc-f336-45db-a97d-202094ec7b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:44.997019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d8bdc-f336-45db-a97d-202094ec7b01 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:44.997732 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d8bdc-f336-45db-a97d-202094ec7b01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:44.998026 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d8bdc-f336-45db-a97d-202094ec7b01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:44.999434 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d8bdc-f336-45db-a97d-202094ec7b01 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:45.011281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 262/519] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:45.012096 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d8bdc-f336-45db-a97d-202094ec7b01 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:45.092201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d841d51-874a-4982-94f9-024be73570b1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:45.115307 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d8bdc-f336-45db-a97d-202094ec7b01 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:45.132255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f272b6a-5203-454f-bbe5-e55147f13437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:45.132860 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f272b6a-5203-454f-bbe5-e55147f13437 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:45.133140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f272b6a-5203-454f-bbe5-e55147f13437 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:45.133413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f272b6a-5203-454f-bbe5-e55147f13437 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:45.134063 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f272b6a-5203-454f-bbe5-e55147f13437 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:45.135554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f272b6a-5203-454f-bbe5-e55147f13437 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:45.149010 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961ca79-8b69-4941-ba27-f4c0a1e22834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:45.149773 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961ca79-8b69-4941-ba27-f4c0a1e22834 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:45.150050 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961ca79-8b69-4941-ba27-f4c0a1e22834 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:45.150328 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961ca79-8b69-4941-ba27-f4c0a1e22834 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:45.157522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 258/520] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Aug 30 11:44:44 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:44:45.158350 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f272b6a-5203-454f-bbe5-e55147f13437 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:45.158574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961ca79-8b69-4941-ba27-f4c0a1e22834 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:45.160077 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961ca79-8b69-4941-ba27-f4c0a1e22834 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:45.175605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-2961ca79-8b69-4941-ba27-f4c0a1e22834 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 11:44:45.175605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:45.175605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:45.175605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:45.175605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:45.175605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:45.175605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:45.175605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:45.175605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:45.175605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:45.175605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:45.175605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:45.175605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:44:45.175605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:44:45.175605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:44:45.175605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:44:45.176623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:45.176623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:45.176623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:44:45.176623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:45.176623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:44:45.176623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:45.176623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:45.176623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:45.176623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:45.176623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:45.176623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:45.176623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:45.176623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:45.176623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:45.176623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:45.176623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:45.176623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:45.176623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:45.177569 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:45.177569 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:45.177569 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:44:45.177569 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:44:45.177569 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:44:45.177569 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:44:45.177569 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:44:45.177569 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:44:45.177569 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 11:44:45.177569 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:45.177569 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 263/521] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:44:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:45.179327 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961ca79-8b69-4941-ba27-f4c0a1e22834 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:45.196545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:45.210995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:45.280614 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f272b6a-5203-454f-bbe5-e55147f13437 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:45.296008 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961ca79-8b69-4941-ba27-f4c0a1e22834 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:45.321140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e9127-1c12-4440-bdf2-0d3f381e00d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:45.322753 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e9127-1c12-4440-bdf2-0d3f381e00d1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:45.322753 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e9127-1c12-4440-bdf2-0d3f381e00d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:45.322753 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e9127-1c12-4440-bdf2-0d3f381e00d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:45.323106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e9127-1c12-4440-bdf2-0d3f381e00d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:45.323322 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e9127-1c12-4440-bdf2-0d3f381e00d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:45.324786 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e9127-1c12-4440-bdf2-0d3f381e00d1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:45.336909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd082d99-f334-4abb-b4b2-a1790114b855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:45.337540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd082d99-f334-4abb-b4b2-a1790114b855 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:45.337814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd082d99-f334-4abb-b4b2-a1790114b855 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:45.338081 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd082d99-f334-4abb-b4b2-a1790114b855 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:45.344104 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 259/522] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:44:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:45.345042 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e9127-1c12-4440-bdf2-0d3f381e00d1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:45.347632 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd082d99-f334-4abb-b4b2-a1790114b855 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:45.350314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd082d99-f334-4abb-b4b2-a1790114b855 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:45.363863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-bd082d99-f334-4abb-b4b2-a1790114b855 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 11:44:45.363863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:45.363863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:45.363863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:45.363863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:45.363863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:45.363863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:45.363863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:45.363863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:45.363863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:45.363863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:45.363863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:45.363863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:44:45.363863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:44:45.363863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:44:45.363863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:44:45.364805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:45.364805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:45.364805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:44:45.364805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:45.364805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:44:45.364805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:45.364805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:45.364805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:45.364805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:45.364805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:45.364805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:45.364805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:45.364805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:45.364805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:45.364805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:45.364805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:45.364805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:45.364805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:45.365689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:45.365689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:45.365689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:44:45.365689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:44:45.365689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:44:45.365689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:44:45.365689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:44:45.365689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:44:45.365689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 11:44:45.365689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:45.365689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 264/523] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:45.366372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd082d99-f334-4abb-b4b2-a1790114b855 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:45.443386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:45.455912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:45.460483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e9127-1c12-4440-bdf2-0d3f381e00d1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:45.471922 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd082d99-f334-4abb-b4b2-a1790114b855 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:45.496575 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cb192-ce49-4bf4-88cb-f18007bd0b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:45.497624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cb192-ce49-4bf4-88cb-f18007bd0b15 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:45.497998 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cb192-ce49-4bf4-88cb-f18007bd0b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:45.498368 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cb192-ce49-4bf4-88cb-f18007bd0b15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:45.505915 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037cb192-ce49-4bf4-88cb-f18007bd0b15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:45.506267 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f06d1a-39a4-480b-90d5-8c5506105d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:45.506948 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f06d1a-39a4-480b-90d5-8c5506105d0e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:45.507283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f06d1a-39a4-480b-90d5-8c5506105d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:45.507661 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f06d1a-39a4-480b-90d5-8c5506105d0e None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:45.507752 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037cb192-ce49-4bf4-88cb-f18007bd0b15 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:45.508503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f06d1a-39a4-480b-90d5-8c5506105d0e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:45.508865 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f06d1a-39a4-480b-90d5-8c5506105d0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:45.510378 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f06d1a-39a4-480b-90d5-8c5506105d0e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:45.520538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-037cb192-ce49-4bf4-88cb-f18007bd0b15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:45.520538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:45.520538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:45.520538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:45.520538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:45.520538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:45.520538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:45.520538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:45.520538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:45.520538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:45.520538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:45.520538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:45.520538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:44:45.520538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:44:45.520538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:44:45.521510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:44:45.521510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:45.521510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:45.521510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:45.521510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:45.521510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:45.521510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:45.521510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:45.521510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:45.521510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:45.521510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:45.521510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:45.521510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:45.521510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:45.521510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:45.521510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:45.521510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:45.522373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:44:45.522373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:44:45.522373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:44:45.522373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:44:45.522373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:44:45.522373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:44:45.522373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:45.522373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:45.523531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 260/524] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:44:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:45.523531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cb192-ce49-4bf4-88cb-f18007bd0b15 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:45.554812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 265/525] 10.222.0.27 () {56 vars in 1139 bytes} [Tue Aug 30 11:44:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:45.555700 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f06d1a-39a4-480b-90d5-8c5506105d0e None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:45.633199 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cb192-ce49-4bf4-88cb-f18007bd0b15 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:45.657974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f06d1a-39a4-480b-90d5-8c5506105d0e None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:45.669035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a111b0-7d98-4c23-a8f1-e52be4d05db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:45.669646 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a111b0-7d98-4c23-a8f1-e52be4d05db3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:45.670034 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a111b0-7d98-4c23-a8f1-e52be4d05db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:45.670186 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a111b0-7d98-4c23-a8f1-e52be4d05db3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:45.670905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a111b0-7d98-4c23-a8f1-e52be4d05db3 None admin] RBAC: Adding query filter params (role.id=eec5decc24ab4673a246120350336b1e, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=8d17f1d0577a41ed8859706073f79d77) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:45.671284 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a111b0-7d98-4c23-a8f1-e52be4d05db3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:45.672820 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a111b0-7d98-4c23-a8f1-e52be4d05db3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:45.687400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 261/526] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:44:45 2022] GET /identity/v3/role_assignments?user.id=8d17f1d0577a41ed8859706073f79d77&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=eec5decc24ab4673a246120350336b1e => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:45.687400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a111b0-7d98-4c23-a8f1-e52be4d05db3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:45.693709 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:45.703547 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1f0bb-dc58-4e8d-affb-c73ebc9cf7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:45.704374 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1f0bb-dc58-4e8d-affb-c73ebc9cf7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:45.704740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1f0bb-dc58-4e8d-affb-c73ebc9cf7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:45.705240 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1f0bb-dc58-4e8d-affb-c73ebc9cf7e2 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:45.705934 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1f0bb-dc58-4e8d-affb-c73ebc9cf7e2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:45.706298 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1f0bb-dc58-4e8d-affb-c73ebc9cf7e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:45.707970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1f0bb-dc58-4e8d-affb-c73ebc9cf7e2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:45.720185 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:45.733390 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 266/527] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Aug 30 11:44:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:45.734609 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1f0bb-dc58-4e8d-affb-c73ebc9cf7e2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:45.810082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a111b0-7d98-4c23-a8f1-e52be4d05db3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:45.849896 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1f0bb-dc58-4e8d-affb-c73ebc9cf7e2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:45.851804 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00bd65-82d2-4e6d-9cd6-6e2fa0e1ebb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:45.852641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00bd65-82d2-4e6d-9cd6-6e2fa0e1ebb0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:45.853083 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00bd65-82d2-4e6d-9cd6-6e2fa0e1ebb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:45.853357 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00bd65-82d2-4e6d-9cd6-6e2fa0e1ebb0 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:45.854152 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00bd65-82d2-4e6d-9cd6-6e2fa0e1ebb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:45.854466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00bd65-82d2-4e6d-9cd6-6e2fa0e1ebb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:45.855988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00bd65-82d2-4e6d-9cd6-6e2fa0e1ebb0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:45.871183 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 262/528] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:44:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:45.872004 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00bd65-82d2-4e6d-9cd6-6e2fa0e1ebb0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:45.891075 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa485e5-e804-41b7-8fc7-e0348172414e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:45.891806 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa485e5-e804-41b7-8fc7-e0348172414e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:45.892087 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa485e5-e804-41b7-8fc7-e0348172414e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:45.892360 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa485e5-e804-41b7-8fc7-e0348172414e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:45.955422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:45.972057 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa485e5-e804-41b7-8fc7-e0348172414e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:45.974662 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:45.975420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa485e5-e804-41b7-8fc7-e0348172414e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:45.994815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00bd65-82d2-4e6d-9cd6-6e2fa0e1ebb0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:46.032748 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e7458-dc46-4eeb-b061-54cf056949e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:46.033369 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e7458-dc46-4eeb-b061-54cf056949e1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:46.033648 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e7458-dc46-4eeb-b061-54cf056949e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:46.033920 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e7458-dc46-4eeb-b061-54cf056949e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:46.108943 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e7458-dc46-4eeb-b061-54cf056949e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:46.108943 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e7458-dc46-4eeb-b061-54cf056949e1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:46.110571 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 267/529] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:46.112835 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa485e5-e804-41b7-8fc7-e0348172414e None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:46.201486 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:46.226018 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 263/530] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:46.226909 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e7458-dc46-4eeb-b061-54cf056949e1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:46.242641 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:46.256193 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa485e5-e804-41b7-8fc7-e0348172414e None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:46.303473 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dade79-04a8-4b70-9028-a9131f3b7a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:46.304468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dade79-04a8-4b70-9028-a9131f3b7a16 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:46.304940 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dade79-04a8-4b70-9028-a9131f3b7a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:46.305410 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dade79-04a8-4b70-9028-a9131f3b7a16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:46.306350 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dade79-04a8-4b70-9028-a9131f3b7a16 None admin] RBAC: Adding query filter params (role.id=eec5decc24ab4673a246120350336b1e, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=c6682c22be8c4bdca4be33a93e802409) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:46.307226 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dade79-04a8-4b70-9028-a9131f3b7a16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:46.309390 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dade79-04a8-4b70-9028-a9131f3b7a16 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:46.317304 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 268/531] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:44:46 2022] GET /identity/v3/role_assignments?user.id=c6682c22be8c4bdca4be33a93e802409&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=eec5decc24ab4673a246120350336b1e => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:46.318320 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dade79-04a8-4b70-9028-a9131f3b7a16 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:46.359923 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e7458-dc46-4eeb-b061-54cf056949e1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:46.441000 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dade79-04a8-4b70-9028-a9131f3b7a16 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:46.460788 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07c52c-6c0e-4d0a-afe5-989112a613df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:46.461634 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07c52c-6c0e-4d0a-afe5-989112a613df None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:46.461768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07c52c-6c0e-4d0a-afe5-989112a613df None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:46.462011 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07c52c-6c0e-4d0a-afe5-989112a613df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:46.481533 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe6775-2cb2-4404-a1b2-e0f682db3059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:46.483033 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe6775-2cb2-4404-a1b2-e0f682db3059 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:46.483561 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe6775-2cb2-4404-a1b2-e0f682db3059 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:46.484166 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe6775-2cb2-4404-a1b2-e0f682db3059 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:46.488233 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07c52c-6c0e-4d0a-afe5-989112a613df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:46.489711 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07c52c-6c0e-4d0a-afe5-989112a613df None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:46.497521 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe6775-2cb2-4404-a1b2-e0f682db3059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:46.499380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe6775-2cb2-4404-a1b2-e0f682db3059 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:46.517268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-8bfe6775-2cb2-4404-a1b2-e0f682db3059 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:46.517268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:46.517268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:46.517268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:46.517268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:46.517268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:46.517268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:46.517268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:46.517268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:46.517268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:46.517268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:46.517268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:46.517268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:46.517268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:46.517268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:46.517268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:46.518690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:46.518690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:46.518690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:46.518690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:46.518690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:46.518690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:46.518690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:46.518690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:46.518690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:46.518690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:46.518690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:46.518690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:46.518690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:46.518690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:46.518690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:46.518690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:46.518690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:46.519573 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:46.519573 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:46.519573 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:46.521610 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 269/532] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:46.531389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9d07c52c-6c0e-4d0a-afe5-989112a613df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:46.531389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:46.531389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:46.531389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:46.531389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:46.531389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:46.531389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:46.531389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:46.531389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:46.531389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:46.531389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:46.531389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:46.531389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:46.531389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:46.531389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:46.531389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:46.532349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:46.532349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:46.532349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:46.532349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:46.532349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:46.532349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:46.532349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:46.532349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:46.532349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:46.532349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:46.532349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:46.532349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:46.532349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:46.532349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:46.532349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:46.532349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:46.532349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:46.533213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:46.533213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:46.533213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:46.533213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 264/533] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:46.534622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe6775-2cb2-4404-a1b2-e0f682db3059 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:46.535049 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07c52c-6c0e-4d0a-afe5-989112a613df None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:46.545730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:46.626272 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:46.648675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe6775-2cb2-4404-a1b2-e0f682db3059 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:46.685490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fe253-cc36-4172-a978-131b6e1ddef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:46.686489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fe253-cc36-4172-a978-131b6e1ddef3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:46.686959 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fe253-cc36-4172-a978-131b6e1ddef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:46.687573 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fe253-cc36-4172-a978-131b6e1ddef3 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:46.688429 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fe253-cc36-4172-a978-131b6e1ddef3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:46.689095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fe253-cc36-4172-a978-131b6e1ddef3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:46.690711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fe253-cc36-4172-a978-131b6e1ddef3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:46.704416 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 270/534] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:46.709684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fe253-cc36-4172-a978-131b6e1ddef3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:46.783712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:46.795239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07c52c-6c0e-4d0a-afe5-989112a613df None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:46.814212 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fe253-cc36-4172-a978-131b6e1ddef3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:46.861896 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c30c8f-5744-4093-9c31-2f84e046851f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:46.862537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c30c8f-5744-4093-9c31-2f84e046851f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:46.862820 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c30c8f-5744-4093-9c31-2f84e046851f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:46.863094 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c30c8f-5744-4093-9c31-2f84e046851f None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:46.863789 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c30c8f-5744-4093-9c31-2f84e046851f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:46.864096 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c30c8f-5744-4093-9c31-2f84e046851f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:46.865511 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c30c8f-5744-4093-9c31-2f84e046851f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:46.867110 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8e5b8-8d65-4f3e-8795-8d6380f8ec0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:46.867794 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8e5b8-8d65-4f3e-8795-8d6380f8ec0e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:46.868069 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8e5b8-8d65-4f3e-8795-8d6380f8ec0e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:46.868336 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8e5b8-8d65-4f3e-8795-8d6380f8ec0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:46.878054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8e5b8-8d65-4f3e-8795-8d6380f8ec0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:46.879470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8e5b8-8d65-4f3e-8795-8d6380f8ec0e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:46.894789 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 265/535] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:46.900245 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c30c8f-5744-4093-9c31-2f84e046851f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:46.904592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-e2a8e5b8-8d65-4f3e-8795-8d6380f8ec0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:46.904592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:46.904592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:46.904592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:46.904592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:46.904592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:46.904592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:46.904592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:46.904592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:46.904592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:46.904592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:46.904592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:46.904592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:44:46.904592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:44:46.904592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:44:46.905484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:44:46.905484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:46.905484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:46.905484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:46.905484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:46.905484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:46.905484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:46.905484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:46.905484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:46.905484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:46.905484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:46.905484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:46.905484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:46.905484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:46.905484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:46.905484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:46.905484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:46.906872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:44:46.906872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:44:46.906872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:44:46.906872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:44:46.906872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:44:46.906872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:44:46.906872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:46.906872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:46.906872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 271/536] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:44:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:44:46.913002 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8e5b8-8d65-4f3e-8795-8d6380f8ec0e None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:47.060670 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8e5b8-8d65-4f3e-8795-8d6380f8ec0e None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:47.080557 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c30c8f-5744-4093-9c31-2f84e046851f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:47.082699 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:47.118175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:47.131863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a081d7-69c1-4bb2-8ec5-b734a82a475f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:47.132619 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a081d7-69c1-4bb2-8ec5-b734a82a475f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:47.132911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a081d7-69c1-4bb2-8ec5-b734a82a475f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:47.133193 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a081d7-69c1-4bb2-8ec5-b734a82a475f None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:47.135004 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a081d7-69c1-4bb2-8ec5-b734a82a475f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:47.135318 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a081d7-69c1-4bb2-8ec5-b734a82a475f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:47.136810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a081d7-69c1-4bb2-8ec5-b734a82a475f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:47.146813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115215db-4942-4fd6-837b-0588443d6f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:47.147478 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115215db-4942-4fd6-837b-0588443d6f60 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:47.147810 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115215db-4942-4fd6-837b-0588443d6f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:47.148088 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115215db-4942-4fd6-837b-0588443d6f60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:47.165831 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115215db-4942-4fd6-837b-0588443d6f60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:47.167327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115215db-4942-4fd6-837b-0588443d6f60 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:47.177424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 272/537] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:44:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:47.182729 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a081d7-69c1-4bb2-8ec5-b734a82a475f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:47.194264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-115215db-4942-4fd6-837b-0588443d6f60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:47.194264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:47.194264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:47.194264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:47.194264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:47.194264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:47.194264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:47.194264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:47.194264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:47.194264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:47.194264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:47.194264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:47.194264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:44:47.194264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:44:47.194264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:44:47.195214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:44:47.195214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:47.195214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:47.195214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:47.195214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:47.195214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:47.195214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:47.195214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:47.195214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:47.195214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:47.195214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:47.195214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:47.195214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:47.195214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:47.195214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:47.195214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:47.195214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:47.196129 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:44:47.196129 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:44:47.196129 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:44:47.196129 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:44:47.196129 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:44:47.196129 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:44:47.196129 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:47.196129 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:47.197131 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 266/538] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:44:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:47.201240 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115215db-4942-4fd6-837b-0588443d6f60 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:47.306221 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a081d7-69c1-4bb2-8ec5-b734a82a475f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:47.308501 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115215db-4942-4fd6-837b-0588443d6f60 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:47.343879 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137238a-352d-4bc0-8e55-46d1e32dc5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:47.344482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137238a-352d-4bc0-8e55-46d1e32dc5ab None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:47.344754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137238a-352d-4bc0-8e55-46d1e32dc5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:47.345020 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137238a-352d-4bc0-8e55-46d1e32dc5ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:47.345728 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137238a-352d-4bc0-8e55-46d1e32dc5ab None admin] RBAC: Adding query filter params (role.id=eec5decc24ab4673a246120350336b1e, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=b9bbec99965e4444bcf88a32502b3257) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:47.346028 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137238a-352d-4bc0-8e55-46d1e32dc5ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:47.347534 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137238a-352d-4bc0-8e55-46d1e32dc5ab None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:47.348509 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6128a6-c15a-4559-84c9-5d40345c8880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:47.349288 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6128a6-c15a-4559-84c9-5d40345c8880 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:47.349672 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6128a6-c15a-4559-84c9-5d40345c8880 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:47.350005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6128a6-c15a-4559-84c9-5d40345c8880 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:47.350838 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6128a6-c15a-4559-84c9-5d40345c8880 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:47.351142 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6128a6-c15a-4559-84c9-5d40345c8880 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:47.352660 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6128a6-c15a-4559-84c9-5d40345c8880 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:47.359891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 273/539] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:44:47 2022] GET /identity/v3/role_assignments?user.id=b9bbec99965e4444bcf88a32502b3257&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=eec5decc24ab4673a246120350336b1e => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:47.361362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d0eec-1514-474e-9007-4c56f8363cc7 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:47.361649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d0eec-1514-474e-9007-4c56f8363cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:47.361919 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d0eec-1514-474e-9007-4c56f8363cc7 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:47.363581 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 274/540] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:47.365793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 267/541] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:44:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:47.371664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d0eec-1514-474e-9007-4c56f8363cc7 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:47.372881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4060021-debc-40b7-bc74-41f33aec799f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:47.373235 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4060021-debc-40b7-bc74-41f33aec799f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:47.373514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4060021-debc-40b7-bc74-41f33aec799f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:47.393408 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c4060021-debc-40b7-bc74-41f33aec799f None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:47.394711 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c4060021-debc-40b7-bc74-41f33aec799f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:47.412186 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:47.476086 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 268/542] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:44:47.479276 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:47.553225 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d0eec-1514-474e-9007-4c56f8363cc7 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:47.592991 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894185c4-a469-4aa4-8d2e-d6941322d250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:47.593648 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894185c4-a469-4aa4-8d2e-d6941322d250 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:47.593996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894185c4-a469-4aa4-8d2e-d6941322d250 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:47.594310 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894185c4-a469-4aa4-8d2e-d6941322d250 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:47.595039 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894185c4-a469-4aa4-8d2e-d6941322d250 None admin] RBAC: Adding query filter params (role.id=eec5decc24ab4673a246120350336b1e, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=f3be96d37b4e4dd889be755b004bfe52) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:47.595410 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894185c4-a469-4aa4-8d2e-d6941322d250 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:47.596883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894185c4-a469-4aa4-8d2e-d6941322d250 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:47.603181 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 275/543] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:44:47 2022] GET /identity/v3/role_assignments?user.id=f3be96d37b4e4dd889be755b004bfe52&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=eec5decc24ab4673a246120350336b1e => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:47.764085 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06726963-0eab-43b7-863c-27f0823ac9fc None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:47.764378 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06726963-0eab-43b7-863c-27f0823ac9fc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:47.764567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06726963-0eab-43b7-863c-27f0823ac9fc None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:47.766357 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 269/544] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:47.771725 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a97f62-4ee0-44ac-8c2a-eed1785c29e2 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:47.772013 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a97f62-4ee0-44ac-8c2a-eed1785c29e2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:47.772289 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a97f62-4ee0-44ac-8c2a-eed1785c29e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:47.790853 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-38a97f62-4ee0-44ac-8c2a-eed1785c29e2 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:47.792150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-38a97f62-4ee0-44ac-8c2a-eed1785c29e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:47.873005 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 276/545] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:47.888397 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06726963-0eab-43b7-863c-27f0823ac9fc None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:48.025124 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06726963-0eab-43b7-863c-27f0823ac9fc None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:48.068768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fd302-1bab-41a5-a6ef-bdb9ef460ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:48.069408 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fd302-1bab-41a5-a6ef-bdb9ef460ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:48.069686 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fd302-1bab-41a5-a6ef-bdb9ef460ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:48.069959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fd302-1bab-41a5-a6ef-bdb9ef460ff8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:48.088404 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fd302-1bab-41a5-a6ef-bdb9ef460ff8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:48.093595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-f80fd302-1bab-41a5-a6ef-bdb9ef460ff8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:48.093595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:48.093595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:48.093595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:48.093595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:48.093595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:48.093595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:48.093595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:48.093595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:48.093595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:48.093595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:48.093595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:48.093595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:48.093595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:48.093595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:48.093595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:48.094690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:48.094690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:48.094690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:48.094690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:48.094690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:48.094690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:48.094690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:48.094690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:48.094690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:48.094690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:48.094690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:48.094690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:48.094690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:48.094690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:48.094690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:48.094690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:48.095540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:48.095540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:48.095540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:48.095540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:48.095540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:48.095540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:48.095540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:48.095540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:48.095540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:48.095540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:48.095540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:48.095540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:48.095540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 270/546] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:44:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:48.104515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a97f62-4ee0-44ac-8c2a-eed1785c29e2 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:48.164615 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fd302-1bab-41a5-a6ef-bdb9ef460ff8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:48.168096 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:48.175633 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:48.262902 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a97f62-4ee0-44ac-8c2a-eed1785c29e2 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:48.312086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f02901-8777-4fa4-bcc0-ef2178904ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:48.312804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02901-8777-4fa4-bcc0-ef2178904ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:48.313081 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02901-8777-4fa4-bcc0-ef2178904ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:48.313350 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02901-8777-4fa4-bcc0-ef2178904ac7 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:48.314018 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f02901-8777-4fa4-bcc0-ef2178904ac7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:48.314317 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f02901-8777-4fa4-bcc0-ef2178904ac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:48.315758 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f02901-8777-4fa4-bcc0-ef2178904ac7 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:48.330456 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 277/547] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Aug 30 11:44:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:48.334228 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f02901-8777-4fa4-bcc0-ef2178904ac7 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:48.366250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fd302-1bab-41a5-a6ef-bdb9ef460ff8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:48.427482 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e9714-a8db-41b9-a29e-d2a20317305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:48.428124 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e9714-a8db-41b9-a29e-d2a20317305c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:48.428400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e9714-a8db-41b9-a29e-d2a20317305c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:48.428670 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e9714-a8db-41b9-a29e-d2a20317305c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:48.447535 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e9714-a8db-41b9-a29e-d2a20317305c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:48.452366 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-7a9e9714-a8db-41b9-a29e-d2a20317305c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:48.452366 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:48.452366 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:48.452366 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:48.452366 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:48.452366 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:48.452366 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:48.452366 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:48.452366 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:48.452366 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:48.452366 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:48.452366 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:48.452366 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:48.452366 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:48.452366 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:48.452366 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:48.453327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:48.453327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:48.453327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:48.453327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:48.453327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:48.453327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:48.453327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:48.453327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:48.453327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:48.453327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:48.453327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:48.453327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:48.453327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:48.453327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:48.453327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:48.453327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:48.454108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:48.454108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:48.454108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:48.454108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:48.454108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:48.454108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:48.454108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:48.454108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:48.454108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:48.454108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:48.454108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:48.454108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:48.454108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 271/548] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:44:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:44:48.462214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e9714-a8db-41b9-a29e-d2a20317305c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:48.516859 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f02901-8777-4fa4-bcc0-ef2178904ac7 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:48.525774 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:48.570317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:48.583538 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07914318-a28a-476f-b30f-2cddaa1563c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:48.584085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914318-a28a-476f-b30f-2cddaa1563c0 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:48.584291 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914318-a28a-476f-b30f-2cddaa1563c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:48.584544 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914318-a28a-476f-b30f-2cddaa1563c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:48.606565 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07914318-a28a-476f-b30f-2cddaa1563c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:48.608083 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07914318-a28a-476f-b30f-2cddaa1563c0 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:48.634273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-07914318-a28a-476f-b30f-2cddaa1563c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:48.634273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:48.634273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:48.634273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:48.634273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:48.634273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:48.634273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:48.634273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:48.634273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:48.634273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:48.634273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:48.634273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:48.634273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:48.634273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:48.634273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:48.634273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:48.635801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:48.635801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:48.635801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:48.635801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:48.635801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:48.635801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:48.635801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:48.635801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:48.635801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:48.635801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:48.635801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:48.635801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:48.635801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:48.635801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:48.635801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:48.635801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:48.635801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:48.636825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:48.636825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:48.636825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:48.636825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 278/549] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:48.637062 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c666624-d2e4-4f6f-a04a-8e615a6d6819 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:48.637567 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c666624-d2e4-4f6f-a04a-8e615a6d6819 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:48.637567 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c666624-d2e4-4f6f-a04a-8e615a6d6819 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:48.638880 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e9714-a8db-41b9-a29e-d2a20317305c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:48.639052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 279/550] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:48.644824 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c666624-d2e4-4f6f-a04a-8e615a6d6819 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:48.691431 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3f5ee-9c2b-40f4-a641-05c001bc2e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:48.691431 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3f5ee-9c2b-40f4-a641-05c001bc2e0c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:48.691431 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3f5ee-9c2b-40f4-a641-05c001bc2e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:48.691431 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3f5ee-9c2b-40f4-a641-05c001bc2e0c None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:48.692224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3f5ee-9c2b-40f4-a641-05c001bc2e0c None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:48.692224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3f5ee-9c2b-40f4-a641-05c001bc2e0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:48.692224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3f5ee-9c2b-40f4-a641-05c001bc2e0c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:48.700914 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 272/551] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Aug 30 11:44:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:48.702462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a6fb4-755e-4d0d-93f7-1ef370b3fa83 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:48.703034 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a6fb4-755e-4d0d-93f7-1ef370b3fa83 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:48.703593 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a6fb4-755e-4d0d-93f7-1ef370b3fa83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:48.722714 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-016a6fb4-755e-4d0d-93f7-1ef370b3fa83 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:48.724313 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-016a6fb4-755e-4d0d-93f7-1ef370b3fa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:48.777024 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c666624-d2e4-4f6f-a04a-8e615a6d6819 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:48.793692 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 273/552] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:48.794917 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a6fb4-755e-4d0d-93f7-1ef370b3fa83 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:48.819031 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099e611-55e3-4206-b8ca-f270f2240d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:48.819845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099e611-55e3-4206-b8ca-f270f2240d94 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:48.820139 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099e611-55e3-4206-b8ca-f270f2240d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:48.820465 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099e611-55e3-4206-b8ca-f270f2240d94 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:48.821071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099e611-55e3-4206-b8ca-f270f2240d94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:48.821376 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099e611-55e3-4206-b8ca-f270f2240d94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:48.822814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099e611-55e3-4206-b8ca-f270f2240d94 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:48.837979 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 280/553] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:48.844655 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099e611-55e3-4206-b8ca-f270f2240d94 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:48.891720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:48.915704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:48.996066 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a6fb4-755e-4d0d-93f7-1ef370b3fa83 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:49.040591 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099e611-55e3-4206-b8ca-f270f2240d94 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:49.062683 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41bd4d-ec00-4902-91b3-4efe2a0b082f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:49.063446 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41bd4d-ec00-4902-91b3-4efe2a0b082f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:49.063726 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41bd4d-ec00-4902-91b3-4efe2a0b082f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:49.064000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41bd4d-ec00-4902-91b3-4efe2a0b082f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:49.077372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41bd4d-ec00-4902-91b3-4efe2a0b082f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:49.079299 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41bd4d-ec00-4902-91b3-4efe2a0b082f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:49.091883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc5734-aa92-426a-a3c8-4adf3f13528b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:49.092517 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc5734-aa92-426a-a3c8-4adf3f13528b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:49.092781 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc5734-aa92-426a-a3c8-4adf3f13528b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:49.093048 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc5734-aa92-426a-a3c8-4adf3f13528b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:49.095405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3d41bd4d-ec00-4902-91b3-4efe2a0b082f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:49.095405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:49.095405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:49.095405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:49.095405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:49.095405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:49.095405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:49.095405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:49.095405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:49.095405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:49.095405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:49.095405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:49.095405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:49.095405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:49.095405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:49.095405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:49.097346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:49.097346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:49.097346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:49.097346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:49.097346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:49.097346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:49.097346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:49.097346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:49.097346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:49.097346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:49.097346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:49.097346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:49.097346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:49.097346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:49.097346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:49.097346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:49.097346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:49.099345 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:49.099345 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:49.099345 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:49.099345 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 274/554] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:49.099345 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41bd4d-ec00-4902-91b3-4efe2a0b082f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:49.105865 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc5734-aa92-426a-a3c8-4adf3f13528b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:49.107387 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc5734-aa92-426a-a3c8-4adf3f13528b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:49.128601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-dbbc5734-aa92-426a-a3c8-4adf3f13528b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:44:49.128601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:49.128601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:49.128601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:49.128601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:49.128601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:49.128601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:49.128601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:49.128601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:49.128601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:49.128601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:49.128601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:49.128601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:44:49.128601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:44:49.128601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:44:49.128601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:44:49.129570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:49.129570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:49.129570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:44:49.129570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:49.129570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:44:49.129570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:49.129570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:49.129570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:49.129570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:49.129570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:49.129570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:49.129570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:49.129570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:49.129570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:49.129570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:49.129570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:49.129570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:49.129570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:49.130455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:49.130455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:49.130455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:44:49.130455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:44:49.130455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:44:49.130455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:44:49.130455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:44:49.130455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:44:49.130455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:44:49.130455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:49.133617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 281/555] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:44:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:49.135250 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc5734-aa92-426a-a3c8-4adf3f13528b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:49.216006 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41bd4d-ec00-4902-91b3-4efe2a0b082f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:49.225923 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:49.226984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:49.250679 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc5734-aa92-426a-a3c8-4adf3f13528b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:49.257038 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc43db8-95a9-45f5-99a2-5e216ae664ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:49.257924 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc43db8-95a9-45f5-99a2-5e216ae664ac None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:49.258380 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc43db8-95a9-45f5-99a2-5e216ae664ac None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:49.258834 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc43db8-95a9-45f5-99a2-5e216ae664ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:49.270516 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc43db8-95a9-45f5-99a2-5e216ae664ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:49.276434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-2dc43db8-95a9-45f5-99a2-5e216ae664ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:49.276434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:49.276434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:49.276434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:49.276434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:49.276434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:49.276434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:49.276434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:49.276434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:49.276434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:49.276434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:49.276434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:49.276434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:49.276434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:49.276434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:49.276434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:49.277532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:49.277532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:49.277532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:49.277532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:49.277532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:49.277532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:49.277532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:49.277532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:49.277532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:49.277532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:49.277532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:49.277532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:49.277532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:49.277532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:49.277532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:49.277532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:49.279053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:49.279053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:49.279053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:49.279053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:49.279053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:49.279053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:49.279053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:49.279053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:49.279053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:49.279053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:49.279053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:49.279053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:49.286096 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 275/556] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:44:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:49.287150 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc43db8-95a9-45f5-99a2-5e216ae664ac None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:49.287262 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad152f-3394-49bc-b5eb-a7a628348866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:49.287947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad152f-3394-49bc-b5eb-a7a628348866 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:49.288235 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad152f-3394-49bc-b5eb-a7a628348866 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:49.288537 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad152f-3394-49bc-b5eb-a7a628348866 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:49.289145 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad152f-3394-49bc-b5eb-a7a628348866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:49.289447 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad152f-3394-49bc-b5eb-a7a628348866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:49.290850 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad152f-3394-49bc-b5eb-a7a628348866 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:49.307654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 282/557] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:49.307654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad152f-3394-49bc-b5eb-a7a628348866 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:49.402261 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc43db8-95a9-45f5-99a2-5e216ae664ac None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:49.407674 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad152f-3394-49bc-b5eb-a7a628348866 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:49.440315 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85a72d-084a-4df3-96d7-0cc50f8a71c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:49.441181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85a72d-084a-4df3-96d7-0cc50f8a71c5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:49.441654 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85a72d-084a-4df3-96d7-0cc50f8a71c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:49.442060 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85a72d-084a-4df3-96d7-0cc50f8a71c5 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:49.442917 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85a72d-084a-4df3-96d7-0cc50f8a71c5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:49.443393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85a72d-084a-4df3-96d7-0cc50f8a71c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:49.443503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539eff38-a75b-4653-81ad-b191fb779e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:49.444359 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539eff38-a75b-4653-81ad-b191fb779e45 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:49.444645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539eff38-a75b-4653-81ad-b191fb779e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:49.444916 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539eff38-a75b-4653-81ad-b191fb779e45 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:49.445575 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539eff38-a75b-4653-81ad-b191fb779e45 None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:49.445759 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85a72d-084a-4df3-96d7-0cc50f8a71c5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:49.445863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539eff38-a75b-4653-81ad-b191fb779e45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:49.447237 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539eff38-a75b-4653-81ad-b191fb779e45 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:49.452652 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:49.461008 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 283/558] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Aug 30 11:44:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:49.461008 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539eff38-a75b-4653-81ad-b191fb779e45 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:49.474831 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 276/559] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Aug 30 11:44:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:49.475970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85a72d-084a-4df3-96d7-0cc50f8a71c5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:49.513117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:49.601835 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539eff38-a75b-4653-81ad-b191fb779e45 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:49.608326 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85a72d-084a-4df3-96d7-0cc50f8a71c5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:49.638874 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036564ba-2ad0-45d7-ba58-43497987f919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:49.639953 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036564ba-2ad0-45d7-ba58-43497987f919 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:49.640468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036564ba-2ad0-45d7-ba58-43497987f919 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:49.640931 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036564ba-2ad0-45d7-ba58-43497987f919 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:49.649714 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036564ba-2ad0-45d7-ba58-43497987f919 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:49.651550 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036564ba-2ad0-45d7-ba58-43497987f919 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:49.654685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21913e-b58f-41a7-89c3-bc994e1542d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:49.656083 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21913e-b58f-41a7-89c3-bc994e1542d0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:49.656439 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21913e-b58f-41a7-89c3-bc994e1542d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:49.656686 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21913e-b58f-41a7-89c3-bc994e1542d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:49.666347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-036564ba-2ad0-45d7-ba58-43497987f919 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:44:49.666347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:49.666347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:49.666347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:49.666347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:49.666347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:49.666347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:49.666347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:49.666347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:49.666347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:49.666347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:49.666347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:49.666347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:44:49.666347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:44:49.666347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:44:49.666347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:44:49.667379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:49.667379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:49.667379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:44:49.667379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:49.667379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:44:49.667379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:49.667379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:49.667379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:49.667379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:49.667379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:49.667379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:49.667379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:49.667379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:49.667379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:49.667379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:49.667379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:49.667379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:49.667379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:49.668330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:49.668330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:49.668330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:44:49.668330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:44:49.668330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:44:49.668330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:44:49.668330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:44:49.668330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:44:49.668330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:44:49.668330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:49.672282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 284/560] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Aug 30 11:44:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:49.673167 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036564ba-2ad0-45d7-ba58-43497987f919 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:49.675485 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21913e-b58f-41a7-89c3-bc994e1542d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:49.678249 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21913e-b58f-41a7-89c3-bc994e1542d0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:49.697839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-cc21913e-b58f-41a7-89c3-bc994e1542d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:49.697839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:49.697839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:49.697839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:49.697839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:49.697839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:49.697839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:49.697839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:49.697839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:49.697839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:49.697839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:49.697839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:49.697839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:49.697839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:49.697839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:49.697839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:49.698845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:49.698845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:49.698845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:49.698845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:49.698845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:49.698845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:49.698845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:49.698845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:49.698845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:49.698845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:49.698845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:49.698845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:49.698845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:49.698845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:49.698845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:49.698845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:49.698845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:49.699776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:49.699776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:49.699776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:49.705600 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 277/561] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:49.706627 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21913e-b58f-41a7-89c3-bc994e1542d0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:49.740677 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:49.782305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036564ba-2ad0-45d7-ba58-43497987f919 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:49.786993 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:49.808240 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21913e-b58f-41a7-89c3-bc994e1542d0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:49.815594 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caec29f-1073-4a2f-880e-01dc15cb5df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:49.816233 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caec29f-1073-4a2f-880e-01dc15cb5df5 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:49.816515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caec29f-1073-4a2f-880e-01dc15cb5df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:49.816807 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caec29f-1073-4a2f-880e-01dc15cb5df5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:49.840813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ab3d4-570b-448f-922c-a43632a163e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:49.841415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ab3d4-570b-448f-922c-a43632a163e7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:49.841685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ab3d4-570b-448f-922c-a43632a163e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:49.841949 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ab3d4-570b-448f-922c-a43632a163e7 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:49.842662 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ab3d4-570b-448f-922c-a43632a163e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:49.842965 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ab3d4-570b-448f-922c-a43632a163e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:49.844592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ab3d4-570b-448f-922c-a43632a163e7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:49.861276 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 278/562] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Aug 30 11:44:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:49.862062 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ab3d4-570b-448f-922c-a43632a163e7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:49.883989 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caec29f-1073-4a2f-880e-01dc15cb5df5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:49.885453 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caec29f-1073-4a2f-880e-01dc15cb5df5 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:49.943643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:49.962162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ab3d4-570b-448f-922c-a43632a163e7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:49.993185 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 285/563] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:49.993185 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f222816-16a2-48b7-9f71-9941d5923a89 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:49.993185 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f222816-16a2-48b7-9f71-9941d5923a89 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:49.993185 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f222816-16a2-48b7-9f71-9941d5923a89 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:49.993185 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 286/564] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:49.993185 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa5322-7698-4a25-8292-1da23903e640 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:49.993185 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa5322-7698-4a25-8292-1da23903e640 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:49.993770 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa5322-7698-4a25-8292-1da23903e640 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:49.994262 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 287/565] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:49.994934 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa5322-7698-4a25-8292-1da23903e640 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:50.000462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f65ff-7f4e-44e8-98d3-c743d586ec78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:50.001089 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f65ff-7f4e-44e8-98d3-c743d586ec78 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:50.001369 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f65ff-7f4e-44e8-98d3-c743d586ec78 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:50.001641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f65ff-7f4e-44e8-98d3-c743d586ec78 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:50.002282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f65ff-7f4e-44e8-98d3-c743d586ec78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:50.002581 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f65ff-7f4e-44e8-98d3-c743d586ec78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:50.004092 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f65ff-7f4e-44e8-98d3-c743d586ec78 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:50.006534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:50.018367 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 279/566] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:50.019206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f65ff-7f4e-44e8-98d3-c743d586ec78 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:50.095856 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa5322-7698-4a25-8292-1da23903e640 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:50.124570 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f65ff-7f4e-44e8-98d3-c743d586ec78 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:50.129501 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86fb24-3bc4-434b-8406-bb6b1d46f8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:50.130134 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86fb24-3bc4-434b-8406-bb6b1d46f8cc None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:50.130398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86fb24-3bc4-434b-8406-bb6b1d46f8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:50.130668 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86fb24-3bc4-434b-8406-bb6b1d46f8cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:50.140988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86fb24-3bc4-434b-8406-bb6b1d46f8cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:50.142508 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86fb24-3bc4-434b-8406-bb6b1d46f8cc None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:50.157399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-eb86fb24-3bc4-434b-8406-bb6b1d46f8cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:50.157399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:50.157399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:50.157399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:50.157399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:50.157399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:50.157399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:50.157399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:50.157399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:50.157399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:50.157399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:50.157399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:50.157399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:50.157399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:50.157399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:50.157399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:50.158408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:50.158408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:50.158408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:50.158408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:50.158408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:50.158408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:50.158408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:50.158408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:50.158408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:50.158408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:50.158408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:50.158408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:50.158408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:50.158408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:50.158408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:50.158408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:50.158408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:50.159341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:50.159341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:50.159341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:50.159543 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38d045-c59a-4e5a-801d-335965c095bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:50.159543 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38d045-c59a-4e5a-801d-335965c095bf None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:50.159543 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38d045-c59a-4e5a-801d-335965c095bf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:50.159767 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 288/567] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:50.159835 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38d045-c59a-4e5a-801d-335965c095bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:50.159901 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c75782-89c5-445c-93e5-836d39c85141 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:50.160004 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c75782-89c5-445c-93e5-836d39c85141 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:50.160278 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c75782-89c5-445c-93e5-836d39c85141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:50.171097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38d045-c59a-4e5a-801d-335965c095bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:50.172715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38d045-c59a-4e5a-801d-335965c095bf None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:50.178556 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-78c75782-89c5-445c-93e5-836d39c85141 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:50.179783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-78c75782-89c5-445c-93e5-836d39c85141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:50.187065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9b38d045-c59a-4e5a-801d-335965c095bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:50.187065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:50.187065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:50.187065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:50.187065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:50.187065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:50.187065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:50.187065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:50.187065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:50.187065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:50.187065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:50.187065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:50.187065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:50.187065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:50.187065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:50.187065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:50.188379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:50.188379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:50.188379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:50.188379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:50.188379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:50.188379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:50.188379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:50.188379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:50.188379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:50.188379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:50.188379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:50.188379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:50.188379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:50.188379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:50.188379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:50.188379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:50.188379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:50.189262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:50.189262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:50.189262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:50.189428 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:50.191517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 280/568] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:50.193162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df35c33-8127-4021-b682-6c3d6fc2a527 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:50.193444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df35c33-8127-4021-b682-6c3d6fc2a527 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:50.193767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df35c33-8127-4021-b682-6c3d6fc2a527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:50.211962 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5df35c33-8127-4021-b682-6c3d6fc2a527 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:50.213143 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5df35c33-8127-4021-b682-6c3d6fc2a527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:50.248744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 289/569] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:50.249578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c75782-89c5-445c-93e5-836d39c85141 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:50.269106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:50.299727 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 281/570] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:50.301393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df35c33-8127-4021-b682-6c3d6fc2a527 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:50.367796 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c75782-89c5-445c-93e5-836d39c85141 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:50.417927 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf609e2e-9df7-4083-aa69-ffb755392f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:50.418557 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf609e2e-9df7-4083-aa69-ffb755392f9c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:50.418827 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf609e2e-9df7-4083-aa69-ffb755392f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:50.419089 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf609e2e-9df7-4083-aa69-ffb755392f9c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:50.422488 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df35c33-8127-4021-b682-6c3d6fc2a527 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:50.426460 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf609e2e-9df7-4083-aa69-ffb755392f9c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:50.427974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf609e2e-9df7-4083-aa69-ffb755392f9c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:50.440541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-cf609e2e-9df7-4083-aa69-ffb755392f9c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 11:44:50.440541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:50.440541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:50.440541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:50.440541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:50.440541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:50.440541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:50.440541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:50.440541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:50.440541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:50.440541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:50.440541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:50.440541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:44:50.440541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:44:50.440541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:44:50.440541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:44:50.441531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:50.441531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:50.441531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:44:50.441531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:50.441531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:44:50.441531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:50.441531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:50.441531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:50.441531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:50.441531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:50.441531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:50.441531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:50.441531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:50.441531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:50.441531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:50.441531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:50.441531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:50.441531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:50.443107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:50.443107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:50.443107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:44:50.443107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:44:50.443107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:44:50.443107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:44:50.443107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:44:50.443107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:44:50.443107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 11:44:50.443107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:50.443107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 290/571] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:50.443107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf609e2e-9df7-4083-aa69-ffb755392f9c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:50.447416 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:50.469365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2befd-167b-4629-a169-e73baae708e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:50.469988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2befd-167b-4629-a169-e73baae708e7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:50.470263 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2befd-167b-4629-a169-e73baae708e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:50.470530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2befd-167b-4629-a169-e73baae708e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:50.471267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2befd-167b-4629-a169-e73baae708e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:50.471653 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2befd-167b-4629-a169-e73baae708e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:50.473007 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2befd-167b-4629-a169-e73baae708e7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:50.491306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 282/572] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:50.492222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2befd-167b-4629-a169-e73baae708e7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:50.533134 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:50.568610 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf609e2e-9df7-4083-aa69-ffb755392f9c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:50.593139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2befd-167b-4629-a169-e73baae708e7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:50.601237 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c460a-7629-4d4a-89db-6d9581045904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:50.601848 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c460a-7629-4d4a-89db-6d9581045904 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:50.602121 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c460a-7629-4d4a-89db-6d9581045904 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:50.602658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c460a-7629-4d4a-89db-6d9581045904 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:50.602996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c460a-7629-4d4a-89db-6d9581045904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:50.603291 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c460a-7629-4d4a-89db-6d9581045904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:50.604719 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c460a-7629-4d4a-89db-6d9581045904 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:50.616047 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 291/573] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:50.616818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c460a-7629-4d4a-89db-6d9581045904 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:50.627948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4188e61-63bd-4fe3-a07a-158e41002b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:50.628582 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4188e61-63bd-4fe3-a07a-158e41002b6c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:50.628884 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4188e61-63bd-4fe3-a07a-158e41002b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:50.629163 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4188e61-63bd-4fe3-a07a-158e41002b6c None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:50.629861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4188e61-63bd-4fe3-a07a-158e41002b6c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:50.630173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4188e61-63bd-4fe3-a07a-158e41002b6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:50.631633 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4188e61-63bd-4fe3-a07a-158e41002b6c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:50.649391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 283/574] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Aug 30 11:44:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:50.650193 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4188e61-63bd-4fe3-a07a-158e41002b6c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:50.678814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:50.718469 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c460a-7629-4d4a-89db-6d9581045904 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:50.746459 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:50.751852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cebfa-d3d4-42fc-89e2-d87aa33ec227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:50.752483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cebfa-d3d4-42fc-89e2-d87aa33ec227 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:50.752762 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cebfa-d3d4-42fc-89e2-d87aa33ec227 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:50.752981 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4188e61-63bd-4fe3-a07a-158e41002b6c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:50.753089 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cebfa-d3d4-42fc-89e2-d87aa33ec227 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:50.759574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cebfa-d3d4-42fc-89e2-d87aa33ec227 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:50.761070 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cebfa-d3d4-42fc-89e2-d87aa33ec227 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:50.772100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-f01cebfa-d3d4-42fc-89e2-d87aa33ec227 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:50.772100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:50.772100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:50.772100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:50.772100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:50.772100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:50.772100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:50.772100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:50.772100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:50.772100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:50.772100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:50.772100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:50.772100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:44:50.772100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:44:50.772100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:44:50.773113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:44:50.773113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:50.773113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:50.773113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:50.773113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:50.773113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:50.773113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:50.773113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:50.773113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:50.773113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:50.773113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:50.773113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:50.773113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:50.773113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:50.773113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:50.773113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:50.773113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:50.774195 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:44:50.774195 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:44:50.774195 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:44:50.774195 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:44:50.774195 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:44:50.774195 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:44:50.774195 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:50.774195 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:50.774195 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 292/575] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:44:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:50.774744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cebfa-d3d4-42fc-89e2-d87aa33ec227 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:50.789692 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947763d-b28f-4928-8a6b-541eb9b11fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:50.790328 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947763d-b28f-4928-8a6b-541eb9b11fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:50.790600 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947763d-b28f-4928-8a6b-541eb9b11fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:50.790865 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947763d-b28f-4928-8a6b-541eb9b11fa6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:50.800955 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947763d-b28f-4928-8a6b-541eb9b11fa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:50.805806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-b947763d-b28f-4928-8a6b-541eb9b11fa6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:50.805806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:50.805806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:50.805806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:50.805806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:50.805806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:50.805806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:50.805806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:50.805806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:50.805806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:50.805806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:50.805806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:50.805806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:50.805806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:50.805806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:50.805806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:50.806739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:50.806739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:50.806739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:50.806739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:50.806739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:50.806739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:50.806739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:50.806739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:50.806739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:50.806739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:50.806739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:50.806739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:50.806739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:50.806739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:50.806739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:50.806739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:50.807620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:50.807620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:50.807620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:50.807620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:50.807620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:50.807620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:50.807620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:50.807620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:50.807620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:50.807620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:50.807620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:50.807620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:50.807620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 284/576] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:44:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:50.807620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947763d-b28f-4928-8a6b-541eb9b11fa6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:50.877143 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cebfa-d3d4-42fc-89e2-d87aa33ec227 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:50.899311 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:50.904037 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947763d-b28f-4928-8a6b-541eb9b11fa6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:50.911471 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a68b1-9a3c-471e-a6c3-c34a06a9df43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:50.912095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a68b1-9a3c-471e-a6c3-c34a06a9df43 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:50.912371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a68b1-9a3c-471e-a6c3-c34a06a9df43 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:50.912644 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a68b1-9a3c-471e-a6c3-c34a06a9df43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:50.923142 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a68b1-9a3c-471e-a6c3-c34a06a9df43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:50.928386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-595a68b1-9a3c-471e-a6c3-c34a06a9df43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:50.928386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:50.928386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:50.928386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:50.928386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:50.928386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:50.928386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:50.928386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:50.928386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:50.928386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:50.928386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:50.928386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:50.928386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:50.928386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:50.928386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:50.928386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:50.929277 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:50.929277 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:50.929277 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:50.929277 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:50.929277 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:50.929277 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:50.929277 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:50.929277 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:50.929277 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:50.929277 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:50.929277 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:50.929277 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:50.929277 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:50.929277 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:50.929277 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:50.929277 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:50.930171 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:50.930171 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:50.930171 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:50.930171 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:50.930171 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:50.930171 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:50.930171 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:50.930171 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:50.930171 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:50.930171 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:50.930171 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:50.930171 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:50.930171 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 293/577] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:44:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:50.930848 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a68b1-9a3c-471e-a6c3-c34a06a9df43 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:50.940356 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb73534-e967-4abb-911f-dd6054ba64d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:50.940988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb73534-e967-4abb-911f-dd6054ba64d4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:50.941265 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb73534-e967-4abb-911f-dd6054ba64d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:50.941536 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb73534-e967-4abb-911f-dd6054ba64d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:50.948294 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb73534-e967-4abb-911f-dd6054ba64d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:50.949772 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb73534-e967-4abb-911f-dd6054ba64d4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:50.961116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4cb73534-e967-4abb-911f-dd6054ba64d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:50.961116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:50.961116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:50.961116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:50.961116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:50.961116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:50.961116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:50.961116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:50.961116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:50.961116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:50.961116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:50.961116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:50.961116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:44:50.961116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:44:50.961116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:44:50.962093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:44:50.962093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:50.962093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:50.962093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:50.962093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:50.962093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:50.962093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:50.962093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:50.962093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:50.962093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:50.962093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:50.962093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:50.962093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:50.962093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:50.962093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:50.962093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:50.962093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:50.963453 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:44:50.963453 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:44:50.963453 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:44:50.963453 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:44:50.963453 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:44:50.963453 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:44:50.963453 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:50.963453 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:50.963453 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 285/578] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:44:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:50.964806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb73534-e967-4abb-911f-dd6054ba64d4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:50.983483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:51.035515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a68b1-9a3c-471e-a6c3-c34a06a9df43 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:51.063935 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb73534-e967-4abb-911f-dd6054ba64d4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:51.068410 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f83a6-3ff6-425e-a145-97d1e055d011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:51.069073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f83a6-3ff6-425e-a145-97d1e055d011 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:51.069356 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f83a6-3ff6-425e-a145-97d1e055d011 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:51.069623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f83a6-3ff6-425e-a145-97d1e055d011 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:51.081347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f83a6-3ff6-425e-a145-97d1e055d011 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:51.082822 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f83a6-3ff6-425e-a145-97d1e055d011 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:51.097483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-aa3f83a6-3ff6-425e-a145-97d1e055d011 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:51.097483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:51.097483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:51.097483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:51.097483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:51.097483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:51.097483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:51.097483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:51.097483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:51.097483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:51.097483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:51.097483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:51.097483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:51.097483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:51.097483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:51.097483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:51.098451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:51.098451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:51.098451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:51.098451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:51.098451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:51.098451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:51.098451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:51.098451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:51.098451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:51.098451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:51.098451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:51.098451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:51.098451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:51.098451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:51.098451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:51.098451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:51.098451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:51.099328 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:51.099328 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:51.099328 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:51.099328 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 294/579] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:51.099328 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f83a6-3ff6-425e-a145-97d1e055d011 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:51.104118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204564e-a0fa-4801-b07a-e85853c5855e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:51.108579 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204564e-a0fa-4801-b07a-e85853c5855e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:51.108862 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204564e-a0fa-4801-b07a-e85853c5855e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:51.110272 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204564e-a0fa-4801-b07a-e85853c5855e None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:51.111000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204564e-a0fa-4801-b07a-e85853c5855e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:51.112029 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204564e-a0fa-4801-b07a-e85853c5855e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:51.113984 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204564e-a0fa-4801-b07a-e85853c5855e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:51.127948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 286/580] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:44:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:51.128607 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204564e-a0fa-4801-b07a-e85853c5855e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:51.135496 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:51.203758 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f83a6-3ff6-425e-a145-97d1e055d011 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:51.207098 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:51.229574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204564e-a0fa-4801-b07a-e85853c5855e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:51.239342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936d375-52bb-4adf-bdc9-249122b786cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:51.239929 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936d375-52bb-4adf-bdc9-249122b786cc None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:51.240510 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936d375-52bb-4adf-bdc9-249122b786cc None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:51.240785 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936d375-52bb-4adf-bdc9-249122b786cc None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:51.241451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936d375-52bb-4adf-bdc9-249122b786cc None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:51.241753 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936d375-52bb-4adf-bdc9-249122b786cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:51.243173 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936d375-52bb-4adf-bdc9-249122b786cc None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:51.251265 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 295/581] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Aug 30 11:44:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:51.252084 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936d375-52bb-4adf-bdc9-249122b786cc None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:51.263257 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0609ab3-e8cb-42a6-9792-221ca6fa0b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:51.263898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0609ab3-e8cb-42a6-9792-221ca6fa0b71 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:51.264181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0609ab3-e8cb-42a6-9792-221ca6fa0b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:51.264452 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0609ab3-e8cb-42a6-9792-221ca6fa0b71 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:51.265109 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0609ab3-e8cb-42a6-9792-221ca6fa0b71 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:51.265436 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0609ab3-e8cb-42a6-9792-221ca6fa0b71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:51.267183 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0609ab3-e8cb-42a6-9792-221ca6fa0b71 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:51.276458 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 287/582] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Aug 30 11:44:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:51.277264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0609ab3-e8cb-42a6-9792-221ca6fa0b71 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:51.348640 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:51.354766 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936d375-52bb-4adf-bdc9-249122b786cc None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:51.380494 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0609ab3-e8cb-42a6-9792-221ca6fa0b71 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:51.387676 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc89b9-7267-4a73-ad57-d5df70f36db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:51.388278 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc89b9-7267-4a73-ad57-d5df70f36db5 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:51.388552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc89b9-7267-4a73-ad57-d5df70f36db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:51.388793 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc89b9-7267-4a73-ad57-d5df70f36db5 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:51.389490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc89b9-7267-4a73-ad57-d5df70f36db5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:51.389789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc89b9-7267-4a73-ad57-d5df70f36db5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:51.391247 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc89b9-7267-4a73-ad57-d5df70f36db5 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:51.402847 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 296/583] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:44:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:51.403633 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc89b9-7267-4a73-ad57-d5df70f36db5 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:51.415755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5420a6-6c7f-4efb-9a75-463df96c5171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:51.416361 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5420a6-6c7f-4efb-9a75-463df96c5171 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:51.416608 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5420a6-6c7f-4efb-9a75-463df96c5171 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:51.416886 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5420a6-6c7f-4efb-9a75-463df96c5171 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:51.417542 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5420a6-6c7f-4efb-9a75-463df96c5171 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:51.417838 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5420a6-6c7f-4efb-9a75-463df96c5171 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:51.419199 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5420a6-6c7f-4efb-9a75-463df96c5171 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:51.426360 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:51.432307 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 288/584] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:51.432921 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5420a6-6c7f-4efb-9a75-463df96c5171 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:51.507463 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc89b9-7267-4a73-ad57-d5df70f36db5 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:51.530043 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5420a6-6c7f-4efb-9a75-463df96c5171 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:51.541256 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c1172-f842-42a4-979a-2875b26ddbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:51.541920 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c1172-f842-42a4-979a-2875b26ddbcd None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:51.542191 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c1172-f842-42a4-979a-2875b26ddbcd None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:51.542455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c1172-f842-42a4-979a-2875b26ddbcd None admin] PATH_INFO: `/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/8d17f1d0577a41ed8859706073f79d77/roles/eec5decc24ab4673a246120350336b1e` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:51.557700 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c1172-f842-42a4-979a-2875b26ddbcd None admin] RBAC: Authorizing `identity:create_grant(project_id=ba4dff9d637c4afcadfd3cd92b065a41, user_id=8d17f1d0577a41ed8859706073f79d77, role_id=eec5decc24ab4673a246120350336b1e)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:51.559168 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c1172-f842-42a4-979a-2875b26ddbcd None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:51.564371 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa54ceb-77ff-44c7-a47a-fcd230e3c415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:51.565002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa54ceb-77ff-44c7-a47a-fcd230e3c415 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:51.565262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa54ceb-77ff-44c7-a47a-fcd230e3c415 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:51.565534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa54ceb-77ff-44c7-a47a-fcd230e3c415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:51.572560 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 297/585] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:44:51 2022] PUT /identity/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/8d17f1d0577a41ed8859706073f79d77/roles/eec5decc24ab4673a246120350336b1e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:44:51.573347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c1172-f842-42a4-979a-2875b26ddbcd None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:51.583252 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:51.586546 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa54ceb-77ff-44c7-a47a-fcd230e3c415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:51.588225 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa54ceb-77ff-44c7-a47a-fcd230e3c415 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:51.607181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9fa54ceb-77ff-44c7-a47a-fcd230e3c415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:51.607181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:51.607181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:51.607181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:51.607181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:51.607181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:51.607181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:51.607181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:51.607181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:51.607181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:51.607181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:51.607181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:51.607181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:51.607181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:51.607181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:51.607181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:51.608308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:51.608308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:51.608308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:51.608308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:51.608308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:51.608308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:51.608308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:51.608308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:51.608308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:51.608308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:51.608308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:51.608308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:51.608308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:51.608308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:51.608308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:51.608308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:51.608308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:51.609650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:51.609650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:51.609650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:51.609650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 289/586] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:51.609650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa54ceb-77ff-44c7-a47a-fcd230e3c415 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:51.672966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:51.695073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c1172-f842-42a4-979a-2875b26ddbcd None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:51.735856 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa54ceb-77ff-44c7-a47a-fcd230e3c415 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:51.737683 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511537d8-4bd2-49a4-bba8-d978f6c6d0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:51.738326 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511537d8-4bd2-49a4-bba8-d978f6c6d0cb None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:51.738599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511537d8-4bd2-49a4-bba8-d978f6c6d0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:51.738870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511537d8-4bd2-49a4-bba8-d978f6c6d0cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:51.749498 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511537d8-4bd2-49a4-bba8-d978f6c6d0cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:51.751422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511537d8-4bd2-49a4-bba8-d978f6c6d0cb None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:51.766937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-511537d8-4bd2-49a4-bba8-d978f6c6d0cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:51.766937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:51.766937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:51.766937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:51.766937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:51.766937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:51.766937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:51.766937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:51.766937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:51.766937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:51.766937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:51.766937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:51.766937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:51.766937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:51.766937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:51.766937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:51.768030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:51.768030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:51.768030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:51.768030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:51.768030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:51.768030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:51.768030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:51.768030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:51.768030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:51.768030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:51.768030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:51.768030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:51.768030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:51.768030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:51.768030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:51.768030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:51.768030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:51.768921 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:51.768921 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:51.768921 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:51.768921 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 298/587] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:51.768921 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511537d8-4bd2-49a4-bba8-d978f6c6d0cb None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:51.775995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ebc70-65ed-459c-9bec-97abbed37569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:51.776932 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ebc70-65ed-459c-9bec-97abbed37569 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:51.777406 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ebc70-65ed-459c-9bec-97abbed37569 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:51.777873 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ebc70-65ed-459c-9bec-97abbed37569 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:51.778915 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ebc70-65ed-459c-9bec-97abbed37569 None admin] RBAC: Adding query filter params (role.id=eec5decc24ab4673a246120350336b1e, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=8d27bfb8c0b64763b7db7cffa5f230f6) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:51.779958 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ebc70-65ed-459c-9bec-97abbed37569 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:51.782139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ebc70-65ed-459c-9bec-97abbed37569 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:51.797856 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 290/588] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:44:51 2022] GET /identity/v3/role_assignments?user.id=8d27bfb8c0b64763b7db7cffa5f230f6&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=eec5decc24ab4673a246120350336b1e => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:51.797856 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ebc70-65ed-459c-9bec-97abbed37569 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:51.841872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:51.890331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511537d8-4bd2-49a4-bba8-d978f6c6d0cb None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:51.929645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe82aa7-8133-4cf4-b38d-7068e7a35f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:51.930158 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe82aa7-8133-4cf4-b38d-7068e7a35f0c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:51.930492 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe82aa7-8133-4cf4-b38d-7068e7a35f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:51.930845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe82aa7-8133-4cf4-b38d-7068e7a35f0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:51.939480 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe82aa7-8133-4cf4-b38d-7068e7a35f0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:51.940949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe82aa7-8133-4cf4-b38d-7068e7a35f0c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:51.952677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ebc70-65ed-459c-9bec-97abbed37569 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:51.955288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-8fe82aa7-8133-4cf4-b38d-7068e7a35f0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:51.955288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:51.955288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:51.955288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:51.955288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:51.955288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:51.955288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:51.955288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:51.955288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:51.955288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:51.955288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:51.955288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:51.955288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:44:51.955288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:44:51.955288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:44:51.956184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:44:51.956184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:51.956184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:51.956184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:51.956184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:51.956184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:51.956184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:51.956184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:51.956184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:51.956184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:51.956184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:51.956184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:51.956184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:51.956184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:51.956184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:51.956184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:51.956184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:51.957076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:44:51.957076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:44:51.957076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:44:51.957076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:44:51.957076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:44:51.957076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:44:51.957076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:51.957076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:51.959105 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 299/589] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:44:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:51.960197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe82aa7-8133-4cf4-b38d-7068e7a35f0c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:51.995911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf6f46-f51a-49d7-bdb9-731238d48a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:51.997281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf6f46-f51a-49d7-bdb9-731238d48a20 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:51.997801 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf6f46-f51a-49d7-bdb9-731238d48a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:51.998330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf6f46-f51a-49d7-bdb9-731238d48a20 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:51.999173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf6f46-f51a-49d7-bdb9-731238d48a20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:51.999706 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf6f46-f51a-49d7-bdb9-731238d48a20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:52.001343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf6f46-f51a-49d7-bdb9-731238d48a20 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:52.014428 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:52.014978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 291/590] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:52.016136 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf6f46-f51a-49d7-bdb9-731238d48a20 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:52.089178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe82aa7-8133-4cf4-b38d-7068e7a35f0c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:52.119383 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:52.141507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf6f46-f51a-49d7-bdb9-731238d48a20 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:52.142553 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17be2ec-beb2-472b-b78c-6b2c33f294d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:52.143176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17be2ec-beb2-472b-b78c-6b2c33f294d3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:52.143497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17be2ec-beb2-472b-b78c-6b2c33f294d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:52.143770 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17be2ec-beb2-472b-b78c-6b2c33f294d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:52.144669 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17be2ec-beb2-472b-b78c-6b2c33f294d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:52.144976 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17be2ec-beb2-472b-b78c-6b2c33f294d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:52.147399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17be2ec-beb2-472b-b78c-6b2c33f294d3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:52.163499 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 300/591] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:52.164627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17be2ec-beb2-472b-b78c-6b2c33f294d3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:52.188808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244072fc-0749-4ef1-a89f-c4ffc117b1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:52.189975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244072fc-0749-4ef1-a89f-c4ffc117b1e0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:52.190791 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244072fc-0749-4ef1-a89f-c4ffc117b1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:52.191261 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244072fc-0749-4ef1-a89f-c4ffc117b1e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:52.192179 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244072fc-0749-4ef1-a89f-c4ffc117b1e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:52.192677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244072fc-0749-4ef1-a89f-c4ffc117b1e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:52.195027 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244072fc-0749-4ef1-a89f-c4ffc117b1e0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:52.211425 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 292/592] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:44:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:52.212597 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244072fc-0749-4ef1-a89f-c4ffc117b1e0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:52.255130 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:52.297793 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17be2ec-beb2-472b-b78c-6b2c33f294d3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:52.333497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b310b8b-c9c7-401e-a4a2-9b864c6689e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:52.334573 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b310b8b-c9c7-401e-a4a2-9b864c6689e1 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:52.335096 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b310b8b-c9c7-401e-a4a2-9b864c6689e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:52.335662 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b310b8b-c9c7-401e-a4a2-9b864c6689e1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:52.345668 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244072fc-0749-4ef1-a89f-c4ffc117b1e0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:52.348699 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b310b8b-c9c7-401e-a4a2-9b864c6689e1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:52.351292 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b310b8b-c9c7-401e-a4a2-9b864c6689e1 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:52.371482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-2b310b8b-c9c7-401e-a4a2-9b864c6689e1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 11:44:52.371482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:52.371482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:52.371482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:52.371482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:52.371482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:52.371482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:52.371482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:52.371482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:52.371482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:52.371482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:52.371482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:52.371482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:44:52.371482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:44:52.371482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:44:52.371482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:44:52.372432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:52.372432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:52.372432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:44:52.372432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:52.372432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:44:52.372432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:52.372432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:52.372432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:52.372432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:52.372432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:52.372432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:52.372432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:52.372432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:52.372432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:52.372432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:52.372432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:52.372432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:52.372432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:52.373375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:52.373375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:52.373375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:44:52.373375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:44:52.373375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:44:52.373375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:44:52.373375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:44:52.373375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:44:52.373375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 11:44:52.373375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:52.374222 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 301/593] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:52.375672 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b310b8b-c9c7-401e-a4a2-9b864c6689e1 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:52.399964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420d716-573a-4b0f-a66d-a46020f6df19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:52.400599 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420d716-573a-4b0f-a66d-a46020f6df19 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:52.400987 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420d716-573a-4b0f-a66d-a46020f6df19 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:52.401262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420d716-573a-4b0f-a66d-a46020f6df19 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:52.409465 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420d716-573a-4b0f-a66d-a46020f6df19 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:52.411124 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420d716-573a-4b0f-a66d-a46020f6df19 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:52.419462 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:52.425046 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-2420d716-573a-4b0f-a66d-a46020f6df19 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 11:44:52.425046 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:52.425046 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:52.425046 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:52.425046 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:52.425046 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:52.425046 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:52.425046 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:52.425046 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:52.425046 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:52.425046 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:52.425046 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:52.425046 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:44:52.425046 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:44:52.425046 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:44:52.425046 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:44:52.427111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:52.427111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:52.427111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:44:52.427111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:52.427111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:44:52.427111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:52.427111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:52.427111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:52.427111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:52.427111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:52.427111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:52.427111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:52.427111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:52.427111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:52.427111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:52.427111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:52.427111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:52.427111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:52.429355 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:52.429355 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:52.429355 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:44:52.429355 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:44:52.429355 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:44:52.429355 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:44:52.429355 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:44:52.429355 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:44:52.429355 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 11:44:52.429355 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:52.435483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 293/594] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:44:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:52.435483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420d716-573a-4b0f-a66d-a46020f6df19 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:52.487622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b310b8b-c9c7-401e-a4a2-9b864c6689e1 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:52.522931 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fea4d0-3e5d-4a4d-b199-53704c4bece1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:52.523633 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fea4d0-3e5d-4a4d-b199-53704c4bece1 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:52.523912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fea4d0-3e5d-4a4d-b199-53704c4bece1 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:52.524182 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fea4d0-3e5d-4a4d-b199-53704c4bece1 None admin] PATH_INFO: `/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/c6682c22be8c4bdca4be33a93e802409/roles/eec5decc24ab4673a246120350336b1e` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:52.539891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fea4d0-3e5d-4a4d-b199-53704c4bece1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba4dff9d637c4afcadfd3cd92b065a41, user_id=c6682c22be8c4bdca4be33a93e802409, role_id=eec5decc24ab4673a246120350336b1e)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:52.541376 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fea4d0-3e5d-4a4d-b199-53704c4bece1 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:52.556137 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 302/595] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:44:52 2022] PUT /identity/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/c6682c22be8c4bdca4be33a93e802409/roles/eec5decc24ab4673a246120350336b1e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:44:52.557090 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fea4d0-3e5d-4a4d-b199-53704c4bece1 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:52.566082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:52.575353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420d716-573a-4b0f-a66d-a46020f6df19 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:52.620693 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881eb18-8a88-4b3d-8c50-572be32ec8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:52.621887 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881eb18-8a88-4b3d-8c50-572be32ec8ad None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:52.622767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881eb18-8a88-4b3d-8c50-572be32ec8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:52.623181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881eb18-8a88-4b3d-8c50-572be32ec8ad None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:52.624408 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881eb18-8a88-4b3d-8c50-572be32ec8ad None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:52.625038 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881eb18-8a88-4b3d-8c50-572be32ec8ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:52.626688 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881eb18-8a88-4b3d-8c50-572be32ec8ad None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:52.653951 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 294/596] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Aug 30 11:44:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:52.657040 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881eb18-8a88-4b3d-8c50-572be32ec8ad None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:52.748826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:52.765144 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fea4d0-3e5d-4a4d-b199-53704c4bece1 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:52.802511 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881eb18-8a88-4b3d-8c50-572be32ec8ad None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:52.810898 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fd384-289a-46a1-ae14-5427f7cec0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:52.811575 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fd384-289a-46a1-ae14-5427f7cec0eb None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:52.811851 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fd384-289a-46a1-ae14-5427f7cec0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:52.812119 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fd384-289a-46a1-ae14-5427f7cec0eb None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:52.812952 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fd384-289a-46a1-ae14-5427f7cec0eb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:52.813344 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fd384-289a-46a1-ae14-5427f7cec0eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:52.814812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fd384-289a-46a1-ae14-5427f7cec0eb None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:52.833690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 303/597] 10.222.0.27 () {56 vars in 1139 bytes} [Tue Aug 30 11:44:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:52.844704 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fd384-289a-46a1-ae14-5427f7cec0eb None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:52.848948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9631f3-05fd-4ad0-8b83-f296de47f8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:52.849593 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9631f3-05fd-4ad0-8b83-f296de47f8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:52.849871 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9631f3-05fd-4ad0-8b83-f296de47f8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:52.850141 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9631f3-05fd-4ad0-8b83-f296de47f8e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:52.865494 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9631f3-05fd-4ad0-8b83-f296de47f8e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:52.867131 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9631f3-05fd-4ad0-8b83-f296de47f8e4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:52.885222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-7d9631f3-05fd-4ad0-8b83-f296de47f8e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:52.885222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:52.885222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:52.885222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:52.885222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:52.885222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:52.885222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:52.885222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:52.885222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:52.885222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:52.885222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:52.885222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:52.885222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:52.885222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:52.885222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:52.885222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:52.886198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:52.886198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:52.886198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:52.886198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:52.886198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:52.886198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:52.886198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:52.886198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:52.886198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:52.886198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:52.886198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:52.886198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:52.886198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:52.886198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:52.886198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:52.886198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:52.886198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:52.887400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:52.887400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:52.887400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:52.887400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 295/598] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:52.894126 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9631f3-05fd-4ad0-8b83-f296de47f8e4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:52.898457 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:53.015283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9631f3-05fd-4ad0-8b83-f296de47f8e4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:53.055028 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79c97f-de40-46ba-b16b-09002e89d21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:53.055673 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79c97f-de40-46ba-b16b-09002e89d21a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:53.055952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79c97f-de40-46ba-b16b-09002e89d21a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:53.056224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79c97f-de40-46ba-b16b-09002e89d21a None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:53.057120 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79c97f-de40-46ba-b16b-09002e89d21a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:53.057426 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79c97f-de40-46ba-b16b-09002e89d21a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:53.059268 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79c97f-de40-46ba-b16b-09002e89d21a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:53.073273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 296/599] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:53.080472 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79c97f-de40-46ba-b16b-09002e89d21a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:53.096234 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fd384-289a-46a1-ae14-5427f7cec0eb None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:53.160143 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e97327-e584-4984-aed4-d03a4a06f35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:53.160701 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e97327-e584-4984-aed4-d03a4a06f35c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:53.160977 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e97327-e584-4984-aed4-d03a4a06f35c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:53.161247 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e97327-e584-4984-aed4-d03a4a06f35c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:53.176789 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:53.178556 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e97327-e584-4984-aed4-d03a4a06f35c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:53.180068 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e97327-e584-4984-aed4-d03a4a06f35c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:53.197532 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:53.210490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-86e97327-e584-4984-aed4-d03a4a06f35c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:53.210490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:53.210490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:53.210490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:53.210490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:53.210490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:53.210490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:53.210490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:53.210490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:53.210490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:53.210490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:53.210490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:53.210490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:53.210490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:53.210490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:53.210490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:53.211522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:53.211522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:53.211522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:53.211522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:53.211522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:53.211522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:53.211522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:53.211522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:53.211522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:53.211522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:53.211522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:53.211522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:53.211522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:53.211522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:53.211522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:53.211522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:53.211522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:53.212396 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:53.212396 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:53.212396 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:53.213103 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 304/600] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:53.219219 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e97327-e584-4984-aed4-d03a4a06f35c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:53.249093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79c97f-de40-46ba-b16b-09002e89d21a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:53.310001 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd6806-2a2b-4322-bece-723234f0a78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:53.310635 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd6806-2a2b-4322-bece-723234f0a78e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:53.310908 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd6806-2a2b-4322-bece-723234f0a78e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:53.311173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd6806-2a2b-4322-bece-723234f0a78e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:53.321852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd6806-2a2b-4322-bece-723234f0a78e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:53.323311 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd6806-2a2b-4322-bece-723234f0a78e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:53.349273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-90dd6806-2a2b-4322-bece-723234f0a78e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:53.349273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:53.349273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:53.349273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:53.349273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:53.349273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:53.349273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:53.349273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:53.349273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:53.349273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:53.349273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:53.349273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:53.349273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:44:53.349273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:44:53.349273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:44:53.350236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:44:53.350236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:53.350236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:53.350236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:53.350236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:53.350236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:53.350236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:53.350236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:53.350236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:53.350236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:53.350236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:53.350236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:53.350236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:53.350236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:53.350236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:53.350236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:53.350236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:53.351118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:44:53.351118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:44:53.351118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:44:53.351118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:44:53.351118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:44:53.351118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:44:53.351118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:53.351118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:53.355819 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 297/601] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:44:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:53.364372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd6806-2a2b-4322-bece-723234f0a78e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:53.377476 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e97327-e584-4984-aed4-d03a4a06f35c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:53.435019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647da727-623d-4fac-a363-e58fe25e51a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:53.435572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647da727-623d-4fac-a363-e58fe25e51a6 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:53.435857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647da727-623d-4fac-a363-e58fe25e51a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:53.436126 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647da727-623d-4fac-a363-e58fe25e51a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:53.436768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647da727-623d-4fac-a363-e58fe25e51a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:53.437068 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647da727-623d-4fac-a363-e58fe25e51a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:53.443007 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647da727-623d-4fac-a363-e58fe25e51a6 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:53.469695 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 305/602] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:53.475254 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647da727-623d-4fac-a363-e58fe25e51a6 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:53.524221 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd6806-2a2b-4322-bece-723234f0a78e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:53.550663 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:53.566152 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95555500-6cff-4a31-aaba-b2956f9248d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:53.568879 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95555500-6cff-4a31-aaba-b2956f9248d9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:53.569161 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95555500-6cff-4a31-aaba-b2956f9248d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:53.569433 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95555500-6cff-4a31-aaba-b2956f9248d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:53.570132 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95555500-6cff-4a31-aaba-b2956f9248d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:53.570431 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95555500-6cff-4a31-aaba-b2956f9248d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:53.571900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95555500-6cff-4a31-aaba-b2956f9248d9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:53.606721 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 298/603] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:44:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:53.612897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95555500-6cff-4a31-aaba-b2956f9248d9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:53.619396 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:53.680343 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647da727-623d-4fac-a363-e58fe25e51a6 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:53.753230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ba381-6b26-4451-8a21-eec19e9ee576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:53.753886 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ba381-6b26-4451-8a21-eec19e9ee576 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:53.754120 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ba381-6b26-4451-8a21-eec19e9ee576 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:53.754318 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ba381-6b26-4451-8a21-eec19e9ee576 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:53.771032 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ba381-6b26-4451-8a21-eec19e9ee576 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:53.772567 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ba381-6b26-4451-8a21-eec19e9ee576 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:53.783341 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95555500-6cff-4a31-aaba-b2956f9248d9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:53.788100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-382ba381-6b26-4451-8a21-eec19e9ee576 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:53.788100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:53.788100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:53.788100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:53.788100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:53.788100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:53.788100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:53.788100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:53.788100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:53.788100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:53.788100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:53.788100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:53.788100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:44:53.788100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:44:53.788100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:44:53.788974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:44:53.788974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:53.788974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:53.788974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:53.788974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:53.788974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:53.788974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:53.788974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:53.788974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:53.788974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:53.788974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:53.788974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:53.788974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:53.788974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:53.788974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:53.788974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:53.788974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:53.789867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:44:53.789867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:44:53.789867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:44:53.789867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:44:53.789867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:44:53.789867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:44:53.789867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:53.789867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:53.789867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 306/604] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:44:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:44:53.791063 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25413a-e58d-499e-9146-80f9b6550dcf None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:53.791063 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25413a-e58d-499e-9146-80f9b6550dcf None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:53.791063 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25413a-e58d-499e-9146-80f9b6550dcf None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:53.795518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 307/605] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:53.797425 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25413a-e58d-499e-9146-80f9b6550dcf None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:53.827043 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fe2cc-ba49-41e5-92ba-305dba519627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:53.827779 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fe2cc-ba49-41e5-92ba-305dba519627 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:53.828171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fe2cc-ba49-41e5-92ba-305dba519627 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:53.828901 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fe2cc-ba49-41e5-92ba-305dba519627 None admin] PATH_INFO: `/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/b9bbec99965e4444bcf88a32502b3257/roles/eec5decc24ab4673a246120350336b1e` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:53.847625 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fe2cc-ba49-41e5-92ba-305dba519627 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba4dff9d637c4afcadfd3cd92b065a41, user_id=b9bbec99965e4444bcf88a32502b3257, role_id=eec5decc24ab4673a246120350336b1e)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:53.849122 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fe2cc-ba49-41e5-92ba-305dba519627 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:53.866696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 299/606] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:44:53 2022] PUT /identity/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/b9bbec99965e4444bcf88a32502b3257/roles/eec5decc24ab4673a246120350336b1e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:44:53.868542 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa2e43-c64d-4306-922f-a8d3e16b27be None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:53.868929 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa2e43-c64d-4306-922f-a8d3e16b27be None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:53.869631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa2e43-c64d-4306-922f-a8d3e16b27be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:53.895270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-aaaa2e43-c64d-4306-922f-a8d3e16b27be None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:53.896965 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-aaaa2e43-c64d-4306-922f-a8d3e16b27be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:53.919691 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25413a-e58d-499e-9146-80f9b6550dcf None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:53.940650 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:53.945447 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:53.963063 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9d3d3-911d-4d24-8e7d-90ead571ec35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:53.963728 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9d3d3-911d-4d24-8e7d-90ead571ec35 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:53.964010 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9d3d3-911d-4d24-8e7d-90ead571ec35 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:53.964690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9d3d3-911d-4d24-8e7d-90ead571ec35 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:53.965489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9d3d3-911d-4d24-8e7d-90ead571ec35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:53.965798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9d3d3-911d-4d24-8e7d-90ead571ec35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:53.967412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9d3d3-911d-4d24-8e7d-90ead571ec35 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:53.983092 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 308/607] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:44:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:53.984318 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e985c-cabd-42d5-a3a0-cc017ac2e0d3 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:53.984614 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e985c-cabd-42d5-a3a0-cc017ac2e0d3 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:53.984883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e985c-cabd-42d5-a3a0-cc017ac2e0d3 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:53.990214 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 309/608] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:53.990214 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e985c-cabd-42d5-a3a0-cc017ac2e0d3 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:54.014051 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 300/609] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:54.015986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00777d-899d-4f26-992a-f4703e5f9cc0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:54.016928 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00777d-899d-4f26-992a-f4703e5f9cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:54.017401 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00777d-899d-4f26-992a-f4703e5f9cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:54.040121 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ec00777d-899d-4f26-992a-f4703e5f9cc0 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:54.041845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ec00777d-899d-4f26-992a-f4703e5f9cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:54.130824 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e985c-cabd-42d5-a3a0-cc017ac2e0d3 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:54.139918 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 301/610] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:54.181937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a27a8-6d81-476e-9ef5-2eecb950c2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:54.182611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a27a8-6d81-476e-9ef5-2eecb950c2f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:54.182888 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a27a8-6d81-476e-9ef5-2eecb950c2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:54.183159 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a27a8-6d81-476e-9ef5-2eecb950c2f2 None admin] PATH_INFO: `/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/f3be96d37b4e4dd889be755b004bfe52/roles/eec5decc24ab4673a246120350336b1e` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:54.198994 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a27a8-6d81-476e-9ef5-2eecb950c2f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba4dff9d637c4afcadfd3cd92b065a41, user_id=f3be96d37b4e4dd889be755b004bfe52, role_id=eec5decc24ab4673a246120350336b1e)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:54.201269 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a27a8-6d81-476e-9ef5-2eecb950c2f2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:54.226786 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 310/611] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:44:53 2022] PUT /identity/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/f3be96d37b4e4dd889be755b004bfe52/roles/eec5decc24ab4673a246120350336b1e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:44:54.302935 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00777d-899d-4f26-992a-f4703e5f9cc0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:54.409195 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:54.416097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00777d-899d-4f26-992a-f4703e5f9cc0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:54.447935 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a27a8-6d81-476e-9ef5-2eecb950c2f2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:54.455660 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8621f4-8551-4862-a50c-8f95d0f51ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:54.456325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8621f4-8551-4862-a50c-8f95d0f51ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:54.456604 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8621f4-8551-4862-a50c-8f95d0f51ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:54.456934 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8621f4-8551-4862-a50c-8f95d0f51ba4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:54.472316 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8621f4-8551-4862-a50c-8f95d0f51ba4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:54.477766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-7d8621f4-8551-4862-a50c-8f95d0f51ba4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:54.477766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:54.477766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:54.477766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:54.477766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:54.477766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:54.477766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:54.477766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:54.477766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:54.477766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:54.477766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:54.477766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:54.477766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:54.477766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:54.477766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:54.477766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:54.478751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:54.478751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:54.478751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:54.478751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:54.478751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:54.478751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:54.478751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:54.478751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:54.478751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:54.478751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:54.478751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:54.478751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:54.478751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:54.478751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:54.478751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:54.478751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:54.479707 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:54.479707 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:54.479707 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:54.479707 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:54.479707 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:54.479707 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:54.479707 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:54.479707 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:54.479707 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:54.479707 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:54.479707 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:54.479707 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:54.482666 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 302/612] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:44:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:54.488338 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:54.489569 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8621f4-8551-4862-a50c-8f95d0f51ba4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:54.585692 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a27a8-6d81-476e-9ef5-2eecb950c2f2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:54.606509 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8621f4-8551-4862-a50c-8f95d0f51ba4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:54.631009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358a1c0-e787-4cea-b461-c175f2a7ab78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:54.631710 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358a1c0-e787-4cea-b461-c175f2a7ab78 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:54.631989 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358a1c0-e787-4cea-b461-c175f2a7ab78 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:54.632260 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358a1c0-e787-4cea-b461-c175f2a7ab78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:54.646129 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7132387-c7c4-435c-b081-132629be1622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:54.646466 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358a1c0-e787-4cea-b461-c175f2a7ab78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:54.647308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7132387-c7c4-435c-b081-132629be1622 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:54.647803 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7132387-c7c4-435c-b081-132629be1622 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:54.648259 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7132387-c7c4-435c-b081-132629be1622 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:54.649121 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7132387-c7c4-435c-b081-132629be1622 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:54.649621 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7132387-c7c4-435c-b081-132629be1622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:54.651222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7132387-c7c4-435c-b081-132629be1622 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:54.651461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-d358a1c0-e787-4cea-b461-c175f2a7ab78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:54.651461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:54.651461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:54.651461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:54.651461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:54.651461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:54.651461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:54.651461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:54.651461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:54.651461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:54.651461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:54.651461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:54.651461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:54.651461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:54.651461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:54.651461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:54.652372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:54.652372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:54.652372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:54.652372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:54.652372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:54.652372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:54.652372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:54.652372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:54.652372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:54.652372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:54.652372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:54.652372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:54.652372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:54.652372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:54.652372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:54.652372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:54.653178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:54.653178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:54.653178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:54.653178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:54.653178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:54.653178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:54.653178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:54.653178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:54.653178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:54.653178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:54.653178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:54.653178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:54.653178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 311/613] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:44:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:54.661557 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358a1c0-e787-4cea-b461-c175f2a7ab78 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:54.673810 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 303/614] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Aug 30 11:44:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:54.684723 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7132387-c7c4-435c-b081-132629be1622 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:54.722290 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:54.814927 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7132387-c7c4-435c-b081-132629be1622 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:54.853466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809342f-6434-42e8-8e8b-243b76ddb231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:54.854034 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809342f-6434-42e8-8e8b-243b76ddb231 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:54.854723 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809342f-6434-42e8-8e8b-243b76ddb231 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:54.855009 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809342f-6434-42e8-8e8b-243b76ddb231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:54.867672 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809342f-6434-42e8-8e8b-243b76ddb231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:54.869649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809342f-6434-42e8-8e8b-243b76ddb231 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:54.883420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:54.885676 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-f809342f-6434-42e8-8e8b-243b76ddb231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:54.885676 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:54.885676 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:54.885676 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:54.885676 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:54.885676 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:54.885676 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:54.885676 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:54.885676 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:54.885676 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:54.885676 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:54.885676 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:54.885676 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:54.885676 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:54.885676 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:54.885676 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:54.886578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:54.886578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:54.886578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:54.886578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:54.886578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:54.886578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:54.886578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:54.886578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:54.886578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:54.886578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:54.886578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:54.886578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:54.886578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:54.886578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:54.886578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:54.886578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:54.886578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:54.887494 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:54.887494 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:54.887494 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:54.887494 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 304/615] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:44:54.895503 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809342f-6434-42e8-8e8b-243b76ddb231 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:54.918010 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358a1c0-e787-4cea-b461-c175f2a7ab78 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:54.967601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebd648-4208-4d24-8829-b41a5ea83b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:54.968273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebd648-4208-4d24-8829-b41a5ea83b1a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:54.968613 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebd648-4208-4d24-8829-b41a5ea83b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:54.969527 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebd648-4208-4d24-8829-b41a5ea83b1a None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:54.970269 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ebd648-4208-4d24-8829-b41a5ea83b1a None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:54.970597 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ebd648-4208-4d24-8829-b41a5ea83b1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:54.971432 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:54.973369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ebd648-4208-4d24-8829-b41a5ea83b1a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:54.988593 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 312/616] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Aug 30 11:44:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:54.990619 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c7b9e-738d-4090-b039-05b83374ccc2 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:54.990914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c7b9e-738d-4090-b039-05b83374ccc2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:54.991193 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c7b9e-738d-4090-b039-05b83374ccc2 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:54.992973 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 313/617] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:54.993619 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c7b9e-738d-4090-b039-05b83374ccc2 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:55.009084 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809342f-6434-42e8-8e8b-243b76ddb231 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:55.044380 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77086d38-1387-4261-b8aa-2691cbd74f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:55.045849 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77086d38-1387-4261-b8aa-2691cbd74f37 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:55.046378 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77086d38-1387-4261-b8aa-2691cbd74f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:55.046741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77086d38-1387-4261-b8aa-2691cbd74f37 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:55.047432 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77086d38-1387-4261-b8aa-2691cbd74f37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:55.047826 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77086d38-1387-4261-b8aa-2691cbd74f37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:55.049364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77086d38-1387-4261-b8aa-2691cbd74f37 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:55.066687 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 305/618] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:55.068161 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb6b4b-bba4-49fc-84e6-e92e72cabc94 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:55.068495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb6b4b-bba4-49fc-84e6-e92e72cabc94 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:55.068862 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb6b4b-bba4-49fc-84e6-e92e72cabc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:55.087105 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8deb6b4b-bba4-49fc-84e6-e92e72cabc94 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:55.088419 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8deb6b4b-bba4-49fc-84e6-e92e72cabc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:55.137233 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c7b9e-738d-4090-b039-05b83374ccc2 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:55.167166 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 306/619] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:55.167166 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb6b4b-bba4-49fc-84e6-e92e72cabc94 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:55.203639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2987034-fded-4302-baeb-2ad658e4ae35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:55.204792 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2987034-fded-4302-baeb-2ad658e4ae35 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:55.205347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2987034-fded-4302-baeb-2ad658e4ae35 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:55.206808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2987034-fded-4302-baeb-2ad658e4ae35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:55.223979 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2987034-fded-4302-baeb-2ad658e4ae35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:55.228297 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2987034-fded-4302-baeb-2ad658e4ae35 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:55.260746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-d2987034-fded-4302-baeb-2ad658e4ae35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:55.260746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:55.260746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:55.260746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:55.260746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:55.260746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:55.260746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:55.260746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:55.260746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:55.260746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:55.260746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:55.260746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:55.260746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:55.260746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:55.260746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:55.260746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:55.261908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:55.261908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:55.261908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:55.261908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:55.261908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:55.261908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:55.261908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:55.261908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:55.261908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:55.261908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:55.261908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:55.261908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:55.261908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:55.261908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:55.261908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:55.261908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:55.261908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:55.262954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:55.262954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:55.262954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:55.262954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 314/620] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:55.270442 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2987034-fded-4302-baeb-2ad658e4ae35 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:55.273763 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:55.274640 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:55.332374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb6b4b-bba4-49fc-84e6-e92e72cabc94 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:55.398910 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1499b-efab-407e-a8d4-23f5d0850ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:55.399643 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1499b-efab-407e-a8d4-23f5d0850ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:55.401297 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1499b-efab-407e-a8d4-23f5d0850ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:55.401813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1499b-efab-407e-a8d4-23f5d0850ae0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:55.418806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1499b-efab-407e-a8d4-23f5d0850ae0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:55.420482 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1499b-efab-407e-a8d4-23f5d0850ae0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:55.442000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-2ff1499b-efab-407e-a8d4-23f5d0850ae0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:44:55.442000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:55.442000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:55.442000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:55.442000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:55.442000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:55.442000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:55.442000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:55.442000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:55.442000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:55.442000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:55.442000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:55.442000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:44:55.442000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:44:55.442000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:44:55.442000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:44:55.443442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:55.443442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:55.443442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:44:55.443442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:55.443442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:44:55.443442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:55.443442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:55.443442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:55.443442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:55.443442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:55.443442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:55.443442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:55.443442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:55.443442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:55.443442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:55.443442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:55.443442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:55.443442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:55.444616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:55.444616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:55.444616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:44:55.444616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:44:55.444616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:44:55.444616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:44:55.444616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:44:55.444616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:44:55.444616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:44:55.444616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:55.451259 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 307/621] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Aug 30 11:44:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:55.457745 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1499b-efab-407e-a8d4-23f5d0850ae0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:55.471120 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2987034-fded-4302-baeb-2ad658e4ae35 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:55.521563 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606bc00-5e36-4b6e-94c8-608041c05d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:55.522173 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606bc00-5e36-4b6e-94c8-608041c05d3b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:55.522449 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606bc00-5e36-4b6e-94c8-608041c05d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:55.522717 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606bc00-5e36-4b6e-94c8-608041c05d3b None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:55.523531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606bc00-5e36-4b6e-94c8-608041c05d3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:55.524217 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606bc00-5e36-4b6e-94c8-608041c05d3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:55.525868 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606bc00-5e36-4b6e-94c8-608041c05d3b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:55.541384 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 315/622] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:44:55.542292 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606bc00-5e36-4b6e-94c8-608041c05d3b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:55.588964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1499b-efab-407e-a8d4-23f5d0850ae0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:55.613706 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:55.619288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:55.630765 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8eaf8a-97d2-40d6-b01a-dec85abea704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:55.632112 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eaf8a-97d2-40d6-b01a-dec85abea704 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:55.632392 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eaf8a-97d2-40d6-b01a-dec85abea704 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:55.632662 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eaf8a-97d2-40d6-b01a-dec85abea704 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:55.633412 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8eaf8a-97d2-40d6-b01a-dec85abea704 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:55.634129 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8eaf8a-97d2-40d6-b01a-dec85abea704 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:55.636040 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8eaf8a-97d2-40d6-b01a-dec85abea704 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:55.661048 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 308/623] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Aug 30 11:44:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:55.666439 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8eaf8a-97d2-40d6-b01a-dec85abea704 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:55.668771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606bc00-5e36-4b6e-94c8-608041c05d3b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:55.705299 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84307d7-2e1a-47b2-b5ba-b014c84009d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:55.705938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84307d7-2e1a-47b2-b5ba-b014c84009d1 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:55.706252 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84307d7-2e1a-47b2-b5ba-b014c84009d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:55.706522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84307d7-2e1a-47b2-b5ba-b014c84009d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:55.717963 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84307d7-2e1a-47b2-b5ba-b014c84009d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:55.722993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-a84307d7-2e1a-47b2-b5ba-b014c84009d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:55.722993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:55.722993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:55.722993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:55.722993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:55.722993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:55.722993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:55.722993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:55.722993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:55.722993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:55.722993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:55.722993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:55.722993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:55.722993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:55.722993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:55.722993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:55.723949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:55.723949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:55.723949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:55.723949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:55.723949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:55.723949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:55.723949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:55.723949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:55.723949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:55.723949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:55.723949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:55.723949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:55.723949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:55.723949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:55.723949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:55.723949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:55.724778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:55.724778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:55.724778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:55.724778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:55.724778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:55.724778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:55.724778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:55.724778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:55.724778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:55.724778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:55.724778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:55.724778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:55.727620 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 316/624] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:44:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:55.728438 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84307d7-2e1a-47b2-b5ba-b014c84009d1 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:55.808638 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8eaf8a-97d2-40d6-b01a-dec85abea704 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:55.838667 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84307d7-2e1a-47b2-b5ba-b014c84009d1 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:55.854168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1ccbe-a1d9-4080-b4f4-23ded857d99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:55.855451 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1ccbe-a1d9-4080-b4f4-23ded857d99f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:55.855940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1ccbe-a1d9-4080-b4f4-23ded857d99f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:55.856563 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1ccbe-a1d9-4080-b4f4-23ded857d99f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:55.863714 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:55.867302 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1ccbe-a1d9-4080-b4f4-23ded857d99f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:55.870105 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1ccbe-a1d9-4080-b4f4-23ded857d99f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:55.881249 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd89f79-e826-474a-b0cb-a5b9ddb7af6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:55.881862 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd89f79-e826-474a-b0cb-a5b9ddb7af6d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:55.882132 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd89f79-e826-474a-b0cb-a5b9ddb7af6d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:55.882398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd89f79-e826-474a-b0cb-a5b9ddb7af6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:55.888618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-5aa1ccbe-a1d9-4080-b4f4-23ded857d99f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:44:55.888618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:55.888618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:55.888618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:55.888618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:55.888618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:55.888618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:55.888618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:55.888618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:55.888618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:55.888618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:55.888618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:55.888618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:44:55.888618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:44:55.888618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:44:55.888618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:44:55.889540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:55.889540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:55.889540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:44:55.889540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:55.889540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:44:55.889540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:55.889540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:55.889540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:55.889540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:55.889540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:55.889540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:55.889540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:55.889540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:55.889540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:55.889540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:55.889540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:55.889540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:55.889540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:55.890734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:55.890734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:55.890734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:44:55.890734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:44:55.890734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:44:55.890734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:44:55.890734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:44:55.890734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:44:55.890734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:44:55.890734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:55.893085 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 309/625] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:44:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:55.894583 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1ccbe-a1d9-4080-b4f4-23ded857d99f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:55.933852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:55.953493 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd89f79-e826-474a-b0cb-a5b9ddb7af6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:55.955240 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd89f79-e826-474a-b0cb-a5b9ddb7af6d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:56.007964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1ccbe-a1d9-4080-b4f4-23ded857d99f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:56.042080 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f16d0-7cc1-4c95-9ef2-8485d23e5cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:56.042694 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f16d0-7cc1-4c95-9ef2-8485d23e5cff None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:56.042987 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f16d0-7cc1-4c95-9ef2-8485d23e5cff None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:56.043230 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f16d0-7cc1-4c95-9ef2-8485d23e5cff None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:56.043901 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f16d0-7cc1-4c95-9ef2-8485d23e5cff None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:56.044203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f16d0-7cc1-4c95-9ef2-8485d23e5cff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:56.045571 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f16d0-7cc1-4c95-9ef2-8485d23e5cff None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:56.059027 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 310/626] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Aug 30 11:44:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:56.059027 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f16d0-7cc1-4c95-9ef2-8485d23e5cff None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:56.073873 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 317/627] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:56.073873 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381568a-0435-47c9-9513-9b225271bc06 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:56.073873 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381568a-0435-47c9-9513-9b225271bc06 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:56.073873 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381568a-0435-47c9-9513-9b225271bc06 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:56.076676 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 318/628] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:56.077314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381568a-0435-47c9-9513-9b225271bc06 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:56.103802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:56.170413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:56.175839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f16d0-7cc1-4c95-9ef2-8485d23e5cff None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:56.190879 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381568a-0435-47c9-9513-9b225271bc06 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:56.218663 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185d301-3021-4cca-a7ad-4c77cadd5841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:56.219286 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185d301-3021-4cca-a7ad-4c77cadd5841 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:56.219595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185d301-3021-4cca-a7ad-4c77cadd5841 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:56.219864 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185d301-3021-4cca-a7ad-4c77cadd5841 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:56.220600 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185d301-3021-4cca-a7ad-4c77cadd5841 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:56.220901 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185d301-3021-4cca-a7ad-4c77cadd5841 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:56.222342 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185d301-3021-4cca-a7ad-4c77cadd5841 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:56.226632 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dcacb4-611e-4539-b5ab-ee3016dbb506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:56.227346 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcacb4-611e-4539-b5ab-ee3016dbb506 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:56.227650 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcacb4-611e-4539-b5ab-ee3016dbb506 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:56.227949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcacb4-611e-4539-b5ab-ee3016dbb506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:56.238467 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dcacb4-611e-4539-b5ab-ee3016dbb506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:56.239965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dcacb4-611e-4539-b5ab-ee3016dbb506 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:56.245195 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 311/629] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Aug 30 11:44:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:56.245195 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185d301-3021-4cca-a7ad-4c77cadd5841 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:56.259754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-96dcacb4-611e-4539-b5ab-ee3016dbb506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:56.259754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:56.259754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:56.259754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:56.259754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:56.259754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:56.259754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:56.259754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:56.259754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:56.259754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:56.259754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:56.259754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:56.259754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:56.259754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:56.259754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:56.259754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:56.260726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:56.260726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:56.260726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:56.260726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:56.260726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:56.260726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:56.260726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:56.260726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:56.260726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:56.260726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:56.260726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:56.260726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:56.260726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:56.260726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:56.260726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:56.260726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:56.260726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:56.261645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:56.261645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:56.261645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:56.261645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 319/630] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:56.262304 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b1dc5-eb99-4f9e-bc8e-754d455afb43 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:56.262304 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b1dc5-eb99-4f9e-bc8e-754d455afb43 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:56.262649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b1dc5-eb99-4f9e-bc8e-754d455afb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:56.280803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-545b1dc5-eb99-4f9e-bc8e-754d455afb43 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:56.282014 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-545b1dc5-eb99-4f9e-bc8e-754d455afb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:56.351227 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185d301-3021-4cca-a7ad-4c77cadd5841 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:56.355460 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 320/631] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:56.355460 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b1dc5-eb99-4f9e-bc8e-754d455afb43 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:56.362125 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:56.404445 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f338d-fce8-4119-9236-527233ce0f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:56.405475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f338d-fce8-4119-9236-527233ce0f02 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:56.406247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f338d-fce8-4119-9236-527233ce0f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:56.406668 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f338d-fce8-4119-9236-527233ce0f02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:56.428130 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f338d-fce8-4119-9236-527233ce0f02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:56.429822 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f338d-fce8-4119-9236-527233ce0f02 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:56.451611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-549f338d-fce8-4119-9236-527233ce0f02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:56.451611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:56.451611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:56.451611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:56.451611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:56.451611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:56.451611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:56.451611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:56.451611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:56.451611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:56.451611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:56.451611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:56.451611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:56.451611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:56.451611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:56.451611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:56.452818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:56.452818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:56.452818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:56.452818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:56.452818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:56.452818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:56.452818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:56.452818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:56.452818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:56.452818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:56.452818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:56.452818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:56.452818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:56.452818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:56.452818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:56.452818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:56.452818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:56.453976 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:56.453976 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:56.453976 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:56.455799 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 312/632] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:56.457337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f338d-fce8-4119-9236-527233ce0f02 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:56.473898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:56.489017 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b1dc5-eb99-4f9e-bc8e-754d455afb43 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:56.536590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1ac1f-473d-48e5-b23f-3f5d64f005a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:56.537581 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1ac1f-473d-48e5-b23f-3f5d64f005a6 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:56.538032 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1ac1f-473d-48e5-b23f-3f5d64f005a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:56.538443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1ac1f-473d-48e5-b23f-3f5d64f005a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:56.549589 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1ac1f-473d-48e5-b23f-3f5d64f005a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:56.551062 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1ac1f-473d-48e5-b23f-3f5d64f005a6 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:56.566505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-8bb1ac1f-473d-48e5-b23f-3f5d64f005a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:56.566505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:56.566505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:56.566505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:56.566505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:56.566505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:56.566505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:56.566505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:56.566505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:56.566505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:56.566505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:56.566505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:56.566505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:56.566505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:56.566505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:56.566505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:56.567536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:56.567536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:56.567536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:56.567536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:56.567536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:56.567536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:56.567536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:56.567536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:56.567536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:56.567536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:56.567536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:56.567536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:56.567536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:56.567536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:56.567536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:56.567536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:56.567536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:56.568413 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:56.568413 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:56.568413 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:56.568413 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 321/633] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:56.568665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1ac1f-473d-48e5-b23f-3f5d64f005a6 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:56.590500 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f338d-fce8-4119-9236-527233ce0f02 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:56.628008 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df239628-f636-4d08-b984-0b8f4d227112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:56.628941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df239628-f636-4d08-b984-0b8f4d227112 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:56.628941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df239628-f636-4d08-b984-0b8f4d227112 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:56.629138 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df239628-f636-4d08-b984-0b8f4d227112 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:56.629760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df239628-f636-4d08-b984-0b8f4d227112 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:56.630055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df239628-f636-4d08-b984-0b8f4d227112 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:56.631453 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df239628-f636-4d08-b984-0b8f4d227112 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:56.633464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:56.648337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 313/634] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:56.648337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73887ce-2394-4097-b59e-0d7a78ccd3fb None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:56.648337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73887ce-2394-4097-b59e-0d7a78ccd3fb None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:56.648337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73887ce-2394-4097-b59e-0d7a78ccd3fb None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:56.648337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 314/635] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:56.648337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73887ce-2394-4097-b59e-0d7a78ccd3fb None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:56.685912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1ac1f-473d-48e5-b23f-3f5d64f005a6 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:56.719658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:56.720956 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db2a1f-15ac-4a49-82e1-4a4c66159773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:56.721565 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db2a1f-15ac-4a49-82e1-4a4c66159773 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:56.721840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db2a1f-15ac-4a49-82e1-4a4c66159773 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:56.722094 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db2a1f-15ac-4a49-82e1-4a4c66159773 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:56.722727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db2a1f-15ac-4a49-82e1-4a4c66159773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:56.723023 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db2a1f-15ac-4a49-82e1-4a4c66159773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:56.724446 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db2a1f-15ac-4a49-82e1-4a4c66159773 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:56.736151 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 322/636] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:56.736929 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db2a1f-15ac-4a49-82e1-4a4c66159773 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:56.755063 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73887ce-2394-4097-b59e-0d7a78ccd3fb None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:56.789034 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd188eb-33f9-42ca-9fee-f1c3b044882b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:56.789742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd188eb-33f9-42ca-9fee-f1c3b044882b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:56.790085 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd188eb-33f9-42ca-9fee-f1c3b044882b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:56.790420 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd188eb-33f9-42ca-9fee-f1c3b044882b None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:56.791138 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd188eb-33f9-42ca-9fee-f1c3b044882b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:56.791533 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd188eb-33f9-42ca-9fee-f1c3b044882b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:56.792992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd188eb-33f9-42ca-9fee-f1c3b044882b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:56.804095 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 315/637] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:56.804985 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd188eb-33f9-42ca-9fee-f1c3b044882b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:56.843875 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db2a1f-15ac-4a49-82e1-4a4c66159773 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:56.860549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:56.878649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2650ac-f581-4df6-a7b1-2d05b67a3287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:56.879280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2650ac-f581-4df6-a7b1-2d05b67a3287 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:56.879586 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2650ac-f581-4df6-a7b1-2d05b67a3287 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:56.879855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2650ac-f581-4df6-a7b1-2d05b67a3287 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:56.890011 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2650ac-f581-4df6-a7b1-2d05b67a3287 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:56.895091 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-5a2650ac-f581-4df6-a7b1-2d05b67a3287 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:56.895091 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:56.895091 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:56.895091 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:56.895091 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:56.895091 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:56.895091 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:56.895091 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:56.895091 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:56.895091 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:56.895091 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:56.895091 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:56.895091 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:56.895091 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:56.895091 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:56.895091 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:56.896314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:56.896314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:56.896314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:56.896314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:56.896314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:56.896314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:56.896314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:56.896314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:56.896314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:56.896314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:56.896314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:56.896314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:56.896314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:56.896314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:56.896314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:56.896314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:56.897161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:56.897161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:56.897161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:56.897161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:56.897161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:56.897161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:56.897161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:56.897161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:56.897161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:56.897161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:56.897161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:56.897161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:56.897161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 323/638] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:44:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:56.897839 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57f923-da0a-435a-a6a0-877840b32154 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:56.897839 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57f923-da0a-435a-a6a0-877840b32154 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:56.897978 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57f923-da0a-435a-a6a0-877840b32154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:56.905474 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd188eb-33f9-42ca-9fee-f1c3b044882b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:56.915205 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-bc57f923-da0a-435a-a6a0-877840b32154 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:44:56.916428 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bc57f923-da0a-435a-a6a0-877840b32154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:44:56.931469 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:56.939383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162252b-66c0-488f-a642-47bc60577100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:56.940031 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162252b-66c0-488f-a642-47bc60577100 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:56.940303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162252b-66c0-488f-a642-47bc60577100 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:56.940566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162252b-66c0-488f-a642-47bc60577100 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:56.947936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162252b-66c0-488f-a642-47bc60577100 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:56.949362 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162252b-66c0-488f-a642-47bc60577100 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:56.960658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9162252b-66c0-488f-a642-47bc60577100 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 11:44:56.960658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:56.960658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:56.960658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:56.960658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:56.960658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:56.960658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:56.960658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:56.960658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:56.960658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:56.960658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:56.960658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:56.960658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:44:56.960658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:44:56.960658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:44:56.960658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:44:56.961655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:56.961655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:56.961655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:44:56.961655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:56.961655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:44:56.961655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:56.961655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:56.961655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:56.961655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:56.961655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:56.961655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:56.961655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:56.961655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:56.961655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:56.961655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:56.961655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:56.961655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:56.961655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:56.962574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:56.962574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:56.962574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:44:56.962574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:44:56.962574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:44:56.962574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:44:56.962574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:44:56.962574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:44:56.962574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 11:44:56.962574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:56.962574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 316/639] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:56.963195 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162252b-66c0-488f-a642-47bc60577100 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:56.987673 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 324/640] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:44:56.988573 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57f923-da0a-435a-a6a0-877840b32154 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:57.065550 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162252b-66c0-488f-a642-47bc60577100 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:57.098543 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda8bc7-0155-4b4b-b809-5e2bbc535f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:57.099263 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda8bc7-0155-4b4b-b809-5e2bbc535f4f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:57.099627 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda8bc7-0155-4b4b-b809-5e2bbc535f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:57.099959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda8bc7-0155-4b4b-b809-5e2bbc535f4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:57.107854 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda8bc7-0155-4b4b-b809-5e2bbc535f4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:57.110471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda8bc7-0155-4b4b-b809-5e2bbc535f4f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:57.111550 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57f923-da0a-435a-a6a0-877840b32154 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:57.118799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:57.124572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3fda8bc7-0155-4b4b-b809-5e2bbc535f4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:57.124572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:57.124572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:57.124572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:57.124572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:57.124572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:57.124572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:57.124572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:57.124572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:57.124572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:57.124572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:57.124572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:57.124572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:44:57.124572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:44:57.124572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:44:57.125814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:44:57.125814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:57.125814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:57.125814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:57.125814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:57.125814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:57.125814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:57.125814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:57.125814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:57.125814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:57.125814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:57.125814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:57.125814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:57.125814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:57.125814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:57.125814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:57.125814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:57.126724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:44:57.126724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:44:57.126724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:44:57.126724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:44:57.126724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:44:57.126724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:44:57.126724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:57.126724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:57.126724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 317/641] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:57.127225 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda8bc7-0155-4b4b-b809-5e2bbc535f4f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:57.154514 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ed234-fd5f-452e-b748-bc7b78dd17d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:57.155141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ed234-fd5f-452e-b748-bc7b78dd17d9 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:57.155516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ed234-fd5f-452e-b748-bc7b78dd17d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:57.155713 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ed234-fd5f-452e-b748-bc7b78dd17d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:57.162779 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ed234-fd5f-452e-b748-bc7b78dd17d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:57.164257 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ed234-fd5f-452e-b748-bc7b78dd17d9 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:57.175803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-469ed234-fd5f-452e-b748-bc7b78dd17d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:57.175803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:57.175803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:57.175803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:57.175803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:57.175803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:57.175803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:57.175803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:57.175803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:57.175803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:57.175803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:57.175803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:57.175803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:44:57.175803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:44:57.175803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:44:57.176909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:44:57.176909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:57.176909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:57.176909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:57.176909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:57.176909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:57.176909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:57.176909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:57.176909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:57.176909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:57.176909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:57.176909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:57.176909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:57.176909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:57.176909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:57.176909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:57.176909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:57.177977 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:44:57.177977 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:44:57.177977 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:44:57.177977 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:44:57.177977 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:44:57.177977 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:44:57.177977 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:57.177977 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:57.177977 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 325/642] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:57.177977 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ed234-fd5f-452e-b748-bc7b78dd17d9 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:57.183639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:57.239838 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda8bc7-0155-4b4b-b809-5e2bbc535f4f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:57.274507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbabc9-06b4-4202-a745-ee22ea4a0220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:57.275116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbabc9-06b4-4202-a745-ee22ea4a0220 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:57.275415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbabc9-06b4-4202-a745-ee22ea4a0220 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:57.275688 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbabc9-06b4-4202-a745-ee22ea4a0220 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:57.276343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbabc9-06b4-4202-a745-ee22ea4a0220 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:57.276640 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbabc9-06b4-4202-a745-ee22ea4a0220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:57.278019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbabc9-06b4-4202-a745-ee22ea4a0220 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:57.282414 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ed234-fd5f-452e-b748-bc7b78dd17d9 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:57.285695 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 318/643] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Aug 30 11:44:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:57.286465 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbabc9-06b4-4202-a745-ee22ea4a0220 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:57.317151 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e98e0-7098-448d-8cb9-61c085ca5ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:57.317750 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e98e0-7098-448d-8cb9-61c085ca5ecb None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:57.318024 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e98e0-7098-448d-8cb9-61c085ca5ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:57.318292 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e98e0-7098-448d-8cb9-61c085ca5ecb None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:57.319009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e98e0-7098-448d-8cb9-61c085ca5ecb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:57.319309 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e98e0-7098-448d-8cb9-61c085ca5ecb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:57.320778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e98e0-7098-448d-8cb9-61c085ca5ecb None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:57.337373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 326/644] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Aug 30 11:44:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:57.338156 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e98e0-7098-448d-8cb9-61c085ca5ecb None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:57.364009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:57.386264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbabc9-06b4-4202-a745-ee22ea4a0220 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:57.396645 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:57.420328 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73feaa-4d62-4d4b-9318-058df59e3200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:57.420938 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73feaa-4d62-4d4b-9318-058df59e3200 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:57.421212 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73feaa-4d62-4d4b-9318-058df59e3200 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:57.421564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73feaa-4d62-4d4b-9318-058df59e3200 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:57.422302 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73feaa-4d62-4d4b-9318-058df59e3200 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:57.422605 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73feaa-4d62-4d4b-9318-058df59e3200 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:57.424071 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73feaa-4d62-4d4b-9318-058df59e3200 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:57.435917 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 319/645] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:44:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:57.438594 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e98e0-7098-448d-8cb9-61c085ca5ecb None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:57.441561 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73feaa-4d62-4d4b-9318-058df59e3200 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:57.474620 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7450a4-4838-40d5-a2b0-0a5d721d1fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:57.475228 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7450a4-4838-40d5-a2b0-0a5d721d1fbc None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:57.475547 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7450a4-4838-40d5-a2b0-0a5d721d1fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:57.475822 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7450a4-4838-40d5-a2b0-0a5d721d1fbc None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:57.476511 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7450a4-4838-40d5-a2b0-0a5d721d1fbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:57.476817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7450a4-4838-40d5-a2b0-0a5d721d1fbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:57.478271 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7450a4-4838-40d5-a2b0-0a5d721d1fbc None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:57.489728 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 327/646] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:44:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:57.490463 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7450a4-4838-40d5-a2b0-0a5d721d1fbc None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:57.544146 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73feaa-4d62-4d4b-9318-058df59e3200 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:57.572583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:57.576603 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf56ba4-5eea-45bf-89da-2df77679bd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:57.577246 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf56ba4-5eea-45bf-89da-2df77679bd02 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:57.577526 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf56ba4-5eea-45bf-89da-2df77679bd02 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:57.577859 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf56ba4-5eea-45bf-89da-2df77679bd02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:57.588050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf56ba4-5eea-45bf-89da-2df77679bd02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:44:57.588178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7450a4-4838-40d5-a2b0-0a5d721d1fbc None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:57.593181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-0cf56ba4-5eea-45bf-89da-2df77679bd02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:57.593181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:57.593181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:57.593181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:57.593181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:57.593181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:57.593181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:57.593181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:57.593181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:57.593181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:57.593181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:57.593181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:57.593181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:44:57.593181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:44:57.593181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:44:57.593181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:44:57.594475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:44:57.594475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:44:57.594475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:44:57.594475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:44:57.594475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:57.594475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:57.594475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:57.594475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:57.594475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:57.594475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:57.594475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:57.594475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:57.594475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:57.594475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:57.594475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:57.594475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:57.595325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:57.595325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:57.595325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:57.595325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:57.595325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:44:57.595325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:44:57.595325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:44:57.595325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:44:57.595325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:44:57.595325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:44:57.595325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:44:57.595325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:57.595325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 320/647] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:44:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:57.595325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf56ba4-5eea-45bf-89da-2df77679bd02 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:57.623123 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789aced-0c6c-4fa4-a602-2462f988cc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:57.623794 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789aced-0c6c-4fa4-a602-2462f988cc89 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:57.624075 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789aced-0c6c-4fa4-a602-2462f988cc89 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:57.624351 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789aced-0c6c-4fa4-a602-2462f988cc89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:57.625862 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:57.635010 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789aced-0c6c-4fa4-a602-2462f988cc89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:57.636616 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789aced-0c6c-4fa4-a602-2462f988cc89 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:57.651290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-0789aced-0c6c-4fa4-a602-2462f988cc89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:57.651290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:57.651290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:57.651290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:57.651290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:57.651290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:57.651290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:57.651290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:57.651290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:57.651290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:57.651290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:57.651290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:57.651290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:57.651290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:57.651290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:57.651290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:57.652495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:57.652495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:57.652495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:57.652495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:57.652495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:57.652495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:57.652495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:57.652495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:57.652495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:57.652495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:57.652495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:57.652495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:57.652495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:57.652495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:57.652495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:57.652495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:57.652495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:57.653384 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:57.653384 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:57.653384 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:57.653384 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 328/648] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:57.653384 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789aced-0c6c-4fa4-a602-2462f988cc89 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:57.698820 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf56ba4-5eea-45bf-89da-2df77679bd02 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:57.738964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816b33a-c929-406d-894f-efe22f083538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:57.739633 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816b33a-c929-406d-894f-efe22f083538 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:57.739918 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816b33a-c929-406d-894f-efe22f083538 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:57.740195 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816b33a-c929-406d-894f-efe22f083538 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:57.753352 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789aced-0c6c-4fa4-a602-2462f988cc89 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:57.785392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ec705-2990-4590-ba3e-bb54cd999cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:57.785998 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ec705-2990-4590-ba3e-bb54cd999cbd None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:57.786275 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ec705-2990-4590-ba3e-bb54cd999cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:57.786551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ec705-2990-4590-ba3e-bb54cd999cbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:57.787271 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ec705-2990-4590-ba3e-bb54cd999cbd None admin] RBAC: Adding query filter params (role.id=eec5decc24ab4673a246120350336b1e, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=8d17f1d0577a41ed8859706073f79d77) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:57.787626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ec705-2990-4590-ba3e-bb54cd999cbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:57.789074 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ec705-2990-4590-ba3e-bb54cd999cbd None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:57.791944 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:57.799743 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 329/649] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:44:57 2022] GET /identity/v3/role_assignments?user.id=8d17f1d0577a41ed8859706073f79d77&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=eec5decc24ab4673a246120350336b1e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:57.800452 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ec705-2990-4590-ba3e-bb54cd999cbd None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:57.810686 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816b33a-c929-406d-894f-efe22f083538 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:57.812586 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816b33a-c929-406d-894f-efe22f083538 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:57.846328 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:57.914516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ec705-2990-4590-ba3e-bb54cd999cbd None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:57.926055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 321/650] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:57.927218 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816b33a-c929-406d-894f-efe22f083538 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:57.963148 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6fb1c-4147-40fc-b125-abd60b693b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:57.963868 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6fb1c-4147-40fc-b125-abd60b693b33 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:57.964155 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6fb1c-4147-40fc-b125-abd60b693b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:57.964949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6fb1c-4147-40fc-b125-abd60b693b33 None admin] PATH_INFO: `/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/8d27bfb8c0b64763b7db7cffa5f230f6/roles/eec5decc24ab4673a246120350336b1e` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:57.981748 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6fb1c-4147-40fc-b125-abd60b693b33 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba4dff9d637c4afcadfd3cd92b065a41, user_id=8d27bfb8c0b64763b7db7cffa5f230f6, role_id=eec5decc24ab4673a246120350336b1e)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:57.983410 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6fb1c-4147-40fc-b125-abd60b693b33 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:58.000679 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 330/651] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:44:57 2022] PUT /identity/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/8d27bfb8c0b64763b7db7cffa5f230f6/roles/eec5decc24ab4673a246120350336b1e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:44:58.002371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6fb1c-4147-40fc-b125-abd60b693b33 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:58.058092 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816b33a-c929-406d-894f-efe22f083538 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:58.081729 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:58.111788 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:58.121262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609bf563-1976-411a-9c7a-3c9386fa30f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:58.122211 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609bf563-1976-411a-9c7a-3c9386fa30f1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:58.122691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609bf563-1976-411a-9c7a-3c9386fa30f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:58.123131 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609bf563-1976-411a-9c7a-3c9386fa30f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:58.124103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609bf563-1976-411a-9c7a-3c9386fa30f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:58.125485 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609bf563-1976-411a-9c7a-3c9386fa30f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:58.127637 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609bf563-1976-411a-9c7a-3c9386fa30f1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:58.138389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 322/652] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Aug 30 11:44:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:58.139574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609bf563-1976-411a-9c7a-3c9386fa30f1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:58.153474 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6fb1c-4147-40fc-b125-abd60b693b33 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:58.196682 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a53be-1a2d-4572-8f4d-901a904ee0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:58.197305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a53be-1a2d-4572-8f4d-901a904ee0f5 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:58.197605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a53be-1a2d-4572-8f4d-901a904ee0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:58.197996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a53be-1a2d-4572-8f4d-901a904ee0f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:58.198650 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a53be-1a2d-4572-8f4d-901a904ee0f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:58.199246 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a53be-1a2d-4572-8f4d-901a904ee0f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:58.200693 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a53be-1a2d-4572-8f4d-901a904ee0f5 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:58.213324 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 331/653] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:58.214599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a53be-1a2d-4572-8f4d-901a904ee0f5 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:58.267044 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609bf563-1976-411a-9c7a-3c9386fa30f1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:58.310194 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b60c7-e7b0-47b5-9d92-ba3294bcfa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:58.311290 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b60c7-e7b0-47b5-9d92-ba3294bcfa22 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:58.311670 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b60c7-e7b0-47b5-9d92-ba3294bcfa22 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:58.312080 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b60c7-e7b0-47b5-9d92-ba3294bcfa22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:58.325974 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b60c7-e7b0-47b5-9d92-ba3294bcfa22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:58.326846 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a53be-1a2d-4572-8f4d-901a904ee0f5 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:58.327714 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b60c7-e7b0-47b5-9d92-ba3294bcfa22 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:58.343061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-825b60c7-e7b0-47b5-9d92-ba3294bcfa22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:58.343061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:58.343061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:58.343061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:58.343061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:58.343061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:58.343061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:58.343061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:58.343061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:58.343061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:58.343061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:58.343061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:58.343061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:58.343061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:58.343061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:58.343061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:58.344224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:58.344224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:58.344224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:58.344224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:58.344224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:58.344224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:58.344224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:58.344224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:58.344224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:58.344224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:58.344224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:58.344224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:58.344224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:58.344224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:58.344224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:58.344224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:58.344224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:58.345421 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:58.345421 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:58.345421 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:58.348168 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:58.349060 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 323/654] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:58.349985 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b60c7-e7b0-47b5-9d92-ba3294bcfa22 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:58.379276 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ee63e-e0d1-4a7c-b0e7-0773f4fb1d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:58.380385 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ee63e-e0d1-4a7c-b0e7-0773f4fb1d2e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:58.380761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ee63e-e0d1-4a7c-b0e7-0773f4fb1d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:58.381437 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ee63e-e0d1-4a7c-b0e7-0773f4fb1d2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:58.394353 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ee63e-e0d1-4a7c-b0e7-0773f4fb1d2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:58.396155 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ee63e-e0d1-4a7c-b0e7-0773f4fb1d2e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:58.407695 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:58.412574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-877ee63e-e0d1-4a7c-b0e7-0773f4fb1d2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:58.412574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:58.412574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:58.412574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:58.412574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:58.412574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:58.412574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:58.412574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:58.412574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:58.412574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:58.412574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:58.412574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:58.412574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:58.412574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:58.412574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:58.412574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:58.413516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:58.413516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:58.413516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:58.413516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:58.413516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:58.413516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:58.413516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:58.413516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:58.413516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:58.413516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:58.413516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:58.413516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:58.413516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:58.413516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:58.413516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:58.413516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:58.413516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:58.414395 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:58.414395 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:58.414395 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:58.421066 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 332/655] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:58.423038 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ee63e-e0d1-4a7c-b0e7-0773f4fb1d2e None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:58.476183 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b60c7-e7b0-47b5-9d92-ba3294bcfa22 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:58.522041 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1183ec-8913-4c01-a45e-2e78f2f0fb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:58.522686 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1183ec-8913-4c01-a45e-2e78f2f0fb52 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:58.522961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1183ec-8913-4c01-a45e-2e78f2f0fb52 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:58.523231 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1183ec-8913-4c01-a45e-2e78f2f0fb52 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:58.532962 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ee63e-e0d1-4a7c-b0e7-0773f4fb1d2e None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:58.533705 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1183ec-8913-4c01-a45e-2e78f2f0fb52 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:58.535433 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1183ec-8913-4c01-a45e-2e78f2f0fb52 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:58.550936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-bb1183ec-8913-4c01-a45e-2e78f2f0fb52 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 11:44:58.550936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:58.550936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:58.550936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:58.550936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:58.550936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:58.550936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:58.550936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:58.550936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:58.550936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:58.550936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:58.550936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:58.550936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:44:58.550936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:44:58.550936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:44:58.550936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:44:58.552005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:58.552005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:58.552005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:44:58.552005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:58.552005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:44:58.552005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:58.552005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:58.552005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:58.552005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:58.552005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:58.552005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:58.552005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:58.552005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:58.552005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:58.552005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:58.552005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:58.552005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:58.552005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:58.552989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:58.552989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:58.552989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:44:58.552989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:44:58.552989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:44:58.552989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:44:58.552989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:44:58.552989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:44:58.552989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 11:44:58.552989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:58.555498 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 324/656] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:44:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:58.556592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1183ec-8913-4c01-a45e-2e78f2f0fb52 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:58.576271 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f8502-7d6e-4d3d-92f5-b2992a31922e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:58.577253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f8502-7d6e-4d3d-92f5-b2992a31922e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:58.577758 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f8502-7d6e-4d3d-92f5-b2992a31922e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:58.578261 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f8502-7d6e-4d3d-92f5-b2992a31922e None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:58.579237 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f8502-7d6e-4d3d-92f5-b2992a31922e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:58.579802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f8502-7d6e-4d3d-92f5-b2992a31922e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:58.581458 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f8502-7d6e-4d3d-92f5-b2992a31922e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:58.595738 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 333/657] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:58.596948 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f8502-7d6e-4d3d-92f5-b2992a31922e None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:58.622896 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:58.694091 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1183ec-8913-4c01-a45e-2e78f2f0fb52 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:58.707916 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f8502-7d6e-4d3d-92f5-b2992a31922e None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:58.715798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:58.739455 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8dd84-ae6c-421d-9d9c-00d6fd66bd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:58.740086 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8dd84-ae6c-421d-9d9c-00d6fd66bd15 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:58.740409 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8dd84-ae6c-421d-9d9c-00d6fd66bd15 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:58.741027 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8dd84-ae6c-421d-9d9c-00d6fd66bd15 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:58.741681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8dd84-ae6c-421d-9d9c-00d6fd66bd15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:58.742114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8dd84-ae6c-421d-9d9c-00d6fd66bd15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:58.743738 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8dd84-ae6c-421d-9d9c-00d6fd66bd15 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:58.747074 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357be526-12f4-4eb7-80d8-dc9160c9b6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:58.747962 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357be526-12f4-4eb7-80d8-dc9160c9b6fd None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:58.748454 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357be526-12f4-4eb7-80d8-dc9160c9b6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:58.748979 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357be526-12f4-4eb7-80d8-dc9160c9b6fd None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:58.750004 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357be526-12f4-4eb7-80d8-dc9160c9b6fd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:58.750586 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357be526-12f4-4eb7-80d8-dc9160c9b6fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:58.752888 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357be526-12f4-4eb7-80d8-dc9160c9b6fd None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:58.761738 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 325/658] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:58.761738 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8dd84-ae6c-421d-9d9c-00d6fd66bd15 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:58.782040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 334/659] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Aug 30 11:44:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:58.783240 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357be526-12f4-4eb7-80d8-dc9160c9b6fd None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:58.881447 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8dd84-ae6c-421d-9d9c-00d6fd66bd15 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:58.900586 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:58.917940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c967d-1d31-45ac-bca2-0f8d23836902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:58.918610 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c967d-1d31-45ac-bca2-0f8d23836902 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:58.918892 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c967d-1d31-45ac-bca2-0f8d23836902 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:58.919163 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c967d-1d31-45ac-bca2-0f8d23836902 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:58.927066 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c967d-1d31-45ac-bca2-0f8d23836902 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:58.928574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c967d-1d31-45ac-bca2-0f8d23836902 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:58.929679 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357be526-12f4-4eb7-80d8-dc9160c9b6fd None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:58.940262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-659c967d-1d31-45ac-bca2-0f8d23836902 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:58.940262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:58.940262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:58.940262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:58.940262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:58.940262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:58.940262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:58.940262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:58.940262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:58.940262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:58.940262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:58.940262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:58.940262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:44:58.940262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:44:58.940262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:44:58.941203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:44:58.941203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:58.941203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:58.941203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:58.941203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:58.941203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:58.941203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:58.941203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:58.941203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:58.941203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:58.941203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:58.941203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:58.941203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:58.941203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:58.941203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:58.941203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:58.941203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:58.942683 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:44:58.942683 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:44:58.942683 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:44:58.942683 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:44:58.942683 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:44:58.942683 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:44:58.942683 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:44:58.942683 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:44:58.942683 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 326/660] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:44:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:58.942683 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c967d-1d31-45ac-bca2-0f8d23836902 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:58.969749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:58.985256 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d6d1c-3433-4a98-8fa8-d2dea63bb447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:58.987303 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d6d1c-3433-4a98-8fa8-d2dea63bb447 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:58.987834 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d6d1c-3433-4a98-8fa8-d2dea63bb447 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:58.988318 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d6d1c-3433-4a98-8fa8-d2dea63bb447 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:58.999403 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d6d1c-3433-4a98-8fa8-d2dea63bb447 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:59.003072 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d6d1c-3433-4a98-8fa8-d2dea63bb447 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:59.023220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-e46d6d1c-3433-4a98-8fa8-d2dea63bb447 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 11:44:59.023220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:59.023220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:59.023220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:59.023220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:59.023220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:59.023220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:59.023220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:59.023220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:59.023220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:59.023220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:59.023220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:59.023220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:44:59.023220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:44:59.023220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:44:59.023220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:44:59.024281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:59.024281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:59.024281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:44:59.024281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:59.024281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:44:59.024281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:44:59.024281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:59.024281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:59.024281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:59.024281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:59.024281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:59.024281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:59.024281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:59.024281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:59.024281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:59.024281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:59.024281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:59.024281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:59.025258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:59.025258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:59.025258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:44:59.025258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:44:59.025258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:44:59.025258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:44:59.025258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:44:59.025258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:44:59.025258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 11:44:59.025258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:59.035178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 335/661] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:44:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:59.035178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d6d1c-3433-4a98-8fa8-d2dea63bb447 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:59.067537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c967d-1d31-45ac-bca2-0f8d23836902 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:59.119597 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9f441-3135-4600-9ec1-09918a8da586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:59.121214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9f441-3135-4600-9ec1-09918a8da586 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:59.121933 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9f441-3135-4600-9ec1-09918a8da586 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:59.122403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9f441-3135-4600-9ec1-09918a8da586 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:59.159911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d6d1c-3433-4a98-8fa8-d2dea63bb447 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:59.196372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9f441-3135-4600-9ec1-09918a8da586 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:59.197219 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec816d63-753a-445a-b0af-0ccd4c3a38cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:59.197854 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9f441-3135-4600-9ec1-09918a8da586 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:59.198334 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec816d63-753a-445a-b0af-0ccd4c3a38cd None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:59.198830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec816d63-753a-445a-b0af-0ccd4c3a38cd None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:59.199295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec816d63-753a-445a-b0af-0ccd4c3a38cd None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:59.200381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec816d63-753a-445a-b0af-0ccd4c3a38cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:59.201005 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec816d63-753a-445a-b0af-0ccd4c3a38cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:59.202812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec816d63-753a-445a-b0af-0ccd4c3a38cd None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:59.214098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:59.220185 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 336/662] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:44:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:59.221227 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec816d63-753a-445a-b0af-0ccd4c3a38cd None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:59.231085 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:59.312485 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 327/663] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:59.313574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9f441-3135-4600-9ec1-09918a8da586 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:59.330969 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec816d63-753a-445a-b0af-0ccd4c3a38cd None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:59.368394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f80b7-cb98-4727-bc4f-3bad699228ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:59.369224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f80b7-cb98-4727-bc4f-3bad699228ed None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:59.369672 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f80b7-cb98-4727-bc4f-3bad699228ed None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:59.370044 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f80b7-cb98-4727-bc4f-3bad699228ed None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:59.370867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f80b7-cb98-4727-bc4f-3bad699228ed None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:59.371291 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f80b7-cb98-4727-bc4f-3bad699228ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:59.373066 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f80b7-cb98-4727-bc4f-3bad699228ed None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:59.396897 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 337/664] 10.222.0.27 () {56 vars in 1139 bytes} [Tue Aug 30 11:44:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:59.398025 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f80b7-cb98-4727-bc4f-3bad699228ed None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:59.414157 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9f441-3135-4600-9ec1-09918a8da586 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:59.438985 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:59.451408 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cce97e-83d1-44ed-bc91-4244c62c4cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:59.451879 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cce97e-83d1-44ed-bc91-4244c62c4cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:59.452502 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cce97e-83d1-44ed-bc91-4244c62c4cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:59.452986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cce97e-83d1-44ed-bc91-4244c62c4cc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:59.454345 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cce97e-83d1-44ed-bc91-4244c62c4cc1 None admin] RBAC: Adding query filter params (role.id=eec5decc24ab4673a246120350336b1e, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=c6682c22be8c4bdca4be33a93e802409) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:59.454926 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cce97e-83d1-44ed-bc91-4244c62c4cc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:59.457689 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cce97e-83d1-44ed-bc91-4244c62c4cc1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:59.471634 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 328/665] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:44:59 2022] GET /identity/v3/role_assignments?user.id=c6682c22be8c4bdca4be33a93e802409&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=eec5decc24ab4673a246120350336b1e => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:59.472868 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cce97e-83d1-44ed-bc91-4244c62c4cc1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:59.488629 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:59.541647 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f80b7-cb98-4727-bc4f-3bad699228ed None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:59.582245 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339c5ef-a6c0-49b2-b2c3-2d41dfdd6556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:59.583280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339c5ef-a6c0-49b2-b2c3-2d41dfdd6556 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:59.583879 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339c5ef-a6c0-49b2-b2c3-2d41dfdd6556 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:59.584373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339c5ef-a6c0-49b2-b2c3-2d41dfdd6556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:59.597441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339c5ef-a6c0-49b2-b2c3-2d41dfdd6556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:59.599295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339c5ef-a6c0-49b2-b2c3-2d41dfdd6556 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:59.617102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-b339c5ef-a6c0-49b2-b2c3-2d41dfdd6556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:59.617102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:44:59.617102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:44:59.617102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:44:59.617102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:44:59.617102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:44:59.617102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:44:59.617102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:44:59.617102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:44:59.617102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:44:59.617102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:44:59.617102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:44:59.617102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:44:59.617102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:44:59.617102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:44:59.617102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:44:59.618128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:44:59.618128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:44:59.618128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:44:59.618128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:44:59.618128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:44:59.618128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:44:59.618128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:44:59.618128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:44:59.618128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:44:59.618128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:44:59.618128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:44:59.618128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:44:59.618128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:44:59.618128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:44:59.618128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:44:59.618128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:44:59.618128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:44:59.619028 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:44:59.619028 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:44:59.619028 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:44:59.621444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 338/666] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:44:59.629743 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339c5ef-a6c0-49b2-b2c3-2d41dfdd6556 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:59.654667 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cce97e-83d1-44ed-bc91-4244c62c4cc1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:59.735524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8cd08-28ff-4182-bc87-0f22c40d18dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:59.736083 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8cd08-28ff-4182-bc87-0f22c40d18dc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:59.736365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8cd08-28ff-4182-bc87-0f22c40d18dc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:59.736640 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8cd08-28ff-4182-bc87-0f22c40d18dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:59.789556 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339c5ef-a6c0-49b2-b2c3-2d41dfdd6556 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:44:59.800193 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:59.803843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:44:59.815485 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8cd08-28ff-4182-bc87-0f22c40d18dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:59.816526 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8cd08-28ff-4182-bc87-0f22c40d18dc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:59.852118 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6130cc9-7c5a-4ce4-b580-e5d2418c4a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:44:59.853080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6130cc9-7c5a-4ce4-b580-e5d2418c4a78 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:59.853567 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6130cc9-7c5a-4ce4-b580-e5d2418c4a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:59.854145 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6130cc9-7c5a-4ce4-b580-e5d2418c4a78 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:59.855067 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6130cc9-7c5a-4ce4-b580-e5d2418c4a78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:44:59.855574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6130cc9-7c5a-4ce4-b580-e5d2418c4a78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:44:59.857176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6130cc9-7c5a-4ce4-b580-e5d2418c4a78 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:44:59.871283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 339/667] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:44:59.876667 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6130cc9-7c5a-4ce4-b580-e5d2418c4a78 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:44:59.944086 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 329/668] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:44:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:44:59.948708 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f7b44-dcae-4e92-a435-648a094e7ab2 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:44:59.948995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f7b44-dcae-4e92-a435-648a094e7ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:44:59.949271 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f7b44-dcae-4e92-a435-648a094e7ab2 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:44:59.950687 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 330/669] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:44:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:44:59.952877 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f7b44-dcae-4e92-a435-648a094e7ab2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:00.010441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6130cc9-7c5a-4ce4-b580-e5d2418c4a78 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:00.055349 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860640a0-e70e-4c10-96f1-a8961e7a4528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:00.056038 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860640a0-e70e-4c10-96f1-a8961e7a4528 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:00.056574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860640a0-e70e-4c10-96f1-a8961e7a4528 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:00.056856 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860640a0-e70e-4c10-96f1-a8961e7a4528 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:00.065155 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860640a0-e70e-4c10-96f1-a8961e7a4528 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:00.066923 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860640a0-e70e-4c10-96f1-a8961e7a4528 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:00.069873 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:00.081549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-860640a0-e70e-4c10-96f1-a8961e7a4528 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:00.081549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:00.081549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:00.081549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:00.081549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:00.081549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:00.081549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:00.081549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:00.081549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:00.081549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:00.081549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:00.081549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:00.081549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:45:00.081549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:45:00.081549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:45:00.082505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:45:00.082505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:00.082505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:00.082505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:00.082505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:00.082505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:00.082505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:00.082505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:00.082505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:00.082505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:00.082505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:00.082505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:00.082505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:00.082505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:00.082505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:00.082505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:00.082505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:00.083469 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:45:00.083469 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:45:00.083469 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:45:00.083469 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:45:00.083469 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:45:00.083469 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:45:00.083469 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:00.083469 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:00.083469 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 340/670] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:44:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:00.084659 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b304a26-800b-400d-9387-2d7f2ef3303a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:00.084941 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b304a26-800b-400d-9387-2d7f2ef3303a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:00.085214 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b304a26-800b-400d-9387-2d7f2ef3303a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:00.091014 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f7b44-dcae-4e92-a435-648a094e7ab2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:00.108626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-3b304a26-800b-400d-9387-2d7f2ef3303a None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:00.109819 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3b304a26-800b-400d-9387-2d7f2ef3303a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:00.135677 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:00.139141 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bceb17b-27dc-4e89-a391-9733293947b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:00.140786 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bceb17b-27dc-4e89-a391-9733293947b4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:00.141292 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bceb17b-27dc-4e89-a391-9733293947b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:00.141940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bceb17b-27dc-4e89-a391-9733293947b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:00.155729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bceb17b-27dc-4e89-a391-9733293947b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:00.158413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bceb17b-27dc-4e89-a391-9733293947b4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:00.175517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-8bceb17b-27dc-4e89-a391-9733293947b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:00.175517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:00.175517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:00.175517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:00.175517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:00.175517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:00.175517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:00.175517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:00.175517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:00.175517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:00.175517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:00.175517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:00.175517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:00.175517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:00.175517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:00.175517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:00.176515 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:00.176515 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:00.176515 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:00.176515 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:00.176515 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:00.176515 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:00.176515 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:00.176515 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:00.176515 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:00.176515 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:00.176515 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:00.176515 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:00.176515 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:00.176515 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:00.176515 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:00.176515 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:00.176515 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:00.177399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:00.177399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:00.177399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:00.177399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 331/671] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:00.178160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a9782-2378-48d0-b466-0041c121c1d3 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:00.178160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a9782-2378-48d0-b466-0041c121c1d3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:00.178333 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a9782-2378-48d0-b466-0041c121c1d3 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:00.179598 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 332/672] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:00.180290 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a9782-2378-48d0-b466-0041c121c1d3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:00.186319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 341/673] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:45:00.187911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b304a26-800b-400d-9387-2d7f2ef3303a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:00.286457 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a9782-2378-48d0-b466-0041c121c1d3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:00.315071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b304a26-800b-400d-9387-2d7f2ef3303a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:00.322299 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30a178-1121-4cb7-9f37-339fe50cee29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:00.322920 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30a178-1121-4cb7-9f37-339fe50cee29 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:00.323204 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30a178-1121-4cb7-9f37-339fe50cee29 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:00.323516 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30a178-1121-4cb7-9f37-339fe50cee29 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:00.324216 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30a178-1121-4cb7-9f37-339fe50cee29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:00.324508 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30a178-1121-4cb7-9f37-339fe50cee29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:00.325947 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30a178-1121-4cb7-9f37-339fe50cee29 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:00.336771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:00.340667 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 333/674] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:45:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:00.341890 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11891d-7942-487f-862c-44287f45e3d1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:00.342537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11891d-7942-487f-862c-44287f45e3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:00.343133 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11891d-7942-487f-862c-44287f45e3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:00.361780 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cf11891d-7942-487f-862c-44287f45e3d1 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:00.362166 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1a700-252a-4563-9230-a8aa965d67c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:00.362966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1a700-252a-4563-9230-a8aa965d67c4 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:00.363347 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cf11891d-7942-487f-862c-44287f45e3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:00.363543 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1a700-252a-4563-9230-a8aa965d67c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:00.363944 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1a700-252a-4563-9230-a8aa965d67c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:00.364713 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1a700-252a-4563-9230-a8aa965d67c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:00.365165 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1a700-252a-4563-9230-a8aa965d67c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:00.367819 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1a700-252a-4563-9230-a8aa965d67c4 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:00.385032 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 342/675] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:00.386207 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1a700-252a-4563-9230-a8aa965d67c4 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:00.417165 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:00.437414 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 334/676] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:45:00.438351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11891d-7942-487f-862c-44287f45e3d1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:00.531857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1a700-252a-4563-9230-a8aa965d67c4 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:00.554086 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11891d-7942-487f-862c-44287f45e3d1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:00.570275 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a981c3-799d-4b05-a3e1-bce67c3938e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:00.571147 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a981c3-799d-4b05-a3e1-bce67c3938e8 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:00.571445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a981c3-799d-4b05-a3e1-bce67c3938e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:00.572079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a981c3-799d-4b05-a3e1-bce67c3938e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:00.572806 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a981c3-799d-4b05-a3e1-bce67c3938e8 None admin] RBAC: Adding query filter params (role.id=eec5decc24ab4673a246120350336b1e, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=b9bbec99965e4444bcf88a32502b3257) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:00.573109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a981c3-799d-4b05-a3e1-bce67c3938e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:00.575055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a981c3-799d-4b05-a3e1-bce67c3938e8 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:00.583803 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:00.588627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 343/677] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:45:00 2022] GET /identity/v3/role_assignments?user.id=b9bbec99965e4444bcf88a32502b3257&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=eec5decc24ab4673a246120350336b1e => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:00.590167 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a981c3-799d-4b05-a3e1-bce67c3938e8 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:00.591278 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c13ced-f2c6-43e3-8817-f5a7f8c5a385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:00.592041 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c13ced-f2c6-43e3-8817-f5a7f8c5a385 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:00.592322 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c13ced-f2c6-43e3-8817-f5a7f8c5a385 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:00.592596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c13ced-f2c6-43e3-8817-f5a7f8c5a385 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:00.600244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c13ced-f2c6-43e3-8817-f5a7f8c5a385 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:00.601740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c13ced-f2c6-43e3-8817-f5a7f8c5a385 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:00.615628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-c2c13ced-f2c6-43e3-8817-f5a7f8c5a385 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:00.615628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:00.615628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:00.615628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:00.615628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:00.615628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:00.615628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:00.615628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:00.615628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:00.615628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:00.615628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:00.615628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:00.615628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:45:00.615628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:45:00.615628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:45:00.616616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:45:00.616616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:00.616616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:00.616616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:00.616616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:00.616616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:00.616616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:00.616616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:00.616616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:00.616616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:00.616616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:00.616616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:00.616616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:00.616616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:00.616616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:00.616616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:00.616616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:00.617513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:45:00.617513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:45:00.617513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:45:00.617513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:45:00.617513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:45:00.617513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:45:00.617513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:00.617513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:00.617513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 335/678] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:00.629846 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c13ced-f2c6-43e3-8817-f5a7f8c5a385 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:00.767909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:00.787737 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a981c3-799d-4b05-a3e1-bce67c3938e8 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:00.797399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c13ced-f2c6-43e3-8817-f5a7f8c5a385 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:00.827946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143163fd-cb1c-4e7f-9b64-fe8604598b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:00.828517 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143163fd-cb1c-4e7f-9b64-fe8604598b6c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:00.828796 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143163fd-cb1c-4e7f-9b64-fe8604598b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:00.829068 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143163fd-cb1c-4e7f-9b64-fe8604598b6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:00.843006 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cce53-d7e3-4a19-bb97-bf8367283e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:00.843870 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cce53-d7e3-4a19-bb97-bf8367283e71 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:00.844153 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cce53-d7e3-4a19-bb97-bf8367283e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:00.844419 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cce53-d7e3-4a19-bb97-bf8367283e71 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:00.845128 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cce53-d7e3-4a19-bb97-bf8367283e71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:00.845433 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cce53-d7e3-4a19-bb97-bf8367283e71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:00.846880 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cce53-d7e3-4a19-bb97-bf8367283e71 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:00.847336 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143163fd-cb1c-4e7f-9b64-fe8604598b6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:45:00.852727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-143163fd-cb1c-4e7f-9b64-fe8604598b6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:45:00.852727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:00.852727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:00.852727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:00.852727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:00.852727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:00.852727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:00.852727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:00.852727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:00.852727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:00.852727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:00.852727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:00.852727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:45:00.852727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:45:00.852727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:45:00.852727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:45:00.853636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:45:00.853636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:45:00.853636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:45:00.853636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:45:00.853636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:00.853636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:00.853636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:00.853636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:00.853636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:00.853636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:00.853636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:00.853636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:00.853636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:00.853636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:00.853636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:00.853636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:00.854635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:00.854635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:00.854635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:00.854635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:00.854635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:45:00.854635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:45:00.854635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:45:00.854635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:45:00.854635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:45:00.854635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:45:00.854635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:45:00.854635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:00.854635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 344/679] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:45:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:00.855312 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143163fd-cb1c-4e7f-9b64-fe8604598b6c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:00.862312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 336/680] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:45:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:00.863385 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cce53-d7e3-4a19-bb97-bf8367283e71 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:00.929743 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:00.986986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cce53-d7e3-4a19-bb97-bf8367283e71 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:00.994323 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143163fd-cb1c-4e7f-9b64-fe8604598b6c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:01.023279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc4d4e-7ef6-4363-988b-6c9e88dae321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:01.024292 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc4d4e-7ef6-4363-988b-6c9e88dae321 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:01.024795 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc4d4e-7ef6-4363-988b-6c9e88dae321 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:01.025267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc4d4e-7ef6-4363-988b-6c9e88dae321 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:01.026197 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc4d4e-7ef6-4363-988b-6c9e88dae321 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:01.026732 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc4d4e-7ef6-4363-988b-6c9e88dae321 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:01.028370 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc4d4e-7ef6-4363-988b-6c9e88dae321 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:01.037729 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fc6b9-df5c-4bec-95df-aadf1611ff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:01.042773 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fc6b9-df5c-4bec-95df-aadf1611ff00 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:01.042773 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fc6b9-df5c-4bec-95df-aadf1611ff00 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:01.042773 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fc6b9-df5c-4bec-95df-aadf1611ff00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:01.043400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 337/681] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:45:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:01.044583 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc4d4e-7ef6-4363-988b-6c9e88dae321 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:01.051085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2fc6b9-df5c-4bec-95df-aadf1611ff00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:45:01.056870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-2c2fc6b9-df5c-4bec-95df-aadf1611ff00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:45:01.056870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:01.056870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:01.056870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:01.056870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:01.056870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:01.056870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:01.056870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:01.056870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:01.056870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:01.056870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:01.056870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:01.056870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:45:01.056870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:45:01.056870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:45:01.056870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:45:01.057818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:45:01.057818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:45:01.057818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:45:01.057818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:45:01.057818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:01.057818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:01.057818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:01.057818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:01.057818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:01.057818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:01.057818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:01.057818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:01.057818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:01.057818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:01.057818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:01.057818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:01.058646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:01.058646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:01.058646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:01.058646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:01.058646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:45:01.058646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:45:01.058646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:45:01.058646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:45:01.058646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:45:01.058646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:45:01.058646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:45:01.058646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:01.058646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 345/682] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:45:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:01.059338 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fc6b9-df5c-4bec-95df-aadf1611ff00 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:01.068488 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:01.181235 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fc6b9-df5c-4bec-95df-aadf1611ff00 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:01.219475 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b7450-0285-4fb6-b6c7-f0cebfbcee15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:01.220127 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b7450-0285-4fb6-b6c7-f0cebfbcee15 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:01.220409 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b7450-0285-4fb6-b6c7-f0cebfbcee15 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:01.220686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b7450-0285-4fb6-b6c7-f0cebfbcee15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:01.232251 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b7450-0285-4fb6-b6c7-f0cebfbcee15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:01.234227 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b7450-0285-4fb6-b6c7-f0cebfbcee15 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:01.251060 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc4d4e-7ef6-4363-988b-6c9e88dae321 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:01.251626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-1b8b7450-0285-4fb6-b6c7-f0cebfbcee15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:01.251626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:01.251626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:01.251626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:01.251626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:01.251626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:01.251626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:01.251626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:01.251626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:01.251626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:01.251626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:01.251626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:01.251626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:01.251626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:01.251626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:01.251626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:01.252554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:01.252554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:01.252554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:01.252554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:01.252554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:01.252554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:01.252554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:01.252554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:01.252554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:01.252554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:01.252554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:01.252554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:01.252554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:01.252554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:01.252554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:01.252554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:01.252554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:01.253443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:01.253443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:01.253443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:01.257785 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 346/683] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:01.258648 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b7450-0285-4fb6-b6c7-f0cebfbcee15 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:01.273437 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:01.298188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be77938-c14e-421f-b55e-dc1ababa226f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:01.299156 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be77938-c14e-421f-b55e-dc1ababa226f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:01.299657 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be77938-c14e-421f-b55e-dc1ababa226f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:01.300121 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be77938-c14e-421f-b55e-dc1ababa226f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:01.301069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be77938-c14e-421f-b55e-dc1ababa226f None admin] RBAC: Adding query filter params (role.id=eec5decc24ab4673a246120350336b1e, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=f3be96d37b4e4dd889be755b004bfe52) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:01.301590 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be77938-c14e-421f-b55e-dc1ababa226f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:01.303231 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be77938-c14e-421f-b55e-dc1ababa226f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:01.314814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 338/684] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:45:01 2022] GET /identity/v3/role_assignments?user.id=f3be96d37b4e4dd889be755b004bfe52&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=eec5decc24ab4673a246120350336b1e => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:01.316128 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be77938-c14e-421f-b55e-dc1ababa226f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:01.391893 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:01.522153 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b7450-0285-4fb6-b6c7-f0cebfbcee15 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:01.594003 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be77938-c14e-421f-b55e-dc1ababa226f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:01.594626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237fc3c-2f01-406d-8678-94d2ab845057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:01.595262 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237fc3c-2f01-406d-8678-94d2ab845057 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:01.601593 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237fc3c-2f01-406d-8678-94d2ab845057 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:01.601893 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237fc3c-2f01-406d-8678-94d2ab845057 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:01.602599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237fc3c-2f01-406d-8678-94d2ab845057 None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:01.602910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237fc3c-2f01-406d-8678-94d2ab845057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:01.605090 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237fc3c-2f01-406d-8678-94d2ab845057 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:01.628039 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 347/685] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Aug 30 11:45:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:01.635088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237fc3c-2f01-406d-8678-94d2ab845057 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:01.670699 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb18cbd-1112-45ce-bd39-6561ddfdaf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:01.671083 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb18cbd-1112-45ce-bd39-6561ddfdaf14 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:01.671444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb18cbd-1112-45ce-bd39-6561ddfdaf14 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:01.671735 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb18cbd-1112-45ce-bd39-6561ddfdaf14 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:01.672397 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb18cbd-1112-45ce-bd39-6561ddfdaf14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:01.672705 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb18cbd-1112-45ce-bd39-6561ddfdaf14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:01.674126 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb18cbd-1112-45ce-bd39-6561ddfdaf14 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:01.707063 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 339/686] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:01.712935 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb18cbd-1112-45ce-bd39-6561ddfdaf14 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:01.769378 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:01.824185 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237fc3c-2f01-406d-8678-94d2ab845057 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:01.847758 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:01.853726 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb18cbd-1112-45ce-bd39-6561ddfdaf14 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:01.863259 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680c9ce-dc54-4793-8c6f-0b3932249d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:01.864273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680c9ce-dc54-4793-8c6f-0b3932249d80 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:01.864757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680c9ce-dc54-4793-8c6f-0b3932249d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:01.865271 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680c9ce-dc54-4793-8c6f-0b3932249d80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:01.877249 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680c9ce-dc54-4793-8c6f-0b3932249d80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:01.879016 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680c9ce-dc54-4793-8c6f-0b3932249d80 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:01.890083 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c281f8-bb4f-47ee-b9e4-8c345b84f97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:01.890791 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c281f8-bb4f-47ee-b9e4-8c345b84f97c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:01.891075 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c281f8-bb4f-47ee-b9e4-8c345b84f97c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:01.891352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c281f8-bb4f-47ee-b9e4-8c345b84f97c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:01.894809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-f680c9ce-dc54-4793-8c6f-0b3932249d80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:01.894809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:01.894809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:01.894809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:01.894809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:01.894809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:01.894809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:01.894809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:01.894809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:01.894809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:01.894809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:01.894809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:01.894809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:01.894809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:01.894809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:01.894809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:01.895843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:01.895843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:01.895843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:01.895843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:01.895843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:01.895843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:01.895843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:01.895843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:01.895843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:01.895843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:01.895843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:01.895843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:01.895843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:01.895843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:01.895843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:01.895843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:01.895843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:01.896817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:01.896817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:01.896817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:01.898855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c281f8-bb4f-47ee-b9e4-8c345b84f97c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:01.899081 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 348/687] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:01.900479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc69d70-726f-481f-857c-4d5c7b2a09f0 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:01.900981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc69d70-726f-481f-857c-4d5c7b2a09f0 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:01.901451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc69d70-726f-481f-857c-4d5c7b2a09f0 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:01.903125 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 349/688] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:01.904839 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc69d70-726f-481f-857c-4d5c7b2a09f0 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:01.904963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c281f8-bb4f-47ee-b9e4-8c345b84f97c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:01.918771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-b2c281f8-bb4f-47ee-b9e4-8c345b84f97c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:45:01.918771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:01.918771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:01.918771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:01.918771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:01.918771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:01.918771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:01.918771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:01.918771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:01.918771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:01.918771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:01.918771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:01.918771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:45:01.918771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:45:01.918771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:45:01.918771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:45:01.919813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:01.919813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:01.919813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:45:01.919813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:01.919813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:45:01.919813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:01.919813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:01.919813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:01.919813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:01.919813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:01.919813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:01.919813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:01.919813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:01.919813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:01.919813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:01.919813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:01.919813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:01.919813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:01.920825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:01.920825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:01.920825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:45:01.920825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:45:01.920825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:45:01.920825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:45:01.920825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:45:01.920825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:45:01.920825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:45:01.920825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:01.920825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 340/689] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Aug 30 11:45:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:01.921550 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d2bb7-55d4-4fae-a30b-12adc4c52ff9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:01.922131 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d2bb7-55d4-4fae-a30b-12adc4c52ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:01.922131 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d2bb7-55d4-4fae-a30b-12adc4c52ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:01.945414 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b27d2bb7-55d4-4fae-a30b-12adc4c52ff9 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:01.947185 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b27d2bb7-55d4-4fae-a30b-12adc4c52ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:02.014491 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc69d70-726f-481f-857c-4d5c7b2a09f0 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:02.015766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 341/690] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:45:02.016741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d2bb7-55d4-4fae-a30b-12adc4c52ff9 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:02.067750 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:02.075717 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba8b15-063d-49d1-84b8-fe664adf63fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:02.076393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba8b15-063d-49d1-84b8-fe664adf63fb None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:02.076812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba8b15-063d-49d1-84b8-fe664adf63fb None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:02.076994 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba8b15-063d-49d1-84b8-fe664adf63fb None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:02.077751 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba8b15-063d-49d1-84b8-fe664adf63fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:02.078037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba8b15-063d-49d1-84b8-fe664adf63fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:02.079495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba8b15-063d-49d1-84b8-fe664adf63fb None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:02.115063 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 350/691] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:02.121137 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba8b15-063d-49d1-84b8-fe664adf63fb None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:02.169719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d2bb7-55d4-4fae-a30b-12adc4c52ff9 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:02.178629 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:02.233179 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4975e9-49e4-4427-bd87-caba4df120df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:02.233806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4975e9-49e4-4427-bd87-caba4df120df None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:02.234289 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4975e9-49e4-4427-bd87-caba4df120df None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:02.234566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4975e9-49e4-4427-bd87-caba4df120df None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:02.235311 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4975e9-49e4-4427-bd87-caba4df120df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:02.235639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4975e9-49e4-4427-bd87-caba4df120df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:02.237088 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4975e9-49e4-4427-bd87-caba4df120df None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:02.276012 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 342/692] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Aug 30 11:45:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:02.279440 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4975e9-49e4-4427-bd87-caba4df120df None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:02.296896 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba8b15-063d-49d1-84b8-fe664adf63fb None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:02.340498 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda70ee-9fc8-4ee7-9802-b250b9468e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:02.341571 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda70ee-9fc8-4ee7-9802-b250b9468e33 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:02.342381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda70ee-9fc8-4ee7-9802-b250b9468e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:02.342811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda70ee-9fc8-4ee7-9802-b250b9468e33 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:02.352790 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda70ee-9fc8-4ee7-9802-b250b9468e33 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:02.354891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda70ee-9fc8-4ee7-9802-b250b9468e33 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:02.372175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-0eda70ee-9fc8-4ee7-9802-b250b9468e33 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:45:02.372175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:02.372175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:02.372175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:02.372175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:02.372175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:02.372175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:02.372175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:02.372175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:02.372175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:02.372175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:02.372175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:02.372175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:45:02.372175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:45:02.372175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:45:02.372175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:45:02.373398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:02.373398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:02.373398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:45:02.373398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:02.373398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:45:02.373398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:02.373398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:02.373398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:02.373398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:02.373398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:02.373398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:02.373398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:02.373398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:02.373398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:02.373398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:02.373398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:02.373398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:02.373398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:02.374436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:02.374436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:02.374436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:45:02.374436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:45:02.374436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:45:02.374436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:45:02.374436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:45:02.374436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:45:02.374436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:45:02.374436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:02.377184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 351/693] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:45:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:02.378565 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda70ee-9fc8-4ee7-9802-b250b9468e33 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:02.386521 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:02.405713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4975e9-49e4-4427-bd87-caba4df120df None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:02.441256 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4436c3-bc8e-4c10-90eb-98efc4da8c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:02.441945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4436c3-bc8e-4c10-90eb-98efc4da8c80 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:02.442318 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4436c3-bc8e-4c10-90eb-98efc4da8c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:02.442831 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4436c3-bc8e-4c10-90eb-98efc4da8c80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:02.495952 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:02.507716 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda70ee-9fc8-4ee7-9802-b250b9468e33 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:02.534952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4436c3-bc8e-4c10-90eb-98efc4da8c80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:02.537627 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4436c3-bc8e-4c10-90eb-98efc4da8c80 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:02.546211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938054f-d4a6-47a0-8f16-6db692c16696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:02.547174 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938054f-d4a6-47a0-8f16-6db692c16696 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:02.547635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938054f-d4a6-47a0-8f16-6db692c16696 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:02.547999 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938054f-d4a6-47a0-8f16-6db692c16696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:02.560495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938054f-d4a6-47a0-8f16-6db692c16696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:02.562565 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938054f-d4a6-47a0-8f16-6db692c16696 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:02.578236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-1938054f-d4a6-47a0-8f16-6db692c16696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:02.578236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:02.578236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:02.578236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:02.578236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:02.578236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:02.578236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:02.578236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:02.578236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:02.578236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:02.578236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:02.578236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:02.578236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:02.578236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:02.578236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:02.578236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:02.579430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:02.579430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:02.579430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:02.579430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:02.579430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:02.579430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:02.579430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:02.579430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:02.579430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:02.579430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:02.579430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:02.579430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:02.579430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:02.579430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:02.579430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:02.579430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:02.579430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:02.580374 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:02.580374 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:02.580374 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:02.585491 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 352/694] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:02.586485 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938054f-d4a6-47a0-8f16-6db692c16696 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:02.645190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:02.664343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 343/695] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:45:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:45:02.665282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4436c3-bc8e-4c10-90eb-98efc4da8c80 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:02.707386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938054f-d4a6-47a0-8f16-6db692c16696 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:02.746075 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb5c37-5489-4a75-a24d-840b3379fd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:02.746697 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb5c37-5489-4a75-a24d-840b3379fd91 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:02.746978 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb5c37-5489-4a75-a24d-840b3379fd91 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:02.747254 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb5c37-5489-4a75-a24d-840b3379fd91 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:02.748022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb5c37-5489-4a75-a24d-840b3379fd91 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:02.748330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb5c37-5489-4a75-a24d-840b3379fd91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:02.749845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb5c37-5489-4a75-a24d-840b3379fd91 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:02.765622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:02.771289 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 353/696] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Aug 30 11:45:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:02.772412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb5c37-5489-4a75-a24d-840b3379fd91 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:02.773235 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4436c3-bc8e-4c10-90eb-98efc4da8c80 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:02.812387 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0e861-b6a3-4c5f-9264-3090ae479e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:02.813000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0e861-b6a3-4c5f-9264-3090ae479e49 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:02.813274 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0e861-b6a3-4c5f-9264-3090ae479e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:02.813540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0e861-b6a3-4c5f-9264-3090ae479e49 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:02.814171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0e861-b6a3-4c5f-9264-3090ae479e49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:02.814468 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0e861-b6a3-4c5f-9264-3090ae479e49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:02.815894 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0e861-b6a3-4c5f-9264-3090ae479e49 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:02.827506 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 344/697] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:02.829034 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebea8d-da74-4dbe-b98b-0d20cf3e89ae None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:02.829318 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebea8d-da74-4dbe-b98b-0d20cf3e89ae None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:02.829588 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebea8d-da74-4dbe-b98b-0d20cf3e89ae None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:02.830954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 345/698] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:02.831522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebea8d-da74-4dbe-b98b-0d20cf3e89ae None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:02.884023 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:02.903341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb5c37-5489-4a75-a24d-840b3379fd91 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:02.942592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebea8d-da74-4dbe-b98b-0d20cf3e89ae None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:02.943469 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f015d-0125-42a6-8b6c-d67fd67b8d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:02.944451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f015d-0125-42a6-8b6c-d67fd67b8d76 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:02.944881 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f015d-0125-42a6-8b6c-d67fd67b8d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:02.945291 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f015d-0125-42a6-8b6c-d67fd67b8d76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:02.956809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f015d-0125-42a6-8b6c-d67fd67b8d76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:02.959377 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f015d-0125-42a6-8b6c-d67fd67b8d76 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:02.977535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-2e9f015d-0125-42a6-8b6c-d67fd67b8d76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:02.977535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:02.977535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:02.977535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:02.977535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:02.977535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:02.977535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:02.977535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:02.977535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:02.977535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:02.977535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:02.977535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:02.977535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:02.977535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:02.977535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:02.977535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:02.978511 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:02.978511 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:02.978511 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:02.978511 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:02.978511 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:02.978511 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:02.978511 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:02.978511 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:02.978511 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:02.978511 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:02.978511 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:02.978511 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:02.978511 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:02.978511 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:02.978511 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:02.978511 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:02.978511 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:02.979411 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:02.979411 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:02.979411 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:02.983200 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 354/699] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:02.983676 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f1c06-66f4-4906-8a95-1732bf22c5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:02.984425 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f1c06-66f4-4906-8a95-1732bf22c5ab None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:02.984620 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b215b-b909-4f34-ada8-f64cec5d8d20 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:02.984740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f1c06-66f4-4906-8a95-1732bf22c5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:02.984901 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b215b-b909-4f34-ada8-f64cec5d8d20 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:02.984997 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f1c06-66f4-4906-8a95-1732bf22c5ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:02.985208 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b215b-b909-4f34-ada8-f64cec5d8d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:03.003621 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-290b215b-b909-4f34-ada8-f64cec5d8d20 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:03.004823 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-290b215b-b909-4f34-ada8-f64cec5d8d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:03.055203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f1c06-66f4-4906-8a95-1732bf22c5ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:03.056701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f1c06-66f4-4906-8a95-1732bf22c5ab None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:03.057660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:03.080184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 355/700] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:45:03.081020 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b215b-b909-4f34-ada8-f64cec5d8d20 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:03.119568 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:03.184726 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 346/701] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:45:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:45:03.185898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f1c06-66f4-4906-8a95-1732bf22c5ab None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:03.211447 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b215b-b909-4f34-ada8-f64cec5d8d20 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:03.252382 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af8ddb-bf53-4cdc-8522-0b80d7afdf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:03.253735 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af8ddb-bf53-4cdc-8522-0b80d7afdf50 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:03.254241 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af8ddb-bf53-4cdc-8522-0b80d7afdf50 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:03.254662 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af8ddb-bf53-4cdc-8522-0b80d7afdf50 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:03.255506 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af8ddb-bf53-4cdc-8522-0b80d7afdf50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:03.257208 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af8ddb-bf53-4cdc-8522-0b80d7afdf50 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:03.283977 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 356/702] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Aug 30 11:45:03 2022] POST /identity/v3/users => generated 254 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:45:03.285118 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af8ddb-bf53-4cdc-8522-0b80d7afdf50 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:03.324077 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f1c06-66f4-4906-8a95-1732bf22c5ab None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:03.364905 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:03.387180 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f37e72-56b3-4e65-b278-a11b24902585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:03.387895 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f37e72-56b3-4e65-b278-a11b24902585 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:03.388474 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f37e72-56b3-4e65-b278-a11b24902585 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:03.388898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f37e72-56b3-4e65-b278-a11b24902585 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:03.389619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f37e72-56b3-4e65-b278-a11b24902585 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:03.390020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f37e72-56b3-4e65-b278-a11b24902585 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:03.391592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f37e72-56b3-4e65-b278-a11b24902585 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:03.404800 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 347/703] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:03.405984 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f37e72-56b3-4e65-b278-a11b24902585 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:03.411931 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:03.441200 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af8ddb-bf53-4cdc-8522-0b80d7afdf50 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:03.481262 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56731f35-baaa-46f7-8e7b-5489159609e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:03.481986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56731f35-baaa-46f7-8e7b-5489159609e0 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:03.482310 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56731f35-baaa-46f7-8e7b-5489159609e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:03.482589 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56731f35-baaa-46f7-8e7b-5489159609e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:03.497634 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56731f35-baaa-46f7-8e7b-5489159609e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:03.499151 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56731f35-baaa-46f7-8e7b-5489159609e0 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:03.513602 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-56731f35-baaa-46f7-8e7b-5489159609e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:03.513602 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:03.513602 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:03.513602 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:03.513602 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:03.513602 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:03.513602 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:03.513602 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:03.513602 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:03.513602 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:03.513602 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:03.513602 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:03.513602 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:03.513602 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:03.513602 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:03.513602 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:03.514568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:03.514568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:03.514568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:03.514568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:03.514568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:03.514568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:03.514568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:03.514568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:03.514568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:03.514568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:03.514568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:03.514568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:03.514568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:03.514568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:03.514568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:03.514568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:03.514568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:03.515614 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:03.515614 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:03.515614 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:03.515614 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 357/704] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:03.516400 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56731f35-baaa-46f7-8e7b-5489159609e0 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:03.531517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f37e72-56b3-4e65-b278-a11b24902585 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:03.571943 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb09cb-9172-4874-b36a-11f16bd785d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:03.572589 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb09cb-9172-4874-b36a-11f16bd785d3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:03.572874 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb09cb-9172-4874-b36a-11f16bd785d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:03.573134 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb09cb-9172-4874-b36a-11f16bd785d3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:03.573718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb09cb-9172-4874-b36a-11f16bd785d3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:03.575188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb09cb-9172-4874-b36a-11f16bd785d3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:03.588429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-c6eb09cb-9172-4874-b36a-11f16bd785d3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 11:45:03.588429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:03.588429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:45:03.588429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:45:03.588429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:45:03.588429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:45:03.588429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:45:03.588429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:03.588429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 11:45:03.588429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:03.588429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:03.588429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:03.588429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:03.588429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:03.588429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:03.588429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:03.588429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:03.589911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:03.589911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:03.589911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:03.589911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:03.589911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:03.589911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:03.589911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:45:03.589911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:45:03.589911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:45:03.589911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:45:03.589911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:03.589911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:03.589911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:03.589911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:03.589911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:03.589911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:03.590793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:03.590793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:03.590793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:03.590793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:03.590793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:03.590793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:03.590793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:03.590793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:03.590793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:03.590793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:03.590793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:45:03.590793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:03.590793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 11:45:03.590793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:03.592850 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 348/705] 10.222.0.27 () {56 vars in 1129 bytes} [Tue Aug 30 11:45:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:03.593914 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb09cb-9172-4874-b36a-11f16bd785d3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:03.648369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56731f35-baaa-46f7-8e7b-5489159609e0 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:03.651648 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:03.664960 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:03.688571 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d0308-52d9-4dc4-9eaa-027bb612a707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:03.689270 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d0308-52d9-4dc4-9eaa-027bb612a707 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:03.689484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d0308-52d9-4dc4-9eaa-027bb612a707 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:03.689756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d0308-52d9-4dc4-9eaa-027bb612a707 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:03.696522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d0308-52d9-4dc4-9eaa-027bb612a707 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:03.697979 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d0308-52d9-4dc4-9eaa-027bb612a707 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:03.699756 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb09cb-9172-4874-b36a-11f16bd785d3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:03.709325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-139d0308-52d9-4dc4-9eaa-027bb612a707 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:03.709325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:03.709325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:03.709325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:03.709325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:03.709325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:03.709325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:03.709325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:03.709325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:03.709325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:03.709325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:03.709325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:03.709325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:45:03.709325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:45:03.709325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:45:03.710273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:45:03.710273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:03.710273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:03.710273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:03.710273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:03.710273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:03.710273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:03.710273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:03.710273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:03.710273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:03.710273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:03.710273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:03.710273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:03.710273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:03.710273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:03.710273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:03.710273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:03.711166 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:45:03.711166 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:45:03.711166 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:45:03.711166 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:45:03.711166 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:45:03.711166 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:45:03.711166 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:03.711166 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:03.711166 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 358/706] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:03.712647 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d0308-52d9-4dc4-9eaa-027bb612a707 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:03.741661 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe6d37-1fb3-4b61-b9bc-655ac19a28b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:03.742325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe6d37-1fb3-4b61-b9bc-655ac19a28b7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:03.742520 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe6d37-1fb3-4b61-b9bc-655ac19a28b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:03.742743 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe6d37-1fb3-4b61-b9bc-655ac19a28b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:03.743392 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe6d37-1fb3-4b61-b9bc-655ac19a28b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:03.743698 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe6d37-1fb3-4b61-b9bc-655ac19a28b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:03.745077 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe6d37-1fb3-4b61-b9bc-655ac19a28b7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:03.757064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 349/707] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:03.758280 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c4c3a-1887-4090-9c3b-8f238f1e1629 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:03.758563 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c4c3a-1887-4090-9c3b-8f238f1e1629 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:03.758835 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c4c3a-1887-4090-9c3b-8f238f1e1629 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:03.760253 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 350/708] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:03.764569 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c4c3a-1887-4090-9c3b-8f238f1e1629 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:03.824870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d0308-52d9-4dc4-9eaa-027bb612a707 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:03.864332 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22395152-ab47-46b5-b093-10fba5bfbc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:03.864959 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22395152-ab47-46b5-b093-10fba5bfbc81 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:03.865257 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22395152-ab47-46b5-b093-10fba5bfbc81 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:03.865528 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22395152-ab47-46b5-b093-10fba5bfbc81 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:03.866155 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22395152-ab47-46b5-b093-10fba5bfbc81 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:03.866459 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22395152-ab47-46b5-b093-10fba5bfbc81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:03.867942 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22395152-ab47-46b5-b093-10fba5bfbc81 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:03.873227 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 359/709] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Aug 30 11:45:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:03.873560 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c4c3a-1887-4090-9c3b-8f238f1e1629 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:03.874026 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22395152-ab47-46b5-b093-10fba5bfbc81 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:03.894549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:03.903643 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:03.912062 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31b5b8-0600-4a98-9f2a-ff2f488d2604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:03.912678 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31b5b8-0600-4a98-9f2a-ff2f488d2604 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:03.912955 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31b5b8-0600-4a98-9f2a-ff2f488d2604 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:03.913226 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31b5b8-0600-4a98-9f2a-ff2f488d2604 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:03.913914 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31b5b8-0600-4a98-9f2a-ff2f488d2604 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:03.914207 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31b5b8-0600-4a98-9f2a-ff2f488d2604 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:03.915686 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31b5b8-0600-4a98-9f2a-ff2f488d2604 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:03.928820 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 351/710] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:45:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:03.928820 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570392c-fd95-43ef-b634-4246531fbbff None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:03.928820 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570392c-fd95-43ef-b634-4246531fbbff None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:03.928820 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570392c-fd95-43ef-b634-4246531fbbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:03.948376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1570392c-fd95-43ef-b634-4246531fbbff None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:03.949659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1570392c-fd95-43ef-b634-4246531fbbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:03.993722 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22395152-ab47-46b5-b093-10fba5bfbc81 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:04.014312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 352/711] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:45:04.015281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570392c-fd95-43ef-b634-4246531fbbff None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:04.041217 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77876072-1785-4bde-88f2-ee87808f8a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:04.042991 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77876072-1785-4bde-88f2-ee87808f8a0f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:04.043725 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77876072-1785-4bde-88f2-ee87808f8a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:04.044173 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77876072-1785-4bde-88f2-ee87808f8a0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:04.055340 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77876072-1785-4bde-88f2-ee87808f8a0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:04.058385 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77876072-1785-4bde-88f2-ee87808f8a0f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:04.075079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-77876072-1785-4bde-88f2-ee87808f8a0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:04.075079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:04.075079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:04.075079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:04.075079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:04.075079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:04.075079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:04.075079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:04.075079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:04.075079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:04.075079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:04.075079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:04.075079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:45:04.075079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:45:04.075079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:45:04.076022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:45:04.076022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:04.076022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:04.076022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:04.076022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:04.076022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:04.076022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:04.076022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:04.076022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:04.076022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:04.076022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:04.076022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:04.076022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:04.076022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:04.076022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:04.076022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:04.076022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:04.076934 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:45:04.076934 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:45:04.076934 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:45:04.076934 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:45:04.076934 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:45:04.076934 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:45:04.076934 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:04.076934 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:04.084429 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 360/712] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:04.084429 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77876072-1785-4bde-88f2-ee87808f8a0f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:04.146284 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570392c-fd95-43ef-b634-4246531fbbff None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:04.161292 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:04.166513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:04.187470 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b1c69-33d5-4eec-80e8-08c8ef6eac88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:04.188441 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b1c69-33d5-4eec-80e8-08c8ef6eac88 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:04.188913 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b1c69-33d5-4eec-80e8-08c8ef6eac88 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:04.189242 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77876072-1785-4bde-88f2-ee87808f8a0f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:04.189619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b1c69-33d5-4eec-80e8-08c8ef6eac88 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:04.190547 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b1c69-33d5-4eec-80e8-08c8ef6eac88 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:04.191192 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b1c69-33d5-4eec-80e8-08c8ef6eac88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:04.192933 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b1c69-33d5-4eec-80e8-08c8ef6eac88 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:04.199397 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 353/713] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Aug 30 11:45:04 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:04.200450 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b1c69-33d5-4eec-80e8-08c8ef6eac88 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:04.259341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94974a3a-2236-4d13-b061-d8aa0ea7fe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:04.261566 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94974a3a-2236-4d13-b061-d8aa0ea7fe6e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:04.262372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94974a3a-2236-4d13-b061-d8aa0ea7fe6e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:04.264334 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94974a3a-2236-4d13-b061-d8aa0ea7fe6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:04.265357 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94974a3a-2236-4d13-b061-d8aa0ea7fe6e None admin] RBAC: Adding query filter params (role.id=4f4d8a6881ca496bb2d4845a6592fea8, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=8d17f1d0577a41ed8859706073f79d77) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:04.267205 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94974a3a-2236-4d13-b061-d8aa0ea7fe6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:04.269150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94974a3a-2236-4d13-b061-d8aa0ea7fe6e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:04.277721 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 361/714] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:45:04 2022] GET /identity/v3/role_assignments?user.id=8d17f1d0577a41ed8859706073f79d77&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=4f4d8a6881ca496bb2d4845a6592fea8 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:04.295501 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94974a3a-2236-4d13-b061-d8aa0ea7fe6e None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:04.424019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b1c69-33d5-4eec-80e8-08c8ef6eac88 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:04.473119 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c51448-b663-4678-bd0e-f5a80951f4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:04.474011 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c51448-b663-4678-bd0e-f5a80951f4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:04.474292 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c51448-b663-4678-bd0e-f5a80951f4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:04.474562 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c51448-b663-4678-bd0e-f5a80951f4b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:04.475272 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c51448-b663-4678-bd0e-f5a80951f4b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:04.475620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c51448-b663-4678-bd0e-f5a80951f4b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:04.475720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94974a3a-2236-4d13-b061-d8aa0ea7fe6e None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:04.477071 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c51448-b663-4678-bd0e-f5a80951f4b2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:04.494506 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 354/715] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:45:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:04.500521 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c51448-b663-4678-bd0e-f5a80951f4b2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:04.517738 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd018b51-7c7e-42e6-87f7-5bdf9cd4a99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:04.518355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd018b51-7c7e-42e6-87f7-5bdf9cd4a99f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:04.518676 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd018b51-7c7e-42e6-87f7-5bdf9cd4a99f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:04.518954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd018b51-7c7e-42e6-87f7-5bdf9cd4a99f None admin] PATH_INFO: `/v3/services/network` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:04.519572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd018b51-7c7e-42e6-87f7-5bdf9cd4a99f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:04.521017 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd018b51-7c7e-42e6-87f7-5bdf9cd4a99f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:04.534188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-fd018b51-7c7e-42e6-87f7-5bdf9cd4a99f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 11:45:04.534188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:04.534188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:45:04.534188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:45:04.534188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:45:04.534188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:45:04.534188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:45:04.534188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:04.534188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 11:45:04.534188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:04.534188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:04.534188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:04.534188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:04.534188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:04.534188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:04.534188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:04.534188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:04.535295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:04.535295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:04.535295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:04.535295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:04.535295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:04.535295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:04.535295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:45:04.535295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:45:04.535295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:45:04.535295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:45:04.535295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:04.535295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:04.535295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:04.535295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:04.535295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:04.535295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:04.536206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:04.536206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:04.536206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:04.536206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:04.536206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:04.536206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:04.536206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:04.536206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:04.536206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:04.536206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:04.536206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:45:04.536206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:04.536206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 11:45:04.536206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:04.536206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 362/716] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:04 2022] GET /identity/v3/services/network => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:04.541556 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd018b51-7c7e-42e6-87f7-5bdf9cd4a99f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:04.545108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:04.615764 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:04.707956 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd018b51-7c7e-42e6-87f7-5bdf9cd4a99f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:04.718419 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c51448-b663-4678-bd0e-f5a80951f4b2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:04.776035 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61672a9f-2fac-4020-98ab-fa454a81077a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:04.776578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61672a9f-2fac-4020-98ab-fa454a81077a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:04.776855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61672a9f-2fac-4020-98ab-fa454a81077a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:04.777127 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61672a9f-2fac-4020-98ab-fa454a81077a None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:04.777766 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61672a9f-2fac-4020-98ab-fa454a81077a None admin] RBAC: Adding query filter params (name=network) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:04.778064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61672a9f-2fac-4020-98ab-fa454a81077a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:04.779502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61672a9f-2fac-4020-98ab-fa454a81077a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:04.784572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1ee3f-bdbf-4897-916c-7bb73f09d582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:04.785189 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1ee3f-bdbf-4897-916c-7bb73f09d582 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:04.785459 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1ee3f-bdbf-4897-916c-7bb73f09d582 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:04.785724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1ee3f-bdbf-4897-916c-7bb73f09d582 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:04.786450 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1ee3f-bdbf-4897-916c-7bb73f09d582 None admin] RBAC: Adding query filter params (role.id=eec5decc24ab4673a246120350336b1e, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=8d27bfb8c0b64763b7db7cffa5f230f6) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:04.786754 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1ee3f-bdbf-4897-916c-7bb73f09d582 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:04.788193 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1ee3f-bdbf-4897-916c-7bb73f09d582 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:04.792118 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 363/717] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Aug 30 11:45:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:04.796618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 355/718] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:45:04 2022] GET /identity/v3/role_assignments?user.id=8d27bfb8c0b64763b7db7cffa5f230f6&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=eec5decc24ab4673a246120350336b1e => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:04.797593 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61672a9f-2fac-4020-98ab-fa454a81077a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:04.870205 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:04.913503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61672a9f-2fac-4020-98ab-fa454a81077a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:04.964992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b3854-2b6c-4fe6-96d0-c4d62d9aee27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:04.965669 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b3854-2b6c-4fe6-96d0-c4d62d9aee27 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:04.965946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b3854-2b6c-4fe6-96d0-c4d62d9aee27 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:04.966265 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b3854-2b6c-4fe6-96d0-c4d62d9aee27 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:04.966907 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b3854-2b6c-4fe6-96d0-c4d62d9aee27 None admin] RBAC: Adding query filter params (type=network) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:04.967215 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b3854-2b6c-4fe6-96d0-c4d62d9aee27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:04.968695 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b3854-2b6c-4fe6-96d0-c4d62d9aee27 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:04.975450 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 364/719] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Aug 30 11:45:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:05.437123 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f26399-9b08-4b6d-a8d6-df1ea0454b42 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:05.437646 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f26399-9b08-4b6d-a8d6-df1ea0454b42 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:05.437646 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f26399-9b08-4b6d-a8d6-df1ea0454b42 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:05.439095 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 356/720] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:05.444667 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb852be-2cdc-4023-a824-9da62a3282aa None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:05.445087 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb852be-2cdc-4023-a824-9da62a3282aa None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:05.445213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb852be-2cdc-4023-a824-9da62a3282aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:05.472475 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-5cb852be-2cdc-4023-a824-9da62a3282aa None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:05.473701 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5cb852be-2cdc-4023-a824-9da62a3282aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:05.553533 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 365/721] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:45:05.954691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f26399-9b08-4b6d-a8d6-df1ea0454b42 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:06.087772 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f26399-9b08-4b6d-a8d6-df1ea0454b42 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:06.095807 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:06.144443 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48456fb6-117b-49b9-b95f-51ed6715aae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:06.145084 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48456fb6-117b-49b9-b95f-51ed6715aae4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:06.145357 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48456fb6-117b-49b9-b95f-51ed6715aae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:06.145621 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48456fb6-117b-49b9-b95f-51ed6715aae4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:06.164792 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48456fb6-117b-49b9-b95f-51ed6715aae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:45:06.169671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-48456fb6-117b-49b9-b95f-51ed6715aae4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:45:06.169671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:06.169671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:06.169671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:06.169671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:06.169671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:06.169671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:06.169671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:06.169671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:06.169671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:06.169671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:06.169671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:06.169671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:45:06.169671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:45:06.169671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:45:06.169671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:45:06.170665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:45:06.170665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:45:06.170665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:45:06.170665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:45:06.170665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:06.170665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:06.170665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:06.170665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:06.170665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:06.170665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:06.170665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:06.170665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:06.170665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:06.170665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:06.170665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:06.170665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:06.171755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:06.171755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:06.171755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:06.171755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:06.171755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:45:06.171755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:45:06.171755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:45:06.171755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:45:06.171755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:45:06.171755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:45:06.171755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:45:06.171755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:06.171755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 357/722] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:45:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:06.176881 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb852be-2cdc-4023-a824-9da62a3282aa None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:06.254849 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:06.299323 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb852be-2cdc-4023-a824-9da62a3282aa None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:06.346087 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f40942-e2e6-4c1c-952a-206b1641a123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:06.346766 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f40942-e2e6-4c1c-952a-206b1641a123 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:06.347043 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f40942-e2e6-4c1c-952a-206b1641a123 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:06.347311 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f40942-e2e6-4c1c-952a-206b1641a123 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:06.348089 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f40942-e2e6-4c1c-952a-206b1641a123 None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:06.348395 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f40942-e2e6-4c1c-952a-206b1641a123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:06.349776 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f40942-e2e6-4c1c-952a-206b1641a123 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:06.358512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 366/723] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Aug 30 11:45:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:06.364373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48456fb6-117b-49b9-b95f-51ed6715aae4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:06.470461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48456fb6-117b-49b9-b95f-51ed6715aae4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:06.508023 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425557d9-467e-41f9-bfee-70555024693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:06.508580 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425557d9-467e-41f9-bfee-70555024693c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:06.508846 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425557d9-467e-41f9-bfee-70555024693c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:06.509209 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425557d9-467e-41f9-bfee-70555024693c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:06.520078 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425557d9-467e-41f9-bfee-70555024693c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:06.521529 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425557d9-467e-41f9-bfee-70555024693c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:06.536718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-425557d9-467e-41f9-bfee-70555024693c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:06.536718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:06.536718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:06.536718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:06.536718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:06.536718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:06.536718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:06.536718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:06.536718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:06.536718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:06.536718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:06.536718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:06.536718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:06.536718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:06.536718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:06.536718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:06.538825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:06.538825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:06.538825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:06.538825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:06.538825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:06.538825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:06.538825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:06.538825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:06.538825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:06.538825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:06.538825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:06.538825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:06.538825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:06.538825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:06.538825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:06.538825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:06.538825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:06.540911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:06.540911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:06.540911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:06.540911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 358/724] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:06.548634 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f40942-e2e6-4c1c-952a-206b1641a123 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:06.607168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc161c5-2b16-4254-9424-6e0b520d372b None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:06.607855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc161c5-2b16-4254-9424-6e0b520d372b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:06.608357 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc161c5-2b16-4254-9424-6e0b520d372b None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:06.610440 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 359/725] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:45:06.615724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b05267-f52f-4797-93d2-3f3c78350342 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:06.616251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b05267-f52f-4797-93d2-3f3c78350342 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:06.616723 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b05267-f52f-4797-93d2-3f3c78350342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:06.635218 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a9b05267-f52f-4797-93d2-3f3c78350342 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:06.636790 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a9b05267-f52f-4797-93d2-3f3c78350342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:06.652450 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:06.693302 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f40942-e2e6-4c1c-952a-206b1641a123 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:06.738184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:06.751015 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285dd6e1-e296-4ab2-9826-85eb948e216f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:06.751862 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dd6e1-e296-4ab2-9826-85eb948e216f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:06.752213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dd6e1-e296-4ab2-9826-85eb948e216f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:06.752629 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dd6e1-e296-4ab2-9826-85eb948e216f None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:06.753354 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285dd6e1-e296-4ab2-9826-85eb948e216f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:06.753722 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285dd6e1-e296-4ab2-9826-85eb948e216f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:06.755181 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285dd6e1-e296-4ab2-9826-85eb948e216f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:06.757297 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 360/726] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 11:45:06.758847 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2095aa-a606-4dd7-84b9-6a08c5832981 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:06.759077 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2095aa-a606-4dd7-84b9-6a08c5832981 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:06.759347 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2095aa-a606-4dd7-84b9-6a08c5832981 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:06.765589 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 361/727] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:06.767198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69f3c5-5537-40c1-8fad-ebee2b33e7a1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:06.767510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69f3c5-5537-40c1-8fad-ebee2b33e7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:06.767782 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69f3c5-5537-40c1-8fad-ebee2b33e7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:06.768642 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 367/728] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:06.780380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285dd6e1-e296-4ab2-9826-85eb948e216f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:06.787048 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9c69f3c5-5537-40c1-8fad-ebee2b33e7a1 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:06.788309 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9c69f3c5-5537-40c1-8fad-ebee2b33e7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:06.863521 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 362/729] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:45:06.970584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285dd6e1-e296-4ab2-9826-85eb948e216f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:07.007321 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c1d4d-9209-4ddb-9731-3fd5f7802364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:07.007989 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c1d4d-9209-4ddb-9731-3fd5f7802364 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:07.008267 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c1d4d-9209-4ddb-9731-3fd5f7802364 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:07.008541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c1d4d-9209-4ddb-9731-3fd5f7802364 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:07.024540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c1d4d-9209-4ddb-9731-3fd5f7802364 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:07.025954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c1d4d-9209-4ddb-9731-3fd5f7802364 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:07.046712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-af6c1d4d-9209-4ddb-9731-3fd5f7802364 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:45:07.046712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:07.046712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:07.046712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:07.046712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:07.046712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:07.046712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:07.046712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:07.046712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:07.046712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:07.046712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:07.046712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:07.046712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:45:07.046712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:45:07.046712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:45:07.046712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:45:07.048802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:07.048802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:07.048802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:45:07.048802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:07.048802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:45:07.048802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:07.048802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:07.048802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:07.048802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:07.048802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:07.048802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:07.048802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:07.048802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:07.048802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:07.048802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:07.048802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:07.048802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:07.048802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:07.049961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:07.049961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:07.049961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:45:07.049961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:45:07.049961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:45:07.049961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:45:07.049961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:45:07.049961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:45:07.049961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:45:07.049961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:07.049961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 368/730] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Aug 30 11:45:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:07.056403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69f3c5-5537-40c1-8fad-ebee2b33e7a1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:07.079282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c1d4d-9209-4ddb-9731-3fd5f7802364 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:07.157017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:07.166912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:07.179450 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69f3c5-5537-40c1-8fad-ebee2b33e7a1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:07.215965 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996c528-3df8-4e37-a570-6dd0c3684205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:07.216715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996c528-3df8-4e37-a570-6dd0c3684205 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:07.217051 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996c528-3df8-4e37-a570-6dd0c3684205 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:07.217380 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996c528-3df8-4e37-a570-6dd0c3684205 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:07.218217 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996c528-3df8-4e37-a570-6dd0c3684205 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:07.218582 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996c528-3df8-4e37-a570-6dd0c3684205 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:07.220658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996c528-3df8-4e37-a570-6dd0c3684205 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:07.232832 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c1d4d-9209-4ddb-9731-3fd5f7802364 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:07.243589 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 363/731] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Aug 30 11:45:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:07.244894 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996c528-3df8-4e37-a570-6dd0c3684205 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:07.271236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c07abb-e1c6-42e0-bbc6-a5b62b1f1c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:07.272316 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c07abb-e1c6-42e0-bbc6-a5b62b1f1c07 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:07.272797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c07abb-e1c6-42e0-bbc6-a5b62b1f1c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:07.273267 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c07abb-e1c6-42e0-bbc6-a5b62b1f1c07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:07.284902 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c07abb-e1c6-42e0-bbc6-a5b62b1f1c07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:45:07.290711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-74c07abb-e1c6-42e0-bbc6-a5b62b1f1c07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:45:07.290711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:07.290711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:07.290711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:07.290711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:07.290711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:07.290711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:07.290711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:07.290711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:07.290711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:07.290711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:07.290711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:07.290711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:45:07.290711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:45:07.290711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:45:07.290711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:45:07.291686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:45:07.291686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:45:07.291686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:45:07.291686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:45:07.291686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:07.291686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:07.291686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:07.291686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:07.291686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:07.291686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:07.291686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:07.291686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:07.291686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:07.291686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:07.291686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:07.291686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:07.292560 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:07.292560 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:07.292560 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:07.292560 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:07.292560 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:45:07.292560 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:45:07.292560 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:45:07.292560 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:45:07.292560 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:45:07.292560 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:45:07.292560 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:45:07.292560 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:07.295210 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 369/732] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:45:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:07.296333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c07abb-e1c6-42e0-bbc6-a5b62b1f1c07 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:07.372741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996c528-3df8-4e37-a570-6dd0c3684205 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:07.406963 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c07abb-e1c6-42e0-bbc6-a5b62b1f1c07 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:07.408960 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:07.421923 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317eb792-aca5-40f8-af4f-2245c15558af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:07.422907 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317eb792-aca5-40f8-af4f-2245c15558af None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:07.423314 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317eb792-aca5-40f8-af4f-2245c15558af None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:07.423618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317eb792-aca5-40f8-af4f-2245c15558af None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:07.424277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317eb792-aca5-40f8-af4f-2245c15558af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:07.425694 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317eb792-aca5-40f8-af4f-2245c15558af None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:07.431659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:07.444160 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2ff30-c369-452d-b4ee-2496aeaf4a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:07.444872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2ff30-c369-452d-b4ee-2496aeaf4a0d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:07.445100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2ff30-c369-452d-b4ee-2496aeaf4a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:07.445318 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2ff30-c369-452d-b4ee-2496aeaf4a0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:07.446385 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 364/733] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Aug 30 11:45:07 2022] POST /identity/v3/services => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:45:07.447262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317eb792-aca5-40f8-af4f-2245c15558af None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:07.556557 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2ff30-c369-452d-b4ee-2496aeaf4a0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:07.558094 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2ff30-c369-452d-b4ee-2496aeaf4a0d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:07.585607 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317eb792-aca5-40f8-af4f-2245c15558af None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:07.631122 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682beda-3aa5-4172-9916-9ca4a0d0a7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:07.631692 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682beda-3aa5-4172-9916-9ca4a0d0a7d0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:07.631975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682beda-3aa5-4172-9916-9ca4a0d0a7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:07.632249 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682beda-3aa5-4172-9916-9ca4a0d0a7d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:07.632921 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682beda-3aa5-4172-9916-9ca4a0d0a7d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:07.633224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682beda-3aa5-4172-9916-9ca4a0d0a7d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:07.634613 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682beda-3aa5-4172-9916-9ca4a0d0a7d0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:07.643083 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 365/734] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:45:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:07.644354 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d97355-2fa5-4b6e-a92b-1e7ab9c9d764 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:07.644661 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d97355-2fa5-4b6e-a92b-1e7ab9c9d764 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:07.644906 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d97355-2fa5-4b6e-a92b-1e7ab9c9d764 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:07.646347 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 366/735] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:07.647386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ce0b5-0c6e-46d1-9814-34c0c0c0d349 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:07.647673 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ce0b5-0c6e-46d1-9814-34c0c0c0d349 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:07.647943 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ce0b5-0c6e-46d1-9814-34c0c0c0d349 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:07.649406 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 367/736] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:07.652875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ce0b5-0c6e-46d1-9814-34c0c0c0d349 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:07.673326 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 370/737] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:45:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 11:45:07.674729 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f69ec7-fd91-4918-b58f-8d5650d0106e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:07.675077 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f69ec7-fd91-4918-b58f-8d5650d0106e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:07.675451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f69ec7-fd91-4918-b58f-8d5650d0106e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:07.681790 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:07.695388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-75f69ec7-fd91-4918-b58f-8d5650d0106e None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:07.696825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-75f69ec7-fd91-4918-b58f-8d5650d0106e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:07.718733 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:07.766950 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 371/738] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:07 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:45:07.771594 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceb9d2-fe03-43b2-9591-33eb714f1611 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:07.771679 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ce0b5-0c6e-46d1-9814-34c0c0c0d349 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:07.771756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceb9d2-fe03-43b2-9591-33eb714f1611 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:07.771756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceb9d2-fe03-43b2-9591-33eb714f1611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:07.787390 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d8ceb9d2-fe03-43b2-9591-33eb714f1611 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:07.788589 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d8ceb9d2-fe03-43b2-9591-33eb714f1611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:07.823193 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ac3e1-9e05-44fe-ba95-e5d74215358d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:07.823777 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ac3e1-9e05-44fe-ba95-e5d74215358d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:07.824053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ac3e1-9e05-44fe-ba95-e5d74215358d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:07.824320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ac3e1-9e05-44fe-ba95-e5d74215358d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:07.838159 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ac3e1-9e05-44fe-ba95-e5d74215358d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:07.840053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ac3e1-9e05-44fe-ba95-e5d74215358d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:07.855279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-8b4ac3e1-9e05-44fe-ba95-e5d74215358d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:07.855279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:07.855279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:07.855279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:07.855279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:07.855279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:07.855279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:07.855279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:07.855279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:07.855279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:07.855279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:07.855279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:07.855279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:07.855279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:07.855279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:07.855279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:07.856281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:07.856281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:07.856281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:07.856281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:07.856281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:07.856281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:07.856281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:07.856281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:07.856281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:07.856281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:07.856281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:07.856281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:07.856281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:07.856281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:07.856281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:07.856281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:07.856281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:07.857196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:07.857196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:07.857196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:07.861403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 368/739] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:07.862404 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ac3e1-9e05-44fe-ba95-e5d74215358d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:07.884678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 372/740] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:07 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 11:45:07.884678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ceb9d2-fe03-43b2-9591-33eb714f1611 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:08.002633 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:08.022602 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ac3e1-9e05-44fe-ba95-e5d74215358d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:08.032585 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:08.063443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ceb9d2-fe03-43b2-9591-33eb714f1611 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:08.076207 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce893d-fd73-4eb7-824b-ed6e335ac001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:08.077498 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce893d-fd73-4eb7-824b-ed6e335ac001 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:08.078103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce893d-fd73-4eb7-824b-ed6e335ac001 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:08.078802 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce893d-fd73-4eb7-824b-ed6e335ac001 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:08.095973 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce893d-fd73-4eb7-824b-ed6e335ac001 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:08.098559 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce893d-fd73-4eb7-824b-ed6e335ac001 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:08.114231 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5d250-2e5b-448b-bb85-f1d37b713b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:08.114870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5d250-2e5b-448b-bb85-f1d37b713b50 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:08.115150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5d250-2e5b-448b-bb85-f1d37b713b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:08.115508 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5d250-2e5b-448b-bb85-f1d37b713b50 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:08.116055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-01ce893d-fd73-4eb7-824b-ed6e335ac001 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:08.116055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:08.116055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:08.116055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:08.116055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:08.116055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:08.116055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:08.116055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:08.116055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:08.116055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:08.116055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:08.116055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:08.116055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:08.116055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:08.116055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:08.116055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:08.116986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:08.116986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:08.116986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:08.116986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:08.116986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:08.116986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:08.116986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:08.116986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:08.116986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:08.116986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:08.116986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:08.116986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:08.116986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:08.116986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:08.116986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:08.116986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:08.116986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:08.117897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:08.117897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:08.117897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:08.118065 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5d250-2e5b-448b-bb85-f1d37b713b50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:08.118065 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5d250-2e5b-448b-bb85-f1d37b713b50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:08.118065 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5d250-2e5b-448b-bb85-f1d37b713b50 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:08.120489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 369/741] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:08.121510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce893d-fd73-4eb7-824b-ed6e335ac001 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:08.136719 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 373/742] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:08.137582 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5d250-2e5b-448b-bb85-f1d37b713b50 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:08.244440 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce893d-fd73-4eb7-824b-ed6e335ac001 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:08.257953 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5d250-2e5b-448b-bb85-f1d37b713b50 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:08.281474 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2b722-5d66-4e33-80a2-922792f2f376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:08.282090 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2b722-5d66-4e33-80a2-922792f2f376 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:08.282391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2b722-5d66-4e33-80a2-922792f2f376 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:08.282655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2b722-5d66-4e33-80a2-922792f2f376 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:08.282774 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:08.283291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2b722-5d66-4e33-80a2-922792f2f376 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:08.285138 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2b722-5d66-4e33-80a2-922792f2f376 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:08.296628 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5fa1c-7038-4c4b-9555-57b8eaa64d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:08.297225 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5fa1c-7038-4c4b-9555-57b8eaa64d3b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:08.297508 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5fa1c-7038-4c4b-9555-57b8eaa64d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:08.297777 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5fa1c-7038-4c4b-9555-57b8eaa64d3b None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:08.298436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5fa1c-7038-4c4b-9555-57b8eaa64d3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:08.298732 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5fa1c-7038-4c4b-9555-57b8eaa64d3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:08.300318 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5fa1c-7038-4c4b-9555-57b8eaa64d3b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:08.300438 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 370/743] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Aug 30 11:45:08 2022] POST /identity/v3/services => generated 240 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:45:08.300940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2b722-5d66-4e33-80a2-922792f2f376 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:08.326807 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:08.339821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 374/744] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:08.339821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5fa1c-7038-4c4b-9555-57b8eaa64d3b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:08.455088 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2b722-5d66-4e33-80a2-922792f2f376 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:08.476652 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5fa1c-7038-4c4b-9555-57b8eaa64d3b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:08.500810 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185bee0-7b52-4c15-ae08-a8568ae5e15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:08.501464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185bee0-7b52-4c15-ae08-a8568ae5e15c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:08.501745 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185bee0-7b52-4c15-ae08-a8568ae5e15c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:08.502021 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185bee0-7b52-4c15-ae08-a8568ae5e15c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:08.510753 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185bee0-7b52-4c15-ae08-a8568ae5e15c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:08.512275 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185bee0-7b52-4c15-ae08-a8568ae5e15c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:08.517099 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e24e46-7902-424f-bf2e-03ea7521281d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:08.518000 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e24e46-7902-424f-bf2e-03ea7521281d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:08.518495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e24e46-7902-424f-bf2e-03ea7521281d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:08.518984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e24e46-7902-424f-bf2e-03ea7521281d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:08.524839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-8185bee0-7b52-4c15-ae08-a8568ae5e15c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:45:08.524839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:08.524839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:08.524839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:08.524839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:08.524839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:08.524839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:08.524839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:08.524839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:08.524839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:08.524839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:08.524839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:08.524839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:45:08.524839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:45:08.524839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:45:08.524839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:45:08.525808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:08.525808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:08.525808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:45:08.525808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:08.525808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:45:08.525808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:08.525808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:08.525808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:08.525808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:08.525808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:08.525808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:08.525808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:08.525808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:08.525808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:08.525808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:08.525808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:08.525808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:08.525808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:08.526744 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:08.526744 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:08.526744 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:45:08.526744 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:45:08.526744 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:45:08.526744 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:45:08.526744 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:45:08.526744 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:45:08.526744 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:45:08.526744 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:08.526744 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 371/745] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Aug 30 11:45:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:08.527333 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185bee0-7b52-4c15-ae08-a8568ae5e15c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:08.540299 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e24e46-7902-424f-bf2e-03ea7521281d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:45:08.545966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-39e24e46-7902-424f-bf2e-03ea7521281d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:45:08.545966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:08.545966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:08.545966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:08.545966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:08.545966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:08.545966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:08.545966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:08.545966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:08.545966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:08.545966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:08.545966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:08.545966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:45:08.545966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:45:08.545966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:45:08.545966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:45:08.547097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:45:08.547097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:45:08.547097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:45:08.547097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:45:08.547097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:08.547097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:08.547097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:08.547097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:08.547097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:08.547097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:08.547097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:08.547097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:08.547097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:08.547097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:08.547097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:08.547097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:08.548019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:08.548019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:08.548019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:08.548019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:08.548019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:45:08.548019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:45:08.548019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:45:08.548019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:45:08.548019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:45:08.548019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:45:08.548019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:45:08.548019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:08.548019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 375/746] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:45:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:08.548844 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e24e46-7902-424f-bf2e-03ea7521281d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:08.604481 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:08.647437 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:08.676326 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185bee0-7b52-4c15-ae08-a8568ae5e15c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:08.683445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e24e46-7902-424f-bf2e-03ea7521281d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:08.720509 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519265d9-05d5-49c4-9f74-bc106cefffc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:08.721282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519265d9-05d5-49c4-9f74-bc106cefffc2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:08.721612 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519265d9-05d5-49c4-9f74-bc106cefffc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:08.721945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519265d9-05d5-49c4-9f74-bc106cefffc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:08.723252 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b6160-4f6c-41d3-bda0-53ee5e0991da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:08.724173 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b6160-4f6c-41d3-bda0-53ee5e0991da None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:08.724629 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b6160-4f6c-41d3-bda0-53ee5e0991da None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:08.725161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b6160-4f6c-41d3-bda0-53ee5e0991da None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:08.726094 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b6160-4f6c-41d3-bda0-53ee5e0991da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:08.726596 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b6160-4f6c-41d3-bda0-53ee5e0991da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:08.728278 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b6160-4f6c-41d3-bda0-53ee5e0991da None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:08.729073 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519265d9-05d5-49c4-9f74-bc106cefffc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:08.730753 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519265d9-05d5-49c4-9f74-bc106cefffc2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:08.745696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-519265d9-05d5-49c4-9f74-bc106cefffc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:08.745696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:08.745696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:08.745696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:08.745696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:08.745696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:08.745696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:08.745696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:08.745696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:08.745696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:08.745696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:08.745696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:08.745696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:45:08.745696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:45:08.745696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:45:08.746652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:45:08.746652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:08.746652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:08.746652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:08.746652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:08.746652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:08.746652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:08.746652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:08.746652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:08.746652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:08.746652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:08.746652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:08.746652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:08.746652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:08.746652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:08.746652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:08.746652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:08.747604 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:45:08.747604 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:45:08.747604 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:45:08.747604 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:45:08.747604 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:45:08.747604 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:45:08.747604 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:08.747604 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:08.754874 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 372/748] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:08.754874 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519265d9-05d5-49c4-9f74-bc106cefffc2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:08.755323 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 376/748] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Aug 30 11:45:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:08.756541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b6160-4f6c-41d3-bda0-53ee5e0991da None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:08.864776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519265d9-05d5-49c4-9f74-bc106cefffc2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:08.865753 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:08.869100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b6160-4f6c-41d3-bda0-53ee5e0991da None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:08.903784 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b29afc-cb6f-492d-ac1f-f545f2ff9846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:08.904727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf415e-43c0-430f-b395-6e17f92c58c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:08.905155 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b29afc-cb6f-492d-ac1f-f545f2ff9846 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:08.905332 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf415e-43c0-430f-b395-6e17f92c58c4 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:08.905653 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf415e-43c0-430f-b395-6e17f92c58c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:08.905932 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf415e-43c0-430f-b395-6e17f92c58c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:08.906494 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b29afc-cb6f-492d-ac1f-f545f2ff9846 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:08.906612 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf415e-43c0-430f-b395-6e17f92c58c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:08.906892 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf415e-43c0-430f-b395-6e17f92c58c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:08.907334 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b29afc-cb6f-492d-ac1f-f545f2ff9846 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:08.908206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b29afc-cb6f-492d-ac1f-f545f2ff9846 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:08.908406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf415e-43c0-430f-b395-6e17f92c58c4 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:08.908907 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b29afc-cb6f-492d-ac1f-f545f2ff9846 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:08.910569 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b29afc-cb6f-492d-ac1f-f545f2ff9846 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:08.912296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:08.925805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 377/749] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:45:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:08.925805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf415e-43c0-430f-b395-6e17f92c58c4 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:08.927176 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 373/750] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:45:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:08.928314 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b29afc-cb6f-492d-ac1f-f545f2ff9846 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:09.031003 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf415e-43c0-430f-b395-6e17f92c58c4 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:09.039517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b29afc-cb6f-492d-ac1f-f545f2ff9846 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:09.072272 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b57bac-155e-4fba-9a3b-7fa49654e623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:09.072912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b57bac-155e-4fba-9a3b-7fa49654e623 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:09.073189 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b57bac-155e-4fba-9a3b-7fa49654e623 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:09.073466 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b57bac-155e-4fba-9a3b-7fa49654e623 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:09.079984 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03a611-8ed8-4008-a7e0-8f4575ec60b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:09.080896 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03a611-8ed8-4008-a7e0-8f4575ec60b0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:09.081390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03a611-8ed8-4008-a7e0-8f4575ec60b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:09.081908 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03a611-8ed8-4008-a7e0-8f4575ec60b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:09.085908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b57bac-155e-4fba-9a3b-7fa49654e623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:09.087395 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b57bac-155e-4fba-9a3b-7fa49654e623 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:09.094422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03a611-8ed8-4008-a7e0-8f4575ec60b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:09.097018 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03a611-8ed8-4008-a7e0-8f4575ec60b0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:09.115384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-2f03a611-8ed8-4008-a7e0-8f4575ec60b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:09.115384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:09.115384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:09.115384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:09.115384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:09.115384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:09.115384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:09.115384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:09.115384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:09.115384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:09.115384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:09.115384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:09.115384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:09.115384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:09.115384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:09.115384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:09.116317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:09.116317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:09.116317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:09.116317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:09.116317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:09.116317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:09.116317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:09.116317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:09.116317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:09.116317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:09.116317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:09.116317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:09.116317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:09.116317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:09.116317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:09.116317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:09.116317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:09.117200 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:09.117200 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:09.117200 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:09.117367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-d0b57bac-155e-4fba-9a3b-7fa49654e623 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:09.117367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:09.117367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:09.117367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:09.117367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:09.117367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:09.117367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:09.117367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:09.117367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:09.117367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:09.117367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:09.117367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:09.117367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:09.117367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:09.117367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:09.117367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:09.118194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:09.118194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:09.118194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:09.118194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:09.118194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:09.118194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:09.118194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:09.118194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:09.118194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:09.118194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:09.118194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:09.118194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:09.118194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:09.118194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:09.118194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:09.118194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:09.118194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:09.119079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:09.119079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:09.119079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:09.121343 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 378/751] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:09.126809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b57bac-155e-4fba-9a3b-7fa49654e623 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:09.127207 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 374/752] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:09.128538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03a611-8ed8-4008-a7e0-8f4575ec60b0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:09.140739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:09.185469 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:09.240627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b57bac-155e-4fba-9a3b-7fa49654e623 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:09.256726 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03a611-8ed8-4008-a7e0-8f4575ec60b0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:09.283910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb57e58-5e85-44b8-ba96-709d9cd12eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:09.285094 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb57e58-5e85-44b8-ba96-709d9cd12eee None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:09.285381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb57e58-5e85-44b8-ba96-709d9cd12eee None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:09.285660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb57e58-5e85-44b8-ba96-709d9cd12eee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:09.286410 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb57e58-5e85-44b8-ba96-709d9cd12eee None admin] RBAC: Adding query filter params (role.id=eec5decc24ab4673a246120350336b1e, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=58c86110ce97463e9b3d53691ae3e12c) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:09.286976 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb57e58-5e85-44b8-ba96-709d9cd12eee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:09.289084 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb57e58-5e85-44b8-ba96-709d9cd12eee None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:09.304137 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 379/753] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:45:09 2022] GET /identity/v3/role_assignments?user.id=58c86110ce97463e9b3d53691ae3e12c&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=eec5decc24ab4673a246120350336b1e => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:09.305319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb57e58-5e85-44b8-ba96-709d9cd12eee None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:09.317850 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92230ad6-60c8-42d5-8d2d-01f4f85ca399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:09.318904 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92230ad6-60c8-42d5-8d2d-01f4f85ca399 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:09.319418 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92230ad6-60c8-42d5-8d2d-01f4f85ca399 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:09.319887 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92230ad6-60c8-42d5-8d2d-01f4f85ca399 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:09.320761 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92230ad6-60c8-42d5-8d2d-01f4f85ca399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:09.321273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92230ad6-60c8-42d5-8d2d-01f4f85ca399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:09.323014 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92230ad6-60c8-42d5-8d2d-01f4f85ca399 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:09.350089 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 375/754] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:09.357078 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92230ad6-60c8-42d5-8d2d-01f4f85ca399 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:09.425029 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:09.461517 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb57e58-5e85-44b8-ba96-709d9cd12eee None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:09.496719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92230ad6-60c8-42d5-8d2d-01f4f85ca399 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:09.505523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce0251-e055-4a62-94d5-ba86fa0ba939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:09.506133 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce0251-e055-4a62-94d5-ba86fa0ba939 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:09.506565 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce0251-e055-4a62-94d5-ba86fa0ba939 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:09.506844 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce0251-e055-4a62-94d5-ba86fa0ba939 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:09.507544 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce0251-e055-4a62-94d5-ba86fa0ba939 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:09.507854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce0251-e055-4a62-94d5-ba86fa0ba939 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:09.509256 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce0251-e055-4a62-94d5-ba86fa0ba939 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:09.523277 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 380/755] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:09.523813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:09.524541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e54c62-c978-40b6-b836-8eeb54814862 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:09.524930 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e54c62-c978-40b6-b836-8eeb54814862 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:09.525213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e54c62-c978-40b6-b836-8eeb54814862 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:09.526541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 381/756] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:09.531817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e54c62-c978-40b6-b836-8eeb54814862 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:09.539175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e408cec-1671-496d-b90e-c8e93bee4443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:09.540219 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e408cec-1671-496d-b90e-c8e93bee4443 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:09.540644 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e408cec-1671-496d-b90e-c8e93bee4443 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:09.541080 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e408cec-1671-496d-b90e-c8e93bee4443 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:09.550462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e408cec-1671-496d-b90e-c8e93bee4443 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:09.552890 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e408cec-1671-496d-b90e-c8e93bee4443 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:09.567611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-1e408cec-1671-496d-b90e-c8e93bee4443 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:09.567611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:09.567611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:09.567611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:09.567611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:09.567611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:09.567611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:09.567611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:09.567611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:09.567611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:09.567611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:09.567611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:09.567611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:45:09.567611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:45:09.567611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:45:09.568703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:45:09.568703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:09.568703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:09.568703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:09.568703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:09.568703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:09.568703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:09.568703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:09.568703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:09.568703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:09.568703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:09.568703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:09.568703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:09.568703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:09.568703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:09.568703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:09.568703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:09.569815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:45:09.569815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:45:09.569815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:45:09.569815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:45:09.569815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:45:09.569815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:45:09.569815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:09.569815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:09.572857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 376/757] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:09.574250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b71711-224e-4901-ae3a-370e98340bae None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:09.574660 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b71711-224e-4901-ae3a-370e98340bae None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:09.575081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b71711-224e-4901-ae3a-370e98340bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:09.596806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-89b71711-224e-4901-ae3a-370e98340bae None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:09.598513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-89b71711-224e-4901-ae3a-370e98340bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:09.648209 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e54c62-c978-40b6-b836-8eeb54814862 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:09.685121 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b2bf6-9df7-4897-8e3a-380229791195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:09.685783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b2bf6-9df7-4897-8e3a-380229791195 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:09.686221 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b2bf6-9df7-4897-8e3a-380229791195 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:09.686570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b2bf6-9df7-4897-8e3a-380229791195 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:09.689242 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 377/758] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:09.690636 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b71711-224e-4901-ae3a-370e98340bae None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:09.695560 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:09.705348 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b2bf6-9df7-4897-8e3a-380229791195 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:09.707289 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b2bf6-9df7-4897-8e3a-380229791195 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:09.729037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-754b2bf6-9df7-4897-8e3a-380229791195 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:45:09.729037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:09.729037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:09.729037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:09.729037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:09.729037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:09.729037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:09.729037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:09.729037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:09.729037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:09.729037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:09.729037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:09.729037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:45:09.729037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:45:09.729037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:45:09.729037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:45:09.730230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:09.730230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:09.730230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:45:09.730230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:09.730230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:45:09.730230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:09.730230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:09.730230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:09.730230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:09.730230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:09.730230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:09.730230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:09.730230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:09.730230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:09.730230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:09.730230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:09.730230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:09.730230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:09.731437 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:09.731437 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:09.731437 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:45:09.731437 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:45:09.731437 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:45:09.731437 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:45:09.731437 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:45:09.731437 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:45:09.731437 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:45:09.731437 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:09.733329 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 382/759] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:45:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:09.741394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b2bf6-9df7-4897-8e3a-380229791195 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:09.803844 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:09.809663 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b71711-224e-4901-ae3a-370e98340bae None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:09.851695 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9cca2-d998-4e00-b0d9-b95a109b1c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:09.852572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9cca2-d998-4e00-b0d9-b95a109b1c90 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:09.852993 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9cca2-d998-4e00-b0d9-b95a109b1c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:09.853405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9cca2-d998-4e00-b0d9-b95a109b1c90 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:09.854270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9cca2-d998-4e00-b0d9-b95a109b1c90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:09.854717 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9cca2-d998-4e00-b0d9-b95a109b1c90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:09.856612 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9cca2-d998-4e00-b0d9-b95a109b1c90 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:09.870213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 378/760] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:45:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:09.876501 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9cca2-d998-4e00-b0d9-b95a109b1c90 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:09.978260 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b2bf6-9df7-4897-8e3a-380229791195 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:09.989756 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9cca2-d998-4e00-b0d9-b95a109b1c90 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:10.031177 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15650-ccb9-41d7-8e3e-c5f86bd88c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:10.032870 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15650-ccb9-41d7-8e3e-c5f86bd88c9e None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:10.034661 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15650-ccb9-41d7-8e3e-c5f86bd88c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:10.035115 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15650-ccb9-41d7-8e3e-c5f86bd88c9e None admin] PATH_INFO: `/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/8d17f1d0577a41ed8859706073f79d77/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:10.037210 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad15650-ccb9-41d7-8e3e-c5f86bd88c9e None admin] RBAC: Authorizing `identity:create_grant(project_id=ba4dff9d637c4afcadfd3cd92b065a41, user_id=8d17f1d0577a41ed8859706073f79d77, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:10.038794 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad15650-ccb9-41d7-8e3e-c5f86bd88c9e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:10.048609 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91420f0f-74cd-4c9f-82ae-62fc2a6877f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:10.049222 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91420f0f-74cd-4c9f-82ae-62fc2a6877f7 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:10.049496 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91420f0f-74cd-4c9f-82ae-62fc2a6877f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:10.049762 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91420f0f-74cd-4c9f-82ae-62fc2a6877f7 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:10.050482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91420f0f-74cd-4c9f-82ae-62fc2a6877f7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:10.050782 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91420f0f-74cd-4c9f-82ae-62fc2a6877f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:10.052289 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91420f0f-74cd-4c9f-82ae-62fc2a6877f7 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:10.072226 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 379/761] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:45:09 2022] PUT /identity/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/8d17f1d0577a41ed8859706073f79d77/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:45:10.073793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15650-ccb9-41d7-8e3e-c5f86bd88c9e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:10.081288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 383/762] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Aug 30 11:45:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:10.086575 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91420f0f-74cd-4c9f-82ae-62fc2a6877f7 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:10.139820 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:10.218611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:10.235746 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15650-ccb9-41d7-8e3e-c5f86bd88c9e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:10.272782 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1586f-b169-4c8a-bd4c-dddb02ad027c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:10.273420 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1586f-b169-4c8a-bd4c-dddb02ad027c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:10.273775 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1586f-b169-4c8a-bd4c-dddb02ad027c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:10.274029 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1586f-b169-4c8a-bd4c-dddb02ad027c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:10.274701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1586f-b169-4c8a-bd4c-dddb02ad027c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:10.276102 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1586f-b169-4c8a-bd4c-dddb02ad027c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:10.286202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-02b1586f-b169-4c8a-bd4c-dddb02ad027c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 11:45:10.286202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:10.286202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:45:10.286202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:45:10.286202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:45:10.286202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:45:10.286202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:45:10.286202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:10.286202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 11:45:10.286202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:10.286202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:10.286202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:10.286202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:10.286202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:10.286202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:10.286202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:10.286202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:10.287247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:10.287247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:10.287247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:10.287247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:10.287247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:10.287247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:10.287247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:45:10.287247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:45:10.287247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:45:10.287247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:45:10.287247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:10.287247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:10.287247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:10.287247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:10.287247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:10.287247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:10.288466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:10.288466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:10.288466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:10.288466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:10.288466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:10.288466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:10.288466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:10.288466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:10.288466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:10.288466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:10.288466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:45:10.288466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:10.288466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 11:45:10.288466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:10.289664 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 380/763] 10.222.0.27 () {56 vars in 1129 bytes} [Tue Aug 30 11:45:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:10.293761 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1586f-b169-4c8a-bd4c-dddb02ad027c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:10.297392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91420f0f-74cd-4c9f-82ae-62fc2a6877f7 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:10.336739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101bd23-cf86-423e-b941-25b88c22ea0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:10.337693 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101bd23-cf86-423e-b941-25b88c22ea0d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:10.337978 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101bd23-cf86-423e-b941-25b88c22ea0d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:10.338254 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101bd23-cf86-423e-b941-25b88c22ea0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:10.384664 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:10.412322 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1586f-b169-4c8a-bd4c-dddb02ad027c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:10.424800 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101bd23-cf86-423e-b941-25b88c22ea0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:10.426395 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101bd23-cf86-423e-b941-25b88c22ea0d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:10.460364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787a1d8-4029-4010-8176-aed2b6e22e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:10.461596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787a1d8-4029-4010-8176-aed2b6e22e89 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:10.462952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787a1d8-4029-4010-8176-aed2b6e22e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:10.463487 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787a1d8-4029-4010-8176-aed2b6e22e89 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:10.464691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787a1d8-4029-4010-8176-aed2b6e22e89 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:10.465210 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787a1d8-4029-4010-8176-aed2b6e22e89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:10.466973 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787a1d8-4029-4010-8176-aed2b6e22e89 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:10.474601 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 381/764] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Aug 30 11:45:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:10.476371 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f534cd-2ff5-4408-8b88-79c1261abc7e None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:10.476862 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f534cd-2ff5-4408-8b88-79c1261abc7e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:10.477329 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f534cd-2ff5-4408-8b88-79c1261abc7e None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:10.478998 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 382/765] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:10.484407 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f534cd-2ff5-4408-8b88-79c1261abc7e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:10.494396 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:10.562474 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 384/766] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:45:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 11:45:10.564404 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55e9f0-ecbd-4968-a64b-eee7af2f319c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:10.565804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55e9f0-ecbd-4968-a64b-eee7af2f319c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:10.566517 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55e9f0-ecbd-4968-a64b-eee7af2f319c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:10.590291 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-3e55e9f0-ecbd-4968-a64b-eee7af2f319c None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:10.592528 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3e55e9f0-ecbd-4968-a64b-eee7af2f319c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:10.597713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f534cd-2ff5-4408-8b88-79c1261abc7e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:10.640554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90ecb3-4110-46e9-a909-26ac1429e71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:10.642350 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90ecb3-4110-46e9-a909-26ac1429e71f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:10.642862 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90ecb3-4110-46e9-a909-26ac1429e71f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:10.643335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90ecb3-4110-46e9-a909-26ac1429e71f None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:10.644189 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90ecb3-4110-46e9-a909-26ac1429e71f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:10.644685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90ecb3-4110-46e9-a909-26ac1429e71f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:10.646698 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90ecb3-4110-46e9-a909-26ac1429e71f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:10.653826 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 383/767] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Aug 30 11:45:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:10.654895 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90ecb3-4110-46e9-a909-26ac1429e71f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:10.668749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:10.689627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 385/768] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:10.695685 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55e9f0-ecbd-4968-a64b-eee7af2f319c None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:10.824819 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90ecb3-4110-46e9-a909-26ac1429e71f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:10.851741 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:10.873570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55e9f0-ecbd-4968-a64b-eee7af2f319c None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:10.892140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c221ac-88ac-45b6-93d4-426a4a191913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:10.892779 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c221ac-88ac-45b6-93d4-426a4a191913 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:10.893053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c221ac-88ac-45b6-93d4-426a4a191913 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:10.893318 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c221ac-88ac-45b6-93d4-426a4a191913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:10.914479 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c221ac-88ac-45b6-93d4-426a4a191913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:10.917152 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c221ac-88ac-45b6-93d4-426a4a191913 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:10.942650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-60c221ac-88ac-45b6-93d4-426a4a191913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:10.942650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:10.942650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:10.942650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:10.942650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:10.942650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:10.942650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:10.942650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:10.942650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:10.942650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:10.942650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:10.942650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:10.942650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:10.942650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:10.942650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:10.942650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:10.943671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:10.943671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:10.943671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:10.943671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:10.943671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:10.943671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:10.943671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:10.943671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:10.943671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:10.943671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:10.943671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:10.943671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:10.943671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:10.943671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:10.943671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:10.943671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:10.943671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:10.944583 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:10.944583 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:10.944583 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:10.944774 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6247c-d69b-4c89-b59e-07e97c1bcbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:10.944774 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6247c-d69b-4c89-b59e-07e97c1bcbb2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:10.944921 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6247c-d69b-4c89-b59e-07e97c1bcbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:10.945455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6247c-d69b-4c89-b59e-07e97c1bcbb2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:10.951380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6247c-d69b-4c89-b59e-07e97c1bcbb2 None admin] RBAC: Adding query filter params (interface=public, service_id=5b02460675f24a81bbfc2e87d8fddec0, region_id=RegionOne) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:10.951380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6247c-d69b-4c89-b59e-07e97c1bcbb2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:10.951380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6247c-d69b-4c89-b59e-07e97c1bcbb2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:10.951613 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 384/769] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:10.955611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c221ac-88ac-45b6-93d4-426a4a191913 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:10.971457 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 386/770] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Aug 30 11:45:10 2022] GET /identity/v3/endpoints?service_id=5b02460675f24a81bbfc2e87d8fddec0&interface=public®ion_id=RegionOne => generated 194 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:10.973915 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6247c-d69b-4c89-b59e-07e97c1bcbb2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:11.054068 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:11.098516 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c221ac-88ac-45b6-93d4-426a4a191913 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:11.119316 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6247c-d69b-4c89-b59e-07e97c1bcbb2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:11.142427 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef827d9-c9c6-4826-83d4-2d12ff71fb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:11.143061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef827d9-c9c6-4826-83d4-2d12ff71fb76 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:11.143341 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef827d9-c9c6-4826-83d4-2d12ff71fb76 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:11.143640 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef827d9-c9c6-4826-83d4-2d12ff71fb76 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:11.144850 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef827d9-c9c6-4826-83d4-2d12ff71fb76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:11.145160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef827d9-c9c6-4826-83d4-2d12ff71fb76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:11.146815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef827d9-c9c6-4826-83d4-2d12ff71fb76 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:11.160774 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba1e9f-259b-4b35-b014-85f65fad6166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:11.161753 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba1e9f-259b-4b35-b014-85f65fad6166 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:11.162186 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba1e9f-259b-4b35-b014-85f65fad6166 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:11.162621 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba1e9f-259b-4b35-b014-85f65fad6166 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:11.163399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba1e9f-259b-4b35-b014-85f65fad6166 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:11.163722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 385/771] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:11.164715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef827d9-c9c6-4826-83d4-2d12ff71fb76 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:11.165320 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba1e9f-259b-4b35-b014-85f65fad6166 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:11.172596 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 387/772] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Aug 30 11:45:10 2022] GET /identity/v3/services => generated 772 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:11.173586 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba1e9f-259b-4b35-b014-85f65fad6166 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:11.194762 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:11.362405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef827d9-c9c6-4826-83d4-2d12ff71fb76 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:11.374724 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba1e9f-259b-4b35-b014-85f65fad6166 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:11.390587 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:11.407793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685e1ff-0372-4572-ab82-2e3156da6b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:11.408449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685e1ff-0372-4572-ab82-2e3156da6b20 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:11.408725 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685e1ff-0372-4572-ab82-2e3156da6b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:11.408997 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685e1ff-0372-4572-ab82-2e3156da6b20 None admin] PATH_INFO: `/v3/services/network` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:11.409754 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685e1ff-0372-4572-ab82-2e3156da6b20 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:11.411527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685e1ff-0372-4572-ab82-2e3156da6b20 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:11.416770 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daffb53-c9bf-4ee3-849a-2aa702ab66c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:11.417440 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daffb53-c9bf-4ee3-849a-2aa702ab66c6 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:11.417712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daffb53-c9bf-4ee3-849a-2aa702ab66c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:11.417978 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daffb53-c9bf-4ee3-849a-2aa702ab66c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:11.425729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-8685e1ff-0372-4572-ab82-2e3156da6b20 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 11:45:11.425729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:11.425729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:45:11.425729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:45:11.425729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:45:11.425729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:45:11.425729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:45:11.425729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:11.425729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 11:45:11.425729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:11.425729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:11.425729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:11.425729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:11.425729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:11.425729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:11.425729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:11.425729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:11.426713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:11.426713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:11.426713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:11.426713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:11.426713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:11.426713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:11.426713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:45:11.426713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:45:11.426713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:45:11.426713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:45:11.426713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:11.426713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:11.426713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:11.426713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:11.426713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:11.426713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:11.427671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:11.427671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:11.427671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:11.427671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:11.427671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:11.427671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:11.427671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:11.427671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:11.427671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:11.427671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:11.427671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:45:11.427671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:11.427671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 11:45:11.427671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:11.428406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daffb53-c9bf-4ee3-849a-2aa702ab66c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:11.428406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daffb53-c9bf-4ee3-849a-2aa702ab66c6 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:11.432752 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 386/773] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:11 2022] GET /identity/v3/services/network => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:11.433812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266c4dd-5501-4cb8-a635-e75588625b65 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:11.434098 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266c4dd-5501-4cb8-a635-e75588625b65 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:11.434373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266c4dd-5501-4cb8-a635-e75588625b65 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:11.439811 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 387/774] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:11.439938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-4daffb53-c9bf-4ee3-849a-2aa702ab66c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:11.439938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:11.439938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:11.439938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:11.439938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:11.439938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:11.439938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:11.439938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:11.439938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:11.439938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:11.439938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:11.439938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:11.439938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:45:11.439938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:45:11.439938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:45:11.440765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:45:11.440765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:11.440765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:11.440765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:11.440765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:11.440765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:11.440765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:11.440765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:11.440765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:11.440765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:11.440765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:11.440765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:11.440765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:11.440765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:11.440765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:11.440765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:11.440765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:11.441642 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:45:11.441642 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:45:11.441642 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:45:11.441642 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:45:11.441642 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:45:11.441642 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:45:11.441642 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:11.441642 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:11.441642 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 388/775] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:11.442124 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daffb53-c9bf-4ee3-849a-2aa702ab66c6 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:11.442190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1eaab5-a578-4620-b190-81df9b797831 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:11.442726 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1eaab5-a578-4620-b190-81df9b797831 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:11.442726 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1eaab5-a578-4620-b190-81df9b797831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:11.468655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bf1eaab5-a578-4620-b190-81df9b797831 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:11.470854 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bf1eaab5-a578-4620-b190-81df9b797831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:11.523014 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:11.558543 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 388/776] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:11.563596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1eaab5-a578-4620-b190-81df9b797831 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:11.565915 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daffb53-c9bf-4ee3-849a-2aa702ab66c6 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:11.625893 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52338506-0b67-4809-9ab2-eefaf99bd476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:11.626428 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52338506-0b67-4809-9ab2-eefaf99bd476 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:11.626707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52338506-0b67-4809-9ab2-eefaf99bd476 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:11.627233 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52338506-0b67-4809-9ab2-eefaf99bd476 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:11.628504 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52338506-0b67-4809-9ab2-eefaf99bd476 None admin] RBAC: Adding query filter params (name=network) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:11.628819 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52338506-0b67-4809-9ab2-eefaf99bd476 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:11.632628 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52338506-0b67-4809-9ab2-eefaf99bd476 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:11.643895 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 389/777] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Aug 30 11:45:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:11.649525 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52338506-0b67-4809-9ab2-eefaf99bd476 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:11.804883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52338506-0b67-4809-9ab2-eefaf99bd476 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:11.805514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1eaab5-a578-4620-b190-81df9b797831 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:11.837639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:11.851866 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dc74b-7505-4e6e-a0da-623b94430cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:11.852834 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dc74b-7505-4e6e-a0da-623b94430cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:11.853345 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dc74b-7505-4e6e-a0da-623b94430cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:11.853815 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dc74b-7505-4e6e-a0da-623b94430cd9 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:11.854691 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6dc74b-7505-4e6e-a0da-623b94430cd9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:11.855192 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6dc74b-7505-4e6e-a0da-623b94430cd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:11.857089 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6dc74b-7505-4e6e-a0da-623b94430cd9 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:11.861720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:11.864733 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 390/778] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Aug 30 11:45:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:11.871126 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dc74b-7505-4e6e-a0da-623b94430cd9 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:11.906484 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c27536-8684-4aac-b10f-673a9c34a516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:11.907033 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c27536-8684-4aac-b10f-673a9c34a516 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:11.907310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c27536-8684-4aac-b10f-673a9c34a516 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:11.907603 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c27536-8684-4aac-b10f-673a9c34a516 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:11.908311 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c27536-8684-4aac-b10f-673a9c34a516 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:11.908626 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c27536-8684-4aac-b10f-673a9c34a516 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:11.910052 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c27536-8684-4aac-b10f-673a9c34a516 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:11.926692 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 389/779] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:45:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:11.932650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c27536-8684-4aac-b10f-673a9c34a516 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:11.983072 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dc74b-7505-4e6e-a0da-623b94430cd9 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:12.021078 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f79c65-262a-48c0-937e-71123f3461a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:12.022081 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f79c65-262a-48c0-937e-71123f3461a2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:12.022671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f79c65-262a-48c0-937e-71123f3461a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:12.023158 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f79c65-262a-48c0-937e-71123f3461a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:12.024155 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f79c65-262a-48c0-937e-71123f3461a2 None admin] RBAC: Adding query filter params (interface=public, service_id=e080e981413a45cbaf4eeba1eec0030b, region_id=RegionOne) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:12.024664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f79c65-262a-48c0-937e-71123f3461a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:12.026573 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f79c65-262a-48c0-937e-71123f3461a2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:12.038030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 391/780] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Aug 30 11:45:11 2022] GET /identity/v3/endpoints?service_id=e080e981413a45cbaf4eeba1eec0030b&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:12.039129 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c27536-8684-4aac-b10f-673a9c34a516 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:12.040037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f79c65-262a-48c0-937e-71123f3461a2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:12.075051 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef160514-f777-4e34-b8d4-dc330e6550f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:12.075918 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef160514-f777-4e34-b8d4-dc330e6550f8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:12.076348 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef160514-f777-4e34-b8d4-dc330e6550f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:12.076720 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef160514-f777-4e34-b8d4-dc330e6550f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:12.087983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef160514-f777-4e34-b8d4-dc330e6550f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:45:12.095396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ef160514-f777-4e34-b8d4-dc330e6550f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:45:12.095396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:12.095396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:12.095396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:12.095396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:12.095396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:12.095396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:12.095396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:12.095396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:12.095396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:12.095396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:12.095396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:12.095396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:45:12.095396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:45:12.095396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:45:12.095396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:45:12.096353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:45:12.096353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:45:12.096353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:45:12.096353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:45:12.096353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:12.096353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:12.096353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:12.096353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:12.096353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:12.096353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:12.096353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:12.096353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:12.096353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:12.096353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:12.096353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:12.096353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:12.097188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:12.097188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:12.097188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:12.097188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:12.097188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:45:12.097188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:45:12.097188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:45:12.097188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:45:12.097188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:45:12.097188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:45:12.097188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:45:12.097188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:12.097188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 390/781] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:45:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:12.099251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef160514-f777-4e34-b8d4-dc330e6550f8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:12.133993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:12.147754 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:12.177104 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f79c65-262a-48c0-937e-71123f3461a2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:12.208018 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef160514-f777-4e34-b8d4-dc330e6550f8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:12.215849 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e032f-bc8a-4c20-8891-c4daae7cd6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:12.216472 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e032f-bc8a-4c20-8891-c4daae7cd6ef None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:12.216748 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e032f-bc8a-4c20-8891-c4daae7cd6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:12.217013 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e032f-bc8a-4c20-8891-c4daae7cd6ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:12.218151 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e032f-bc8a-4c20-8891-c4daae7cd6ef None admin] RBAC: Adding query filter params (role.id=4f4d8a6881ca496bb2d4845a6592fea8, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=8d27bfb8c0b64763b7db7cffa5f230f6) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:12.218453 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e032f-bc8a-4c20-8891-c4daae7cd6ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:12.220254 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e032f-bc8a-4c20-8891-c4daae7cd6ef None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:12.226122 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 392/782] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:45:12 2022] GET /identity/v3/role_assignments?user.id=8d27bfb8c0b64763b7db7cffa5f230f6&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=4f4d8a6881ca496bb2d4845a6592fea8 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:12.226781 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e032f-bc8a-4c20-8891-c4daae7cd6ef None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:12.247997 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58858491-bd38-4c46-be7e-b94e03cc2bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:12.249042 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58858491-bd38-4c46-be7e-b94e03cc2bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:12.249670 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58858491-bd38-4c46-be7e-b94e03cc2bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:12.250248 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58858491-bd38-4c46-be7e-b94e03cc2bf4 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:12.251095 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58858491-bd38-4c46-be7e-b94e03cc2bf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:12.252994 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58858491-bd38-4c46-be7e-b94e03cc2bf4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:12.260191 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 391/783] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Aug 30 11:45:12 2022] GET /identity/v3/services => generated 772 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:12.262065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ee453-a39f-44b3-af78-d43911c90665 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:12.262579 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ee453-a39f-44b3-af78-d43911c90665 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:12.263178 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ee453-a39f-44b3-af78-d43911c90665 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:12.269688 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 392/784] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:12.272082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b91e2-d369-44f9-a3d5-0a1e37922131 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:12.272611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b91e2-d369-44f9-a3d5-0a1e37922131 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:12.273079 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b91e2-d369-44f9-a3d5-0a1e37922131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:12.308053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-820b91e2-d369-44f9-a3d5-0a1e37922131 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:12.314918 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-820b91e2-d369-44f9-a3d5-0a1e37922131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:12.410615 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 393/785] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:45:12.463412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e032f-bc8a-4c20-8891-c4daae7cd6ef None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:12.497251 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:12.508383 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a63b4-d3c0-4f80-b7a1-3738c7549db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:12.509008 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a63b4-d3c0-4f80-b7a1-3738c7549db4 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:12.509289 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a63b4-d3c0-4f80-b7a1-3738c7549db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:12.509561 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a63b4-d3c0-4f80-b7a1-3738c7549db4 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:12.510229 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a63b4-d3c0-4f80-b7a1-3738c7549db4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:12.510531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a63b4-d3c0-4f80-b7a1-3738c7549db4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:12.511966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a63b4-d3c0-4f80-b7a1-3738c7549db4 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:12.522307 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 393/786] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Aug 30 11:45:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:12.527692 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b91e2-d369-44f9-a3d5-0a1e37922131 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:12.561207 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:12.655119 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b91e2-d369-44f9-a3d5-0a1e37922131 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:12.692718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dc56b-13d8-4a13-833d-fba601da713b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:12.693362 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dc56b-13d8-4a13-833d-fba601da713b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:12.693641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dc56b-13d8-4a13-833d-fba601da713b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:12.693915 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dc56b-13d8-4a13-833d-fba601da713b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:12.704684 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dc56b-13d8-4a13-833d-fba601da713b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:12.706204 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dc56b-13d8-4a13-833d-fba601da713b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:12.725805 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-5a6dc56b-13d8-4a13-833d-fba601da713b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:12.725805 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:12.725805 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:12.725805 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:12.725805 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:12.725805 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:12.725805 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:12.725805 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:12.725805 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:12.725805 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:12.725805 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:12.725805 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:12.725805 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:12.725805 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:12.725805 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:12.725805 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:12.726774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:12.726774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:12.726774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:12.726774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:12.726774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:12.726774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:12.726774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:12.726774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:12.726774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:12.726774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:12.726774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:12.726774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:12.726774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:12.726774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:12.726774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:12.726774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:12.726774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:12.727705 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:12.727705 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:12.727705 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:12.727705 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 394/787] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:12.732815 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a63b4-d3c0-4f80-b7a1-3738c7549db4 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:12.775990 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dc56b-13d8-4a13-833d-fba601da713b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:12.846049 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a63b4-d3c0-4f80-b7a1-3738c7549db4 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:12.880753 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633be921-793c-47a7-b525-e3f1e8f3d6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:12.881375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633be921-793c-47a7-b525-e3f1e8f3d6f6 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:12.881652 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633be921-793c-47a7-b525-e3f1e8f3d6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:12.881926 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633be921-793c-47a7-b525-e3f1e8f3d6f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:12.882568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633be921-793c-47a7-b525-e3f1e8f3d6f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:12.882869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633be921-793c-47a7-b525-e3f1e8f3d6f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:12.884301 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633be921-793c-47a7-b525-e3f1e8f3d6f6 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:12.896861 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 394/788] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:12.902882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633be921-793c-47a7-b525-e3f1e8f3d6f6 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:12.939732 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:12.971396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dc56b-13d8-4a13-833d-fba601da713b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:12.971860 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:13.032465 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633be921-793c-47a7-b525-e3f1e8f3d6f6 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:13.041019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f732d-5dbe-4b2b-8b3f-d67e1874094f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:13.041669 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f732d-5dbe-4b2b-8b3f-d67e1874094f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:13.041947 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f732d-5dbe-4b2b-8b3f-d67e1874094f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:13.042220 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f732d-5dbe-4b2b-8b3f-d67e1874094f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:13.058694 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f732d-5dbe-4b2b-8b3f-d67e1874094f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:45:13.065383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-951f732d-5dbe-4b2b-8b3f-d67e1874094f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:45:13.065383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:13.065383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:13.065383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:13.065383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:13.065383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:13.065383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:13.065383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:13.065383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:13.065383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:13.065383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:13.065383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:13.065383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:45:13.065383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:45:13.065383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:45:13.065383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:45:13.066403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:45:13.066403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:45:13.066403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:45:13.066403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:45:13.066403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:13.066403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:13.066403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:13.066403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:13.066403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:13.066403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:13.066403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:13.066403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:13.066403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:13.066403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:13.066403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:13.066403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:13.067291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:13.067291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:13.067291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:13.067291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:13.067291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:45:13.067291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:45:13.067291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:45:13.067291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:45:13.067291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:45:13.067291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:45:13.067291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:45:13.067291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:13.073972 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 395/789] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:45:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:13.078508 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f732d-5dbe-4b2b-8b3f-d67e1874094f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:13.113482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8f7d6-3c28-495b-bec9-10176f1b353b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:13.114146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8f7d6-3c28-495b-bec9-10176f1b353b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:13.114428 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8f7d6-3c28-495b-bec9-10176f1b353b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:13.114703 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8f7d6-3c28-495b-bec9-10176f1b353b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:13.131027 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8f7d6-3c28-495b-bec9-10176f1b353b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:13.132572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8f7d6-3c28-495b-bec9-10176f1b353b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:13.158795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-75e8f7d6-3c28-495b-bec9-10176f1b353b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:45:13.158795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:13.158795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:13.158795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:13.158795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:13.158795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:13.158795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:13.158795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:13.158795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:13.158795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:13.158795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:13.158795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:13.158795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:45:13.158795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:45:13.158795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:45:13.158795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:45:13.159826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:13.159826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:13.159826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:45:13.159826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:13.159826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:45:13.159826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:13.159826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:13.159826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:13.159826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:13.159826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:13.159826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:13.159826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:13.159826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:13.159826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:13.159826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:13.159826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:13.159826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:13.159826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:13.160797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:13.160797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:13.160797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:45:13.160797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:45:13.160797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:45:13.160797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:45:13.160797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:45:13.160797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:45:13.160797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:45:13.160797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:13.160797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 395/790] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Aug 30 11:45:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:13.167428 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8f7d6-3c28-495b-bec9-10176f1b353b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:13.285433 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f732d-5dbe-4b2b-8b3f-d67e1874094f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:13.331523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8f7d6-3c28-495b-bec9-10176f1b353b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:13.344171 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:13.351774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17c992-e882-4c58-8b07-06f781338c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:13.352410 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17c992-e882-4c58-8b07-06f781338c42 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:13.352691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17c992-e882-4c58-8b07-06f781338c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:13.352961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17c992-e882-4c58-8b07-06f781338c42 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:13.353721 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17c992-e882-4c58-8b07-06f781338c42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:13.354025 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17c992-e882-4c58-8b07-06f781338c42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:13.355447 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17c992-e882-4c58-8b07-06f781338c42 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:13.366716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 396/791] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:45:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:13.372404 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17c992-e882-4c58-8b07-06f781338c42 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:13.376495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:13.401908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8a952-c76f-4232-800c-23b4426f97bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:13.402543 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8a952-c76f-4232-800c-23b4426f97bc None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:13.402816 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8a952-c76f-4232-800c-23b4426f97bc None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:13.403079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8a952-c76f-4232-800c-23b4426f97bc None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:13.403846 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8a952-c76f-4232-800c-23b4426f97bc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:13.404148 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8a952-c76f-4232-800c-23b4426f97bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:13.405913 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8a952-c76f-4232-800c-23b4426f97bc None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:13.430355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 396/792] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Aug 30 11:45:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:13.431808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8a952-c76f-4232-800c-23b4426f97bc None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:13.533384 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8a952-c76f-4232-800c-23b4426f97bc None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:13.559173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17c992-e882-4c58-8b07-06f781338c42 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:13.568550 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab111913-a293-4d63-bb30-deff8fe5bb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:13.569211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab111913-a293-4d63-bb30-deff8fe5bb2f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:13.569482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab111913-a293-4d63-bb30-deff8fe5bb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:13.569749 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab111913-a293-4d63-bb30-deff8fe5bb2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:13.581307 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab111913-a293-4d63-bb30-deff8fe5bb2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:13.582801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab111913-a293-4d63-bb30-deff8fe5bb2f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:13.601155 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabc175-7912-41ed-a459-c7ba66f41276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:13.602274 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabc175-7912-41ed-a459-c7ba66f41276 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:13.602837 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabc175-7912-41ed-a459-c7ba66f41276 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:13.603314 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabc175-7912-41ed-a459-c7ba66f41276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:13.616065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabc175-7912-41ed-a459-c7ba66f41276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:13.617978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabc175-7912-41ed-a459-c7ba66f41276 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:13.635709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-0cabc175-7912-41ed-a459-c7ba66f41276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:13.635709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:13.635709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:13.635709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:13.635709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:13.635709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:13.635709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:13.635709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:13.635709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:13.635709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:13.635709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:13.635709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:13.635709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:13.635709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:13.635709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:13.635709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:13.636774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:13.636774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:13.636774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:13.636774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:13.636774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:13.636774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:13.636774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:13.636774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:13.636774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:13.636774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:13.636774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:13.636774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:13.636774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:13.636774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:13.636774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:13.636774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:13.636774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:13.637675 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:13.637675 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:13.637675 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:13.640119 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 397/793] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:13.646852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f569545-266e-4226-87e9-3630ab23c662 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:13.647513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f569545-266e-4226-87e9-3630ab23c662 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:13.648031 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f569545-266e-4226-87e9-3630ab23c662 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:13.649989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 398/794] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:13.651099 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f569545-266e-4226-87e9-3630ab23c662 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:13.718182 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:13.722603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-ab111913-a293-4d63-bb30-deff8fe5bb2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:13.722603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:13.722603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:13.722603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:13.722603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:13.722603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:13.722603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:13.722603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:13.722603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:13.722603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:13.722603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:13.722603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:13.722603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:13.722603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:13.722603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:13.722603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:13.723615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:13.723615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:13.723615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:13.723615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:13.723615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:13.723615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:13.723615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:13.723615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:13.723615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:13.723615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:13.723615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:13.723615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:13.723615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:13.723615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:13.723615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:13.723615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:13.723615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:13.724527 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:13.724527 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:13.724527 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:13.728560 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 397/795] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:13.730046 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c751a7d-bec7-4094-b5bb-df38ab8951f7 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:13.730323 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c751a7d-bec7-4094-b5bb-df38ab8951f7 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:13.730655 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c751a7d-bec7-4094-b5bb-df38ab8951f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:13.753005 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-5c751a7d-bec7-4094-b5bb-df38ab8951f7 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:13.754819 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5c751a7d-bec7-4094-b5bb-df38ab8951f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:13.775136 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:13.777920 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f569545-266e-4226-87e9-3630ab23c662 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:13.821231 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88c8c4-0e99-4831-93ac-6baa0c3d5c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:13.821816 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88c8c4-0e99-4831-93ac-6baa0c3d5c66 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:13.822099 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88c8c4-0e99-4831-93ac-6baa0c3d5c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:13.822369 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88c8c4-0e99-4831-93ac-6baa0c3d5c66 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:13.823055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88c8c4-0e99-4831-93ac-6baa0c3d5c66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:13.823398 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88c8c4-0e99-4831-93ac-6baa0c3d5c66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:13.825355 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88c8c4-0e99-4831-93ac-6baa0c3d5c66 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:13.845855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 399/796] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:13.845855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88c8c4-0e99-4831-93ac-6baa0c3d5c66 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:13.850516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 398/797] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:13.851254 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c751a7d-bec7-4094-b5bb-df38ab8951f7 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:13.951613 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c751a7d-bec7-4094-b5bb-df38ab8951f7 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:13.957867 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88c8c4-0e99-4831-93ac-6baa0c3d5c66 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:13.977702 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:13.987992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7baac2-a0f2-4e82-a1b3-79bddc2a7fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:13.988610 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7baac2-a0f2-4e82-a1b3-79bddc2a7fea None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:13.988944 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7baac2-a0f2-4e82-a1b3-79bddc2a7fea None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:13.989211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7baac2-a0f2-4e82-a1b3-79bddc2a7fea None admin] PATH_INFO: `/v3/users/nova` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:13.996718 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7baac2-a0f2-4e82-a1b3-79bddc2a7fea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:13.998164 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7baac2-a0f2-4e82-a1b3-79bddc2a7fea None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:14.001396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835b13c-7918-41c9-9b8c-274c1cc84aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:14.002282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835b13c-7918-41c9-9b8c-274c1cc84aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:14.002761 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835b13c-7918-41c9-9b8c-274c1cc84aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:14.003248 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835b13c-7918-41c9-9b8c-274c1cc84aa7 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:14.004141 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835b13c-7918-41c9-9b8c-274c1cc84aa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:14.004644 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835b13c-7918-41c9-9b8c-274c1cc84aa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:14.006304 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835b13c-7918-41c9-9b8c-274c1cc84aa7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:14.010135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-0e7baac2-a0f2-4e82-a1b3-79bddc2a7fea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:45:14.010135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:14.010135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:14.010135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:14.010135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:14.010135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:14.010135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:14.010135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:14.010135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:14.010135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:14.010135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:14.010135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:14.010135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:45:14.010135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:45:14.010135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:45:14.010135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:45:14.011080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:14.011080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:14.011080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:45:14.011080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:14.011080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:45:14.011080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:14.011080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:14.011080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:14.011080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:14.011080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:14.011080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:14.011080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:14.011080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:14.011080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:14.011080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:14.011080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:14.011080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:14.011080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:14.012087 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:14.012087 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:14.012087 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:45:14.012087 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:45:14.012087 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:45:14.012087 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:45:14.012087 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:45:14.012087 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:45:14.012087 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:45:14.012087 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:14.015495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 399/798] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Aug 30 11:45:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:14.017686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7baac2-a0f2-4e82-a1b3-79bddc2a7fea None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:14.023331 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 400/799] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:14.032438 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835b13c-7918-41c9-9b8c-274c1cc84aa7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:14.036855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:14.138791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7baac2-a0f2-4e82-a1b3-79bddc2a7fea None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:14.152347 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835b13c-7918-41c9-9b8c-274c1cc84aa7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:14.176736 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e744cd8-1101-426e-ba25-fa540f073a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:14.177601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e744cd8-1101-426e-ba25-fa540f073a31 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:14.178018 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e744cd8-1101-426e-ba25-fa540f073a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:14.178450 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e744cd8-1101-426e-ba25-fa540f073a31 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:14.179351 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e744cd8-1101-426e-ba25-fa540f073a31 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:14.179902 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e744cd8-1101-426e-ba25-fa540f073a31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:14.181593 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e744cd8-1101-426e-ba25-fa540f073a31 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:14.189843 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831b5ce-946f-49cd-a782-4476e5719592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:14.190439 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831b5ce-946f-49cd-a782-4476e5719592 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:14.190720 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831b5ce-946f-49cd-a782-4476e5719592 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:14.190994 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831b5ce-946f-49cd-a782-4476e5719592 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:14.198639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831b5ce-946f-49cd-a782-4476e5719592 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:14.200246 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831b5ce-946f-49cd-a782-4476e5719592 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:14.207374 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 400/800] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Aug 30 11:45:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:14.208898 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e744cd8-1101-426e-ba25-fa540f073a31 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:14.212650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-7831b5ce-946f-49cd-a782-4476e5719592 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:14.212650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:14.212650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:14.212650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:14.212650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:14.212650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:14.212650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:14.212650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:14.212650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:14.212650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:14.212650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:14.212650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:14.212650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:45:14.212650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:45:14.212650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:45:14.213513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:45:14.213513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:14.213513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:14.213513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:14.213513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:14.213513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:14.213513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:14.213513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:14.213513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:14.213513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:14.213513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:14.213513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:14.213513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:14.213513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:14.213513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:14.213513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:14.213513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:14.215148 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:45:14.215148 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:45:14.215148 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:45:14.215148 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:45:14.215148 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:45:14.215148 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:45:14.215148 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:14.215148 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:14.215148 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 401/801] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:14.219976 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831b5ce-946f-49cd-a782-4476e5719592 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:14.260588 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:14.285046 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:14.321368 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e744cd8-1101-426e-ba25-fa540f073a31 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:14.336078 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831b5ce-946f-49cd-a782-4476e5719592 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:14.358143 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3ac3f-767a-4cf7-97c6-6f2705070086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:14.359169 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3ac3f-767a-4cf7-97c6-6f2705070086 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:14.359670 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3ac3f-767a-4cf7-97c6-6f2705070086 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:14.360132 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3ac3f-767a-4cf7-97c6-6f2705070086 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:14.374602 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176be030-d9c5-4174-abcc-fe83f3ce4196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:14.375172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176be030-d9c5-4174-abcc-fe83f3ce4196 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:14.375480 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176be030-d9c5-4174-abcc-fe83f3ce4196 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:14.375758 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176be030-d9c5-4174-abcc-fe83f3ce4196 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:14.376458 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176be030-d9c5-4174-abcc-fe83f3ce4196 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:14.376825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176be030-d9c5-4174-abcc-fe83f3ce4196 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:14.378262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176be030-d9c5-4174-abcc-fe83f3ce4196 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:14.391971 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 402/802] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:45:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:14.397877 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176be030-d9c5-4174-abcc-fe83f3ce4196 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:14.439457 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3ac3f-767a-4cf7-97c6-6f2705070086 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:14.441154 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3ac3f-767a-4cf7-97c6-6f2705070086 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:14.504944 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:14.512924 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176be030-d9c5-4174-abcc-fe83f3ce4196 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:14.521973 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:14.552244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3de9c-4480-45d7-b83c-9b4688327387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:14.552921 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3de9c-4480-45d7-b83c-9b4688327387 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:14.553200 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3de9c-4480-45d7-b83c-9b4688327387 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:14.553574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3de9c-4480-45d7-b83c-9b4688327387 None admin] PATH_INFO: `/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/58c86110ce97463e9b3d53691ae3e12c/roles/eec5decc24ab4673a246120350336b1e` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:14.560292 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 401/803] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:45:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:45:14.561549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89537012-e759-4106-8ce1-709dbf7f7e83 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:14.562592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89537012-e759-4106-8ce1-709dbf7f7e83 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:14.562883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89537012-e759-4106-8ce1-709dbf7f7e83 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:14.564201 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 402/804] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:14.564931 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89537012-e759-4106-8ce1-709dbf7f7e83 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:14.576059 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3de9c-4480-45d7-b83c-9b4688327387 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba4dff9d637c4afcadfd3cd92b065a41, user_id=58c86110ce97463e9b3d53691ae3e12c, role_id=eec5decc24ab4673a246120350336b1e)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:14.578304 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3de9c-4480-45d7-b83c-9b4688327387 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:14.594071 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 403/805] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:45:14 2022] PUT /identity/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/58c86110ce97463e9b3d53691ae3e12c/roles/eec5decc24ab4673a246120350336b1e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:45:14.595187 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3de9c-4480-45d7-b83c-9b4688327387 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:14.695496 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89537012-e759-4106-8ce1-709dbf7f7e83 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:14.733289 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfc724-f8d7-4194-84ad-cbaafcd8f3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:14.735051 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfc724-f8d7-4194-84ad-cbaafcd8f3fb None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:14.735441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfc724-f8d7-4194-84ad-cbaafcd8f3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:14.735788 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfc724-f8d7-4194-84ad-cbaafcd8f3fb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:14.736568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfc724-f8d7-4194-84ad-cbaafcd8f3fb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:14.738139 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfc724-f8d7-4194-84ad-cbaafcd8f3fb None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:14.747119 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3de9c-4480-45d7-b83c-9b4688327387 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:14.748577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-c7cfc724-f8d7-4194-84ad-cbaafcd8f3fb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 11:45:14.748577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:14.748577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:45:14.748577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:45:14.748577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:45:14.748577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:45:14.748577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:45:14.748577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:14.748577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 11:45:14.748577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:14.748577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:14.748577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:14.748577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:14.748577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:14.748577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:14.748577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:14.748577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:14.749587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:14.749587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:14.749587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:14.749587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:14.749587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:14.749587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:14.749587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:45:14.749587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:45:14.749587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:45:14.749587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:45:14.749587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:14.749587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:14.749587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:14.749587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:14.749587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:14.749587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:14.750443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:14.750443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:14.750443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:14.750443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:14.750443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:14.750443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:14.750443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:14.750443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:14.750443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:14.750443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:14.750443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:45:14.750443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:14.750443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 11:45:14.750443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:14.755937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 403/806] 10.222.0.27 () {56 vars in 1129 bytes} [Tue Aug 30 11:45:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:14.757486 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4454c73-4048-4e83-8ef1-fcfa5a1da8b0 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:14.757846 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4454c73-4048-4e83-8ef1-fcfa5a1da8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:14.758190 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4454c73-4048-4e83-8ef1-fcfa5a1da8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:14.778698 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a4454c73-4048-4e83-8ef1-fcfa5a1da8b0 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:14.780961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a4454c73-4048-4e83-8ef1-fcfa5a1da8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:14.801511 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8ecf9-4cc9-413e-a0db-00242fcb4c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:14.802166 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8ecf9-4cc9-413e-a0db-00242fcb4c81 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:14.802453 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8ecf9-4cc9-413e-a0db-00242fcb4c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:14.802724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8ecf9-4cc9-413e-a0db-00242fcb4c81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:14.814379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8ecf9-4cc9-413e-a0db-00242fcb4c81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:14.815253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:14.816048 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8ecf9-4cc9-413e-a0db-00242fcb4c81 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:14.823632 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:14.833630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-2cc8ecf9-4cc9-413e-a0db-00242fcb4c81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:14.833630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:14.833630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:14.833630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:14.833630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:14.833630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:14.833630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:14.833630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:14.833630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:14.833630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:14.833630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:14.833630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:14.833630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:14.833630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:14.833630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:14.833630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:14.834762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:14.834762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:14.834762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:14.834762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:14.834762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:14.834762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:14.834762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:14.834762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:14.834762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:14.834762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:14.834762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:14.834762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:14.834762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:14.834762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:14.834762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:14.834762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:14.834762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:14.835977 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:14.835977 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:14.835977 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:14.837585 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 404/807] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:14.837585 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8ecf9-4cc9-413e-a0db-00242fcb4c81 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:14.866449 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 404/808] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:14.867641 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08518b39-4aa5-4650-ba09-784cedfdbea4 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:14.867925 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08518b39-4aa5-4650-ba09-784cedfdbea4 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:14.868195 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08518b39-4aa5-4650-ba09-784cedfdbea4 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:14.869727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 405/809] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:14.873741 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08518b39-4aa5-4650-ba09-784cedfdbea4 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:14.956180 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8ecf9-4cc9-413e-a0db-00242fcb4c81 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:14.995729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4bf00-432b-4c52-be0f-27a521d8104d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:14.996525 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4bf00-432b-4c52-be0f-27a521d8104d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:14.996904 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4bf00-432b-4c52-be0f-27a521d8104d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:14.997275 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4bf00-432b-4c52-be0f-27a521d8104d None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:14.998007 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4bf00-432b-4c52-be0f-27a521d8104d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:14.998410 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4bf00-432b-4c52-be0f-27a521d8104d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:14.999994 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4bf00-432b-4c52-be0f-27a521d8104d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:15.000592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08518b39-4aa5-4650-ba09-784cedfdbea4 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:15.011000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 405/810] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Aug 30 11:45:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:15.012522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49abf98-43bc-4d7f-a954-43a17abb027f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:15.012924 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49abf98-43bc-4d7f-a954-43a17abb027f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:15.013297 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49abf98-43bc-4d7f-a954-43a17abb027f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:15.036361 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f49abf98-43bc-4d7f-a954-43a17abb027f None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:15.038345 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f49abf98-43bc-4d7f-a954-43a17abb027f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:15.047341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e9626-647c-4581-a8d4-282cbbd69174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:15.048185 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e9626-647c-4581-a8d4-282cbbd69174 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:15.048624 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e9626-647c-4581-a8d4-282cbbd69174 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:15.049028 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e9626-647c-4581-a8d4-282cbbd69174 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:15.050156 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e9626-647c-4581-a8d4-282cbbd69174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:15.050638 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e9626-647c-4581-a8d4-282cbbd69174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:15.052663 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e9626-647c-4581-a8d4-282cbbd69174 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:15.071858 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 406/811] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:15.072987 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e9626-647c-4581-a8d4-282cbbd69174 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:15.104822 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:15.129907 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:15.140849 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 406/812] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:15.141959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49abf98-43bc-4d7f-a954-43a17abb027f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:15.202424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e9626-647c-4581-a8d4-282cbbd69174 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:15.241074 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01a02c-59a6-432b-a5a8-48f40c4a9d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:15.241618 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01a02c-59a6-432b-a5a8-48f40c4a9d09 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:15.241896 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01a02c-59a6-432b-a5a8-48f40c4a9d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:15.242170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01a02c-59a6-432b-a5a8-48f40c4a9d09 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:15.242816 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01a02c-59a6-432b-a5a8-48f40c4a9d09 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:15.243118 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01a02c-59a6-432b-a5a8-48f40c4a9d09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:15.244576 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01a02c-59a6-432b-a5a8-48f40c4a9d09 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:15.254715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 407/813] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Aug 30 11:45:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:15.256104 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01a02c-59a6-432b-a5a8-48f40c4a9d09 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:15.349909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:15.365783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01a02c-59a6-432b-a5a8-48f40c4a9d09 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:15.394852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49abf98-43bc-4d7f-a954-43a17abb027f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:15.400881 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5991d-2521-407f-a119-20848ff15555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:15.401759 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5991d-2521-407f-a119-20848ff15555 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:15.402260 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5991d-2521-407f-a119-20848ff15555 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:15.402758 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5991d-2521-407f-a119-20848ff15555 None admin] PATH_INFO: `/v3/services/network` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:15.403593 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5991d-2521-407f-a119-20848ff15555 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:15.405256 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5991d-2521-407f-a119-20848ff15555 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:15.414369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-80d5991d-2521-407f-a119-20848ff15555 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 11:45:15.414369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:15.414369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:45:15.414369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:45:15.414369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:45:15.414369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:45:15.414369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:45:15.414369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:15.414369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 11:45:15.414369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:15.414369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:15.414369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:15.414369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:15.414369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:15.414369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:15.414369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:15.414369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:15.415627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:15.415627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:15.415627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:15.415627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:15.415627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:15.415627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:15.415627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:45:15.415627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:45:15.415627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:45:15.415627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:45:15.415627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:15.415627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:15.415627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:15.415627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:15.415627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:15.415627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:15.416687 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:15.416687 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:15.416687 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:15.416687 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:15.416687 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:15.416687 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:15.416687 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:15.416687 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:15.416687 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:15.416687 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:15.416687 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:45:15.416687 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:15.416687 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 11:45:15.416687 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:15.418487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 408/814] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:15 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:15.419646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5991d-2521-407f-a119-20848ff15555 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:15.431607 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac679419-9a0f-4abd-8b61-e10942abb777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:15.432359 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac679419-9a0f-4abd-8b61-e10942abb777 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:15.432633 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac679419-9a0f-4abd-8b61-e10942abb777 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:15.432900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac679419-9a0f-4abd-8b61-e10942abb777 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:15.440205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac679419-9a0f-4abd-8b61-e10942abb777 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:15.441760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac679419-9a0f-4abd-8b61-e10942abb777 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:15.453902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ac679419-9a0f-4abd-8b61-e10942abb777 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:15.453902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:15.453902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:15.453902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:15.453902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:15.453902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:15.453902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:15.453902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:15.453902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:15.453902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:15.453902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:15.453902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:15.453902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:45:15.453902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:45:15.453902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:45:15.454930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:45:15.454930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:15.454930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:15.454930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:15.454930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:15.454930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:15.454930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:15.454930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:15.454930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:15.454930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:15.454930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:15.454930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:15.454930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:15.454930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:15.454930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:15.454930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:15.454930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:15.456279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:45:15.456279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:45:15.456279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:45:15.456279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:45:15.456279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:45:15.456279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:45:15.456279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:15.456279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:15.456279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 407/815] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:15.456279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac679419-9a0f-4abd-8b61-e10942abb777 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:15.511250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:15.534829 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5991d-2521-407f-a119-20848ff15555 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:15.570634 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0837574-4bf5-42f0-b155-dc937881fb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:15.571538 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0837574-4bf5-42f0-b155-dc937881fb13 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:15.571817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0837574-4bf5-42f0-b155-dc937881fb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:15.572083 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0837574-4bf5-42f0-b155-dc937881fb13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:15.572741 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0837574-4bf5-42f0-b155-dc937881fb13 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:15.572858 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac679419-9a0f-4abd-8b61-e10942abb777 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:15.574112 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0837574-4bf5-42f0-b155-dc937881fb13 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:15.598027 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 409/816] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:45:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:45:15.598797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0837574-4bf5-42f0-b155-dc937881fb13 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:15.618830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:15.634242 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562377c5-247a-40d4-8599-49913c4516a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:15.635335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562377c5-247a-40d4-8599-49913c4516a0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:15.635809 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562377c5-247a-40d4-8599-49913c4516a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:15.636376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562377c5-247a-40d4-8599-49913c4516a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:15.649501 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562377c5-247a-40d4-8599-49913c4516a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:45:15.655097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-562377c5-247a-40d4-8599-49913c4516a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:45:15.655097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:15.655097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:15.655097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:15.655097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:15.655097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:15.655097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:15.655097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:15.655097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:15.655097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:15.655097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:15.655097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:15.655097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:45:15.655097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:45:15.655097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:45:15.655097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:45:15.656364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:45:15.656364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:45:15.656364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:45:15.656364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:45:15.656364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:15.656364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:15.656364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:15.656364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:15.656364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:15.656364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:15.656364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:15.656364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:15.656364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:15.656364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:15.656364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:15.656364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:15.657422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:15.657422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:15.657422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:15.657422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:15.657422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:45:15.657422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:45:15.657422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:45:15.657422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:45:15.657422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:45:15.657422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:45:15.657422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:45:15.657422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:15.663615 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 408/817] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:45:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:15.665498 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562377c5-247a-40d4-8599-49913c4516a0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:15.734274 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0837574-4bf5-42f0-b155-dc937881fb13 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:15.781599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f039fd0-ee2e-4bd5-9596-b44a128bab7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:15.782141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f039fd0-ee2e-4bd5-9596-b44a128bab7d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:15.782410 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f039fd0-ee2e-4bd5-9596-b44a128bab7d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:15.782677 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f039fd0-ee2e-4bd5-9596-b44a128bab7d None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:15.783320 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f039fd0-ee2e-4bd5-9596-b44a128bab7d None admin] RBAC: Adding query filter params (name=network) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:15.783648 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f039fd0-ee2e-4bd5-9596-b44a128bab7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:15.785076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f039fd0-ee2e-4bd5-9596-b44a128bab7d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:15.791857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 410/818] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Aug 30 11:45:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:15.794038 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f039fd0-ee2e-4bd5-9596-b44a128bab7d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:15.802954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562377c5-247a-40d4-8599-49913c4516a0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:15.814485 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:15.851817 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b22b4-e339-4d2d-8400-ed5fd6d8a067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:15.852734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b22b4-e339-4d2d-8400-ed5fd6d8a067 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:15.853486 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b22b4-e339-4d2d-8400-ed5fd6d8a067 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:15.853768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b22b4-e339-4d2d-8400-ed5fd6d8a067 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:15.854803 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b22b4-e339-4d2d-8400-ed5fd6d8a067 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:15.855139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b22b4-e339-4d2d-8400-ed5fd6d8a067 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:15.857671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b22b4-e339-4d2d-8400-ed5fd6d8a067 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:15.874698 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 409/819] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:45:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:15.875840 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b22b4-e339-4d2d-8400-ed5fd6d8a067 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:15.895187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:15.927970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f039fd0-ee2e-4bd5-9596-b44a128bab7d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:15.965925 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9d9d6-a732-41e6-a7f4-d2251b1fb1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:15.966560 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9d9d6-a732-41e6-a7f4-d2251b1fb1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:15.966835 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9d9d6-a732-41e6-a7f4-d2251b1fb1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:15.967102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9d9d6-a732-41e6-a7f4-d2251b1fb1f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:15.967963 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9d9d6-a732-41e6-a7f4-d2251b1fb1f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:15.968269 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9d9d6-a732-41e6-a7f4-d2251b1fb1f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:15.969954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9d9d6-a732-41e6-a7f4-d2251b1fb1f4 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:15.983266 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 411/820] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:45:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:15.984447 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9d9d6-a732-41e6-a7f4-d2251b1fb1f4 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:16.002304 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b22b4-e339-4d2d-8400-ed5fd6d8a067 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:16.036554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50266a38-4a43-4c44-beb6-276a7f4b5a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:16.037110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50266a38-4a43-4c44-beb6-276a7f4b5a99 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:16.037383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50266a38-4a43-4c44-beb6-276a7f4b5a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:16.037651 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50266a38-4a43-4c44-beb6-276a7f4b5a99 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:16.038274 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50266a38-4a43-4c44-beb6-276a7f4b5a99 None admin] RBAC: Adding query filter params (type=network) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:16.038566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50266a38-4a43-4c44-beb6-276a7f4b5a99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:16.039973 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50266a38-4a43-4c44-beb6-276a7f4b5a99 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:16.049687 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 410/821] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Aug 30 11:45:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:16.050600 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50266a38-4a43-4c44-beb6-276a7f4b5a99 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:16.083101 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:16.098493 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9d9d6-a732-41e6-a7f4-d2251b1fb1f4 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:16.131805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:16.135990 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d88e4e-ba66-44b4-893e-486ece74eab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:16.136885 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d88e4e-ba66-44b4-893e-486ece74eab6 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:16.137469 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d88e4e-ba66-44b4-893e-486ece74eab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:16.137839 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d88e4e-ba66-44b4-893e-486ece74eab6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:16.138663 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d88e4e-ba66-44b4-893e-486ece74eab6 None admin] RBAC: Adding query filter params (role.id=4f4d8a6881ca496bb2d4845a6592fea8, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=8d17f1d0577a41ed8859706073f79d77) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:16.139080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d88e4e-ba66-44b4-893e-486ece74eab6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:16.140816 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d88e4e-ba66-44b4-893e-486ece74eab6 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:16.155703 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 412/822] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:45:15 2022] GET /identity/v3/role_assignments?user.id=8d17f1d0577a41ed8859706073f79d77&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=4f4d8a6881ca496bb2d4845a6592fea8 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:16.156905 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d88e4e-ba66-44b4-893e-486ece74eab6 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:16.157700 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50266a38-4a43-4c44-beb6-276a7f4b5a99 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:16.208178 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554afe97-c87d-4617-b3f3-6ffdccf063e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:16.209109 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554afe97-c87d-4617-b3f3-6ffdccf063e9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:16.209555 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554afe97-c87d-4617-b3f3-6ffdccf063e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:16.209961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554afe97-c87d-4617-b3f3-6ffdccf063e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:16.236137 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554afe97-c87d-4617-b3f3-6ffdccf063e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:16.237929 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554afe97-c87d-4617-b3f3-6ffdccf063e9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:16.266462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-554afe97-c87d-4617-b3f3-6ffdccf063e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:16.266462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:16.266462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:16.266462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:16.266462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:16.266462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:16.266462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:16.266462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:16.266462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:16.266462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:16.266462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:16.266462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:16.266462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:16.266462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:16.266462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:16.266462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:16.267527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:16.267527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:16.267527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:16.267527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:16.267527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:16.267527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:16.267527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:16.267527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:16.267527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:16.267527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:16.267527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:16.267527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:16.267527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:16.267527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:16.267527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:16.267527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:16.267527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:16.268415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:16.268415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:16.268415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:16.274626 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 411/823] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:16.276313 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554afe97-c87d-4617-b3f3-6ffdccf063e9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:16.294138 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d88e4e-ba66-44b4-893e-486ece74eab6 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:16.331644 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17460b63-5371-4ad6-b31e-38e83df4577c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:16.332266 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17460b63-5371-4ad6-b31e-38e83df4577c None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:16.332596 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17460b63-5371-4ad6-b31e-38e83df4577c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:16.332866 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17460b63-5371-4ad6-b31e-38e83df4577c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:16.333582 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17460b63-5371-4ad6-b31e-38e83df4577c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:16.334971 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17460b63-5371-4ad6-b31e-38e83df4577c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:16.367419 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 413/824] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:45:16 2022] POST /identity/v3/endpoints => generated 337 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:45:16.385100 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:16.424001 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554afe97-c87d-4617-b3f3-6ffdccf063e9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:16.472756 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e8d6f-b604-44ab-8f4f-8f43e911bbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:16.473401 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e8d6f-b604-44ab-8f4f-8f43e911bbfa None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:16.473676 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e8d6f-b604-44ab-8f4f-8f43e911bbfa None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:16.473943 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e8d6f-b604-44ab-8f4f-8f43e911bbfa None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:16.474599 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e8d6f-b604-44ab-8f4f-8f43e911bbfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:16.474899 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e8d6f-b604-44ab-8f4f-8f43e911bbfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:16.476523 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e8d6f-b604-44ab-8f4f-8f43e911bbfa None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:16.491626 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 412/825] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:16.497865 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17460b63-5371-4ad6-b31e-38e83df4577c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:16.560618 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:16.614986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17460b63-5371-4ad6-b31e-38e83df4577c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:16.632995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c188fc0-84a1-42bc-883e-5cceaa15fc5d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:16.633344 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c188fc0-84a1-42bc-883e-5cceaa15fc5d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:16.633549 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c188fc0-84a1-42bc-883e-5cceaa15fc5d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:16.635141 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 413/826] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:45:16.643334 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba136e11-7251-4d33-bb9b-0bd2abf8b66f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:16.643660 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba136e11-7251-4d33-bb9b-0bd2abf8b66f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:16.643931 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba136e11-7251-4d33-bb9b-0bd2abf8b66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:16.652943 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f5a59-c35d-469f-8492-f591acc2633c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:16.653883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f5a59-c35d-469f-8492-f591acc2633c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:16.654368 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f5a59-c35d-469f-8492-f591acc2633c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:16.654829 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f5a59-c35d-469f-8492-f591acc2633c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:16.667163 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f5a59-c35d-469f-8492-f591acc2633c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:16.668998 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f5a59-c35d-469f-8492-f591acc2633c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:16.675315 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ba136e11-7251-4d33-bb9b-0bd2abf8b66f None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:16.676592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ba136e11-7251-4d33-bb9b-0bd2abf8b66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:16.682009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-a31f5a59-c35d-469f-8492-f591acc2633c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:45:16.682009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:16.682009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:16.682009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:16.682009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:16.682009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:16.682009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:16.682009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:16.682009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:16.682009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:16.682009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:16.682009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:16.682009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:45:16.682009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:45:16.682009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:45:16.682009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:45:16.682946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:16.682946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:16.682946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:45:16.682946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:16.682946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:45:16.682946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:16.682946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:16.682946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:16.682946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:16.682946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:16.682946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:16.682946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:16.682946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:16.682946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:16.682946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:16.682946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:16.682946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:16.682946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:16.684440 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:16.684440 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:16.684440 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:45:16.684440 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:45:16.684440 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:45:16.684440 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:45:16.684440 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:45:16.684440 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:45:16.684440 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:45:16.684440 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:16.684440 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 414/827] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:45:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:16.691535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f5a59-c35d-469f-8492-f591acc2633c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:16.757855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 414/828] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:16.802305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f5a59-c35d-469f-8492-f591acc2633c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:16.816478 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:16.838081 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2fc7f-f135-4078-b8ea-0fc307a0e38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:16.838951 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2fc7f-f135-4078-b8ea-0fc307a0e38f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:16.839240 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2fc7f-f135-4078-b8ea-0fc307a0e38f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:16.839535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2fc7f-f135-4078-b8ea-0fc307a0e38f None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:16.840264 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2fc7f-f135-4078-b8ea-0fc307a0e38f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:16.840563 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2fc7f-f135-4078-b8ea-0fc307a0e38f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:16.842010 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2fc7f-f135-4078-b8ea-0fc307a0e38f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:16.860467 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 415/829] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Aug 30 11:45:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:16.866298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba136e11-7251-4d33-bb9b-0bd2abf8b66f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:16.941173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:16.973579 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba136e11-7251-4d33-bb9b-0bd2abf8b66f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:17.008630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62e487-ae69-423c-b601-3a7229c9ae95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:17.010035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62e487-ae69-423c-b601-3a7229c9ae95 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:17.010563 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62e487-ae69-423c-b601-3a7229c9ae95 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:17.011020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62e487-ae69-423c-b601-3a7229c9ae95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:17.021685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62e487-ae69-423c-b601-3a7229c9ae95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:17.023517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62e487-ae69-423c-b601-3a7229c9ae95 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:17.038531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-7a62e487-ae69-423c-b601-3a7229c9ae95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:17.038531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:17.038531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:17.038531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:17.038531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:17.038531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:17.038531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:17.038531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:17.038531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:17.038531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:17.038531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:17.038531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:17.038531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:17.038531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:17.038531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:17.038531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:17.039624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:17.039624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:17.039624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:17.039624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:17.039624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:17.039624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:17.039624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:17.039624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:17.039624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:17.039624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:17.039624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:17.039624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:17.039624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:17.039624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:17.039624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:17.039624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:17.039624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:17.040504 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:17.040504 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:17.040504 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:17.047135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 415/830] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:17.048635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2fc7f-f135-4078-b8ea-0fc307a0e38f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:17.049974 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62e487-ae69-423c-b601-3a7229c9ae95 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:17.172814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2fc7f-f135-4078-b8ea-0fc307a0e38f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:17.188349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62e487-ae69-423c-b601-3a7229c9ae95 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:17.208905 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43e17d-ced9-48e4-94fd-9cec2cf6aba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:17.209716 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43e17d-ced9-48e4-94fd-9cec2cf6aba0 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:17.210133 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43e17d-ced9-48e4-94fd-9cec2cf6aba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:17.210524 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43e17d-ced9-48e4-94fd-9cec2cf6aba0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:17.217624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:17.223353 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e43e17d-ced9-48e4-94fd-9cec2cf6aba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:45:17.229678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-7e43e17d-ced9-48e4-94fd-9cec2cf6aba0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:45:17.229678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:17.229678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:17.229678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:17.229678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:17.229678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:17.229678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:17.229678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:17.229678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:17.229678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:17.229678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:17.229678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:17.229678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:45:17.229678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:45:17.229678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:45:17.229678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:45:17.230787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:45:17.230787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:45:17.230787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:45:17.230787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:45:17.230787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:17.230787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:17.230787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:17.230787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:17.230787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:17.230787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:17.230787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:17.230787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:17.230787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:17.230787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:17.230787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:17.230787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:17.231857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:17.231857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:17.231857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:17.231857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:17.231857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:45:17.231857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:45:17.231857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:45:17.231857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:45:17.231857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:45:17.231857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:45:17.231857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:45:17.231857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:17.238894 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 416/831] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:45:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:17.239598 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf1a90-15c4-4198-ad08-8fdcfc4dda7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:17.240007 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43e17d-ced9-48e4-94fd-9cec2cf6aba0 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:17.240650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf1a90-15c4-4198-ad08-8fdcfc4dda7c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:17.241065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf1a90-15c4-4198-ad08-8fdcfc4dda7c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:17.241472 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf1a90-15c4-4198-ad08-8fdcfc4dda7c None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:17.242258 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf1a90-15c4-4198-ad08-8fdcfc4dda7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:17.242693 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf1a90-15c4-4198-ad08-8fdcfc4dda7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:17.244549 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf1a90-15c4-4198-ad08-8fdcfc4dda7c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:17.261612 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 416/832] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:17.267962 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf1a90-15c4-4198-ad08-8fdcfc4dda7c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:17.275737 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:17.358263 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43e17d-ced9-48e4-94fd-9cec2cf6aba0 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:17.390388 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf1a90-15c4-4198-ad08-8fdcfc4dda7c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:17.393235 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f5573-aa55-4d5a-b624-66298b9a4c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:17.394295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f5573-aa55-4d5a-b624-66298b9a4c1a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:17.394295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f5573-aa55-4d5a-b624-66298b9a4c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:17.394492 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f5573-aa55-4d5a-b624-66298b9a4c1a None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:17.395220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f5573-aa55-4d5a-b624-66298b9a4c1a None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:17.395623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f5573-aa55-4d5a-b624-66298b9a4c1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:17.397081 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f5573-aa55-4d5a-b624-66298b9a4c1a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:17.410841 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 417/833] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Aug 30 11:45:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:17.411880 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f5573-aa55-4d5a-b624-66298b9a4c1a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:17.429785 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1f98b-4282-4c8b-9d6e-a070a641f4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:17.430835 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1f98b-4282-4c8b-9d6e-a070a641f4d3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:17.431287 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1f98b-4282-4c8b-9d6e-a070a641f4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:17.431776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1f98b-4282-4c8b-9d6e-a070a641f4d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:17.439197 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1f98b-4282-4c8b-9d6e-a070a641f4d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:17.441018 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1f98b-4282-4c8b-9d6e-a070a641f4d3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:17.453374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-1ec1f98b-4282-4c8b-9d6e-a070a641f4d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:17.453374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:17.453374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:17.453374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:17.453374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:17.453374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:17.453374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:17.453374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:17.453374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:17.453374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:17.453374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:17.453374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:17.453374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:45:17.453374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:45:17.453374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:45:17.454285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:45:17.454285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:17.454285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:17.454285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:17.454285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:17.454285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:17.454285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:17.454285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:17.454285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:17.454285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:17.454285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:17.454285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:17.454285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:17.454285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:17.454285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:17.454285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:17.454285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:17.455177 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:45:17.455177 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:45:17.455177 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:45:17.455177 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:45:17.455177 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:45:17.455177 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:45:17.455177 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:17.455177 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:17.457677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 417/834] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:17.464124 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1f98b-4282-4c8b-9d6e-a070a641f4d3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:17.510276 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:17.516645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:17.532590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f5573-aa55-4d5a-b624-66298b9a4c1a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:17.580534 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2a31c-85a6-4240-8acc-a4cdbfccfb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:17.581647 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2a31c-85a6-4240-8acc-a4cdbfccfb31 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:17.582093 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2a31c-85a6-4240-8acc-a4cdbfccfb31 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:17.582500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2a31c-85a6-4240-8acc-a4cdbfccfb31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:17.583588 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1f98b-4282-4c8b-9d6e-a070a641f4d3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:17.601295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2a31c-85a6-4240-8acc-a4cdbfccfb31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:17.603644 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2a31c-85a6-4240-8acc-a4cdbfccfb31 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:17.619783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-26e2a31c-85a6-4240-8acc-a4cdbfccfb31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:17.619783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:17.619783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:17.619783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:17.619783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:17.619783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:17.619783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:17.619783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:17.619783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:17.619783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:17.619783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:17.619783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:17.619783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:17.619783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:17.619783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:17.619783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:17.620828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:17.620828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:17.620828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:17.620828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:17.620828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:17.620828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:17.620828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:17.620828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:17.620828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:17.620828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:17.620828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:17.620828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:17.620828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:17.620828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:17.620828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:17.620828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:17.620828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:17.621721 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:17.621721 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:17.621721 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:17.623904 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 418/835] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:17.630067 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2a31c-85a6-4240-8acc-a4cdbfccfb31 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:17.637693 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b7c9d-5125-4267-9129-107bc848351f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:17.638322 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b7c9d-5125-4267-9129-107bc848351f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:17.638599 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b7c9d-5125-4267-9129-107bc848351f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:17.638872 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b7c9d-5125-4267-9129-107bc848351f None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:17.639691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b7c9d-5125-4267-9129-107bc848351f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:17.640184 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b7c9d-5125-4267-9129-107bc848351f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:17.641860 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b7c9d-5125-4267-9129-107bc848351f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:17.659508 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 418/836] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:45:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:17.665525 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b7c9d-5125-4267-9129-107bc848351f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:17.759216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2a31c-85a6-4240-8acc-a4cdbfccfb31 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:17.774778 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b7c9d-5125-4267-9129-107bc848351f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:17.776479 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:17.795952 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3663c0e-b78b-46b3-a4d3-50c97132c5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:17.796961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3663c0e-b78b-46b3-a4d3-50c97132c5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:17.797410 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3663c0e-b78b-46b3-a4d3-50c97132c5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:17.797781 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3663c0e-b78b-46b3-a4d3-50c97132c5a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:17.798490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3663c0e-b78b-46b3-a4d3-50c97132c5a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:17.798784 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3663c0e-b78b-46b3-a4d3-50c97132c5a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:17.800188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3663c0e-b78b-46b3-a4d3-50c97132c5a4 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:17.816988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 419/837] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:17.816988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ca3ed-9d5c-4963-8404-2c300bde3154 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:17.816988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ca3ed-9d5c-4963-8404-2c300bde3154 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:17.816988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ca3ed-9d5c-4963-8404-2c300bde3154 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:17.816988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 420/838] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:17.818744 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c251773-62b7-41b0-a07c-8e727dcceb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:17.819542 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c251773-62b7-41b0-a07c-8e727dcceb49 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:17.820140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c251773-62b7-41b0-a07c-8e727dcceb49 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:17.820423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ca3ed-9d5c-4963-8404-2c300bde3154 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:17.820586 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c251773-62b7-41b0-a07c-8e727dcceb49 None admin] PATH_INFO: `/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/8d27bfb8c0b64763b7db7cffa5f230f6/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:17.822671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c251773-62b7-41b0-a07c-8e727dcceb49 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba4dff9d637c4afcadfd3cd92b065a41, user_id=8d27bfb8c0b64763b7db7cffa5f230f6, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:17.824240 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c251773-62b7-41b0-a07c-8e727dcceb49 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:17.825269 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:17.840184 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 419/839] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:45:17 2022] PUT /identity/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/8d27bfb8c0b64763b7db7cffa5f230f6/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:45:17.841401 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c344-e2d6-4b3a-9217-ee65c3fc4e88 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:17.841757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c344-e2d6-4b3a-9217-ee65c3fc4e88 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:17.841958 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c344-e2d6-4b3a-9217-ee65c3fc4e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:17.867651 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d742c344-e2d6-4b3a-9217-ee65c3fc4e88 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:17.869054 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d742c344-e2d6-4b3a-9217-ee65c3fc4e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:17.942715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ca3ed-9d5c-4963-8404-2c300bde3154 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:17.972060 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 420/840] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:17.987900 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561c312-c7fb-45b6-8620-6b1f89589dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:17.988753 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561c312-c7fb-45b6-8620-6b1f89589dda None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:17.989125 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561c312-c7fb-45b6-8620-6b1f89589dda None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:17.989539 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561c312-c7fb-45b6-8620-6b1f89589dda None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:17.997974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561c312-c7fb-45b6-8620-6b1f89589dda None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:17.999650 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561c312-c7fb-45b6-8620-6b1f89589dda None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:18.012837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-f561c312-c7fb-45b6-8620-6b1f89589dda None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:45:18.012837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:18.012837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:18.012837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:18.012837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:18.012837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:18.012837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:18.012837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:18.012837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:18.012837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:18.012837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:18.012837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:18.012837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:45:18.012837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:45:18.012837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:45:18.012837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:45:18.013882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:18.013882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:18.013882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:45:18.013882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:18.013882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:45:18.013882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:18.013882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:18.013882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:18.013882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:18.013882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:18.013882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:18.013882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:18.013882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:18.013882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:18.013882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:18.013882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:18.013882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:18.013882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:18.014914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:18.014914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:18.014914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:45:18.014914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:45:18.014914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:45:18.014914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:45:18.014914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:45:18.014914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:45:18.014914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:45:18.014914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:18.014914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 421/841] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Aug 30 11:45:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:18.020457 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742c344-e2d6-4b3a-9217-ee65c3fc4e88 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:18.136568 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:18.145714 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742c344-e2d6-4b3a-9217-ee65c3fc4e88 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:18.181517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41831079-6d6f-45fa-9904-c71d36f8e15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:18.182128 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41831079-6d6f-45fa-9904-c71d36f8e15b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:18.182399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41831079-6d6f-45fa-9904-c71d36f8e15b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:18.182667 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41831079-6d6f-45fa-9904-c71d36f8e15b None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:18.183417 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41831079-6d6f-45fa-9904-c71d36f8e15b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:18.183721 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41831079-6d6f-45fa-9904-c71d36f8e15b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:18.185156 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41831079-6d6f-45fa-9904-c71d36f8e15b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:18.203319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 421/842] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Aug 30 11:45:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:18.208584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561c312-c7fb-45b6-8620-6b1f89589dda None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:18.253854 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41831079-6d6f-45fa-9904-c71d36f8e15b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:18.282337 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:18.325848 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561c312-c7fb-45b6-8620-6b1f89589dda None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:18.361531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41831079-6d6f-45fa-9904-c71d36f8e15b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:18.362949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b78bd6-7b62-4b35-aa02-d51dbb54ddee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:18.363590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b78bd6-7b62-4b35-aa02-d51dbb54ddee None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:18.363869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b78bd6-7b62-4b35-aa02-d51dbb54ddee None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:18.364138 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b78bd6-7b62-4b35-aa02-d51dbb54ddee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:18.398765 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30bacf-6040-4019-89f9-d3f9c73783ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:18.399833 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30bacf-6040-4019-89f9-d3f9c73783ec None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:18.400307 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30bacf-6040-4019-89f9-d3f9c73783ec None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:18.400893 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30bacf-6040-4019-89f9-d3f9c73783ec None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:18.401697 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30bacf-6040-4019-89f9-d3f9c73783ec None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:18.403296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30bacf-6040-4019-89f9-d3f9c73783ec None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:18.413118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ce30bacf-6040-4019-89f9-d3f9c73783ec None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 11:45:18.413118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:18.413118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:45:18.413118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:45:18.413118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:45:18.413118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:45:18.413118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:45:18.413118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:18.413118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 11:45:18.413118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:18.413118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:18.413118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:18.413118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:18.413118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:18.413118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:18.413118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:18.413118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:18.414162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:18.414162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:18.414162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:18.414162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:18.414162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:18.414162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:18.414162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:45:18.414162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:45:18.414162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:45:18.414162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:45:18.414162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:18.414162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:18.414162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:18.414162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:18.414162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:18.414162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:18.414988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:18.414988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:18.414988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:18.414988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:18.414988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:18.414988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:18.414988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:18.414988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:18.414988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:18.414988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:18.414988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:45:18.414988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:18.414988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 11:45:18.414988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:18.417884 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 422/843] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Aug 30 11:45:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:18.424436 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30bacf-6040-4019-89f9-d3f9c73783ec None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:18.441396 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b78bd6-7b62-4b35-aa02-d51dbb54ddee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:18.442348 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:18.443148 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b78bd6-7b62-4b35-aa02-d51dbb54ddee None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:18.507202 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:18.536313 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30bacf-6040-4019-89f9-d3f9c73783ec None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:18.550276 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 422/844] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:45:18 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:45:18.551721 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2378535-de34-46bc-8fda-be50875ee787 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:18.552012 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2378535-de34-46bc-8fda-be50875ee787 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:18.552288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2378535-de34-46bc-8fda-be50875ee787 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:18.553644 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 423/845] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:18.558432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2378535-de34-46bc-8fda-be50875ee787 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:18.576943 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ed966-c40e-42d4-b4e8-ce160abb85b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:18.578555 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ed966-c40e-42d4-b4e8-ce160abb85b4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:18.578842 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ed966-c40e-42d4-b4e8-ce160abb85b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:18.579136 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ed966-c40e-42d4-b4e8-ce160abb85b4 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:18.579811 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ed966-c40e-42d4-b4e8-ce160abb85b4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:18.580106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ed966-c40e-42d4-b4e8-ce160abb85b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:18.581490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ed966-c40e-42d4-b4e8-ce160abb85b4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:18.586024 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 423/846] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Aug 30 11:45:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:18.592097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7c12c-8f1c-406c-9f54-25a2997df9de None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:18.592381 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7c12c-8f1c-406c-9f54-25a2997df9de None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:18.593076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7c12c-8f1c-406c-9f54-25a2997df9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:18.611183 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7db7c12c-8f1c-406c-9f54-25a2997df9de None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:18.612405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7db7c12c-8f1c-406c-9f54-25a2997df9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:18.678055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2378535-de34-46bc-8fda-be50875ee787 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:18.687936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 424/847] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:18.689181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7c12c-8f1c-406c-9f54-25a2997df9de None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:18.708872 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:18.725862 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417aa1c-4166-4dbf-a030-74267b021c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:18.726726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417aa1c-4166-4dbf-a030-74267b021c96 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:18.727145 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417aa1c-4166-4dbf-a030-74267b021c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:18.727600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417aa1c-4166-4dbf-a030-74267b021c96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:18.739184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417aa1c-4166-4dbf-a030-74267b021c96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:18.740801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417aa1c-4166-4dbf-a030-74267b021c96 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:18.760479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-3417aa1c-4166-4dbf-a030-74267b021c96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:18.760479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:18.760479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:18.760479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:18.760479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:18.760479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:18.760479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:18.760479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:18.760479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:18.760479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:18.760479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:18.760479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:18.760479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:18.760479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:18.760479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:18.760479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:18.761570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:18.761570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:18.761570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:18.761570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:18.761570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:18.761570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:18.761570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:18.761570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:18.761570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:18.761570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:18.761570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:18.761570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:18.761570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:18.761570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:18.761570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:18.761570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:18.761570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:18.762812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:18.762812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:18.762812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:18.762812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 424/848] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:18.767811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417aa1c-4166-4dbf-a030-74267b021c96 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:18.787825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:18.827801 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7c12c-8f1c-406c-9f54-25a2997df9de None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:18.879745 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4ca99-286d-4519-b216-ca3f59899b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:18.882538 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417aa1c-4166-4dbf-a030-74267b021c96 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:18.882753 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4ca99-286d-4519-b216-ca3f59899b84 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:18.883124 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4ca99-286d-4519-b216-ca3f59899b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:18.884859 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4ca99-286d-4519-b216-ca3f59899b84 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:18.884859 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4ca99-286d-4519-b216-ca3f59899b84 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:18.884859 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4ca99-286d-4519-b216-ca3f59899b84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:18.886003 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4ca99-286d-4519-b216-ca3f59899b84 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:18.903903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 425/849] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Aug 30 11:45:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:18.921150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8a2ea-da8f-4bbc-a80a-41216220e276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:18.922144 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8a2ea-da8f-4bbc-a80a-41216220e276 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:18.922563 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8a2ea-da8f-4bbc-a80a-41216220e276 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:18.922994 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8a2ea-da8f-4bbc-a80a-41216220e276 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:18.923823 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8a2ea-da8f-4bbc-a80a-41216220e276 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:18.924266 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8a2ea-da8f-4bbc-a80a-41216220e276 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:18.925832 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8a2ea-da8f-4bbc-a80a-41216220e276 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:18.940398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 425/850] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:18.946296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4ca99-286d-4519-b216-ca3f59899b84 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:18.994391 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8a2ea-da8f-4bbc-a80a-41216220e276 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:19.039592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:19.076974 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4ca99-286d-4519-b216-ca3f59899b84 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:19.096692 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:19.123145 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8a2ea-da8f-4bbc-a80a-41216220e276 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:19.128344 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaf78e-55d7-476c-974b-38a1e0c9c528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:19.128992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaf78e-55d7-476c-974b-38a1e0c9c528 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:19.129271 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaf78e-55d7-476c-974b-38a1e0c9c528 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:19.129541 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaf78e-55d7-476c-974b-38a1e0c9c528 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:19.138638 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faaf78e-55d7-476c-974b-38a1e0c9c528 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:19.140611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faaf78e-55d7-476c-974b-38a1e0c9c528 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:19.154616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-2faaf78e-55d7-476c-974b-38a1e0c9c528 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:19.154616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:19.154616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:19.154616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:19.154616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:19.154616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:19.154616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:19.154616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:19.154616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:19.154616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:19.154616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:19.154616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:19.154616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:45:19.154616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:45:19.154616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:45:19.155815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:45:19.155815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:19.155815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:19.155815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:19.155815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:19.155815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:19.155815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:19.155815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:19.155815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:19.155815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:19.155815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:19.155815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:19.155815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:19.155815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:19.155815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:19.155815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:19.155815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:19.156737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:45:19.156737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:45:19.156737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:45:19.156737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:45:19.156737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:45:19.156737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:45:19.156737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:19.156737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:19.158625 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 426/851] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:19.163575 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50a77d-2719-4d38-a139-c1eba61064e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:19.164219 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50a77d-2719-4d38-a139-c1eba61064e7 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:19.164501 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50a77d-2719-4d38-a139-c1eba61064e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:19.164774 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50a77d-2719-4d38-a139-c1eba61064e7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:19.164989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaf78e-55d7-476c-974b-38a1e0c9c528 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:19.165354 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50a77d-2719-4d38-a139-c1eba61064e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:19.166906 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50a77d-2719-4d38-a139-c1eba61064e7 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:19.178840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-bc50a77d-2719-4d38-a139-c1eba61064e7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 11:45:19.178840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:19.178840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:45:19.178840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:45:19.178840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:45:19.178840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:45:19.178840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:45:19.178840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:19.178840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 11:45:19.178840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:19.178840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:19.178840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:19.178840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:19.178840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:19.178840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:19.178840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:19.180055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:19.180055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:19.180055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:19.180055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:19.180055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:19.180055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:19.180055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:19.180055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:45:19.180055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:45:19.180055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:45:19.180055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:45:19.180055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:19.180055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:19.180055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:19.180055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:19.180055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:19.180055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:19.181130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:19.181130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:19.181130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:19.181130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:19.181130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:19.181130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:19.181130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:19.181130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:19.181130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:19.181130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:19.181130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:45:19.181130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:19.181130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 11:45:19.181130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:19.181130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 426/852] 10.222.0.27 () {56 vars in 1132 bytes} [Tue Aug 30 11:45:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:19.185927 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50a77d-2719-4d38-a139-c1eba61064e7 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:19.277277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaf78e-55d7-476c-974b-38a1e0c9c528 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:19.291289 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50a77d-2719-4d38-a139-c1eba61064e7 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:19.309276 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:19.315462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e504d-6a3b-48d4-9305-0fb92d724215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:19.316375 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e504d-6a3b-48d4-9305-0fb92d724215 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:19.316866 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e504d-6a3b-48d4-9305-0fb92d724215 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:19.317322 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e504d-6a3b-48d4-9305-0fb92d724215 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:19.319226 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e504d-6a3b-48d4-9305-0fb92d724215 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:19.319767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e504d-6a3b-48d4-9305-0fb92d724215 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:19.321398 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e504d-6a3b-48d4-9305-0fb92d724215 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:19.328515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03eb4c-6fe2-49a3-904f-d603bb56b69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:19.329138 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03eb4c-6fe2-49a3-904f-d603bb56b69a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:19.329415 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03eb4c-6fe2-49a3-904f-d603bb56b69a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:19.329742 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03eb4c-6fe2-49a3-904f-d603bb56b69a None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:19.330379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03eb4c-6fe2-49a3-904f-d603bb56b69a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:19.330678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03eb4c-6fe2-49a3-904f-d603bb56b69a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:19.332489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03eb4c-6fe2-49a3-904f-d603bb56b69a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:19.337086 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 427/853] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:45:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:19.342443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 427/854] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Aug 30 11:45:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:19.343865 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03eb4c-6fe2-49a3-904f-d603bb56b69a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:19.344962 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e504d-6a3b-48d4-9305-0fb92d724215 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:19.347787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:19.449236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03eb4c-6fe2-49a3-904f-d603bb56b69a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:19.450741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e504d-6a3b-48d4-9305-0fb92d724215 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:19.485088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54ab63-cf51-47e2-8698-c5f5fb6e7804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:19.485698 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54ab63-cf51-47e2-8698-c5f5fb6e7804 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:19.485975 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54ab63-cf51-47e2-8698-c5f5fb6e7804 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:19.486240 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54ab63-cf51-47e2-8698-c5f5fb6e7804 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:19.486961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54ab63-cf51-47e2-8698-c5f5fb6e7804 None admin] RBAC: Adding query filter params (role.id=eec5decc24ab4673a246120350336b1e, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=58c86110ce97463e9b3d53691ae3e12c) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:19.487256 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54ab63-cf51-47e2-8698-c5f5fb6e7804 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:19.488761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54ab63-cf51-47e2-8698-c5f5fb6e7804 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:19.490089 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75691fc-897a-48ec-81db-a4654f2eb5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:19.490909 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75691fc-897a-48ec-81db-a4654f2eb5a8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:19.491406 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75691fc-897a-48ec-81db-a4654f2eb5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:19.491863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75691fc-897a-48ec-81db-a4654f2eb5a8 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:19.492749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75691fc-897a-48ec-81db-a4654f2eb5a8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:19.493238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75691fc-897a-48ec-81db-a4654f2eb5a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:19.494868 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75691fc-897a-48ec-81db-a4654f2eb5a8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:19.507439 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 428/856] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:45:19 2022] GET /identity/v3/role_assignments?user.id=58c86110ce97463e9b3d53691ae3e12c&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=eec5decc24ab4673a246120350336b1e => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:19.507968 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 428/856] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Aug 30 11:45:19 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:19.886843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997a07b-a380-455a-ae09-d8fd564d28f3 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:19.887250 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997a07b-a380-455a-ae09-d8fd564d28f3 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:19.887443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997a07b-a380-455a-ae09-d8fd564d28f3 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:19.888788 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 429/857] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:19.894242 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db360e6-5c30-4456-a16d-2c1e187ee6f3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:19.894526 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db360e6-5c30-4456-a16d-2c1e187ee6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:19.894798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db360e6-5c30-4456-a16d-2c1e187ee6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:19.913611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2db360e6-5c30-4456-a16d-2c1e187ee6f3 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:19.914804 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2db360e6-5c30-4456-a16d-2c1e187ee6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:19.968775 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:19.987971 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 429/858] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:20.253267 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997a07b-a380-455a-ae09-d8fd564d28f3 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:20.324029 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:20.361462 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997a07b-a380-455a-ae09-d8fd564d28f3 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:20.395632 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c7255-29f1-41f6-bca0-b3e2c62b982e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:20.396326 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c7255-29f1-41f6-bca0-b3e2c62b982e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:20.396603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c7255-29f1-41f6-bca0-b3e2c62b982e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:20.396993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c7255-29f1-41f6-bca0-b3e2c62b982e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:20.407558 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c7255-29f1-41f6-bca0-b3e2c62b982e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:45:20.412890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-911c7255-29f1-41f6-bca0-b3e2c62b982e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:45:20.412890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:20.412890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:20.412890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:20.412890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:20.412890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:20.412890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:20.412890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:20.412890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:20.412890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:20.412890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:20.412890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:20.412890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:45:20.412890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:45:20.412890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:45:20.412890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:45:20.413811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:45:20.413811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:45:20.413811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:45:20.413811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:45:20.413811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:20.413811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:20.413811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:20.413811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:20.413811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:20.413811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:20.413811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:20.413811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:20.413811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:20.413811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:20.413811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:20.413811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:20.414643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:20.414643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:20.414643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:20.414643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:20.414643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:45:20.414643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:45:20.414643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:45:20.414643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:45:20.414643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:45:20.414643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:45:20.414643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:45:20.414643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:20.414643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 430/859] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:45:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:20.420363 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db360e6-5c30-4456-a16d-2c1e187ee6f3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:20.523009 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db360e6-5c30-4456-a16d-2c1e187ee6f3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:20.557998 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38176e6e-6730-4d81-a113-04f91964db2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:20.558619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38176e6e-6730-4d81-a113-04f91964db2b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:20.558897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38176e6e-6730-4d81-a113-04f91964db2b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:20.559168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38176e6e-6730-4d81-a113-04f91964db2b None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:20.559904 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38176e6e-6730-4d81-a113-04f91964db2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:20.560207 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38176e6e-6730-4d81-a113-04f91964db2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:20.561912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38176e6e-6730-4d81-a113-04f91964db2b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:20.570977 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 430/860] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:45:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:20.576652 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c7255-29f1-41f6-bca0-b3e2c62b982e None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:20.684243 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c7255-29f1-41f6-bca0-b3e2c62b982e None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:20.715163 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:20.723798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc5273-937a-4ec1-8329-17da11529ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:20.724660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc5273-937a-4ec1-8329-17da11529ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:20.725119 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc5273-937a-4ec1-8329-17da11529ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:20.725561 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc5273-937a-4ec1-8329-17da11529ac1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:20.736840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc5273-937a-4ec1-8329-17da11529ac1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:20.738295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc5273-937a-4ec1-8329-17da11529ac1 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:20.752812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-e7bc5273-937a-4ec1-8329-17da11529ac1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:20.752812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:20.752812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:20.752812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:20.752812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:20.752812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:20.752812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:20.752812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:20.752812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:20.752812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:20.752812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:20.752812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:20.752812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:20.752812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:20.752812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:20.752812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:20.753757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:20.753757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:20.753757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:20.753757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:20.753757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:20.753757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:20.753757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:20.753757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:20.753757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:20.753757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:20.753757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:20.753757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:20.753757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:20.753757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:20.753757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:20.753757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:20.753757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:20.754643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:20.754643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:20.754643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:20.754643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 431/861] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:20.760694 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38176e6e-6730-4d81-a113-04f91964db2b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:20.812081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:20.856381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a9e9b-6605-4177-9f14-f7063080a458 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:20.856948 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a9e9b-6605-4177-9f14-f7063080a458 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:20.857416 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a9e9b-6605-4177-9f14-f7063080a458 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:20.859285 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 432/862] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:45:20.864218 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38176e6e-6730-4d81-a113-04f91964db2b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:20.864453 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12563c98-2ac7-421f-970f-7912481e8c67 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:20.864903 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12563c98-2ac7-421f-970f-7912481e8c67 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:20.865344 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12563c98-2ac7-421f-970f-7912481e8c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:20.883768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-12563c98-2ac7-421f-970f-7912481e8c67 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:20.885219 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-12563c98-2ac7-421f-970f-7912481e8c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:20.899561 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010537e1-4f26-489f-998d-a2c663c2db20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:20.900182 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010537e1-4f26-489f-998d-a2c663c2db20 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:20.900462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010537e1-4f26-489f-998d-a2c663c2db20 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:20.900732 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010537e1-4f26-489f-998d-a2c663c2db20 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:20.901371 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010537e1-4f26-489f-998d-a2c663c2db20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:20.901675 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010537e1-4f26-489f-998d-a2c663c2db20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:20.903161 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010537e1-4f26-489f-998d-a2c663c2db20 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:20.916572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 431/863] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:20.922367 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010537e1-4f26-489f-998d-a2c663c2db20 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:20.962163 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 433/864] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:45:21.024106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010537e1-4f26-489f-998d-a2c663c2db20 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:21.034373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:21.062698 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7ead8-dfcf-4b0e-86bc-24784e40ee79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:21.063268 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7ead8-dfcf-4b0e-86bc-24784e40ee79 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:21.063577 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7ead8-dfcf-4b0e-86bc-24784e40ee79 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:21.063851 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7ead8-dfcf-4b0e-86bc-24784e40ee79 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:21.071552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7ead8-dfcf-4b0e-86bc-24784e40ee79 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:21.073014 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7ead8-dfcf-4b0e-86bc-24784e40ee79 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:21.085996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-5ad7ead8-dfcf-4b0e-86bc-24784e40ee79 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:45:21.085996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:21.085996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:21.085996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:21.085996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:21.085996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:21.085996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:21.085996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:21.085996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:21.085996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:21.085996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:21.085996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:21.085996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:45:21.085996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:45:21.085996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:45:21.085996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:45:21.086948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:21.086948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:21.086948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:45:21.086948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:21.086948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:45:21.086948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:21.086948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:21.086948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:21.086948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:21.086948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:21.086948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:21.086948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:21.086948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:21.086948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:21.086948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:21.086948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:21.086948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:21.086948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:21.087922 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:21.087922 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:21.087922 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:45:21.087922 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:45:21.087922 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:45:21.087922 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:45:21.087922 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:45:21.087922 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:45:21.087922 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 11:45:21.087922 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:21.087922 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 432/865] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:45:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:21.093966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12563c98-2ac7-421f-970f-7912481e8c67 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:21.202255 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12563c98-2ac7-421f-970f-7912481e8c67 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:21.213012 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:21.238004 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a70cc7-72b2-4dd8-8667-fab622ed5c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:21.238621 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a70cc7-72b2-4dd8-8667-fab622ed5c24 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:21.238891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a70cc7-72b2-4dd8-8667-fab622ed5c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:21.239158 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a70cc7-72b2-4dd8-8667-fab622ed5c24 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:21.239915 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a70cc7-72b2-4dd8-8667-fab622ed5c24 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:21.240216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a70cc7-72b2-4dd8-8667-fab622ed5c24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:21.241653 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a70cc7-72b2-4dd8-8667-fab622ed5c24 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:21.263730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 434/866] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Aug 30 11:45:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:21.269204 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7ead8-dfcf-4b0e-86bc-24784e40ee79 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:21.271408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a70cc7-72b2-4dd8-8667-fab622ed5c24 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:21.377931 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a70cc7-72b2-4dd8-8667-fab622ed5c24 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:21.382871 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7ead8-dfcf-4b0e-86bc-24784e40ee79 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:21.414144 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8223b-4ad7-4484-9378-a56a5e08d0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:21.414690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8223b-4ad7-4484-9378-a56a5e08d0f9 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:21.414967 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8223b-4ad7-4484-9378-a56a5e08d0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:21.415237 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8223b-4ad7-4484-9378-a56a5e08d0f9 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:21.415927 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8223b-4ad7-4484-9378-a56a5e08d0f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:21.417405 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8223b-4ad7-4484-9378-a56a5e08d0f9 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:21.419961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe826b-5f63-4875-ac63-7bdcd983d612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:21.420895 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe826b-5f63-4875-ac63-7bdcd983d612 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:21.421836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe826b-5f63-4875-ac63-7bdcd983d612 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:21.422308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe826b-5f63-4875-ac63-7bdcd983d612 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:21.438040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 435/867] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Aug 30 11:45:21 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:45:21.472347 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:21.478425 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d66bf0-7e3c-441e-9c52-96ce4422f542 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:21.478740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d66bf0-7e3c-441e-9c52-96ce4422f542 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:21.478977 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d66bf0-7e3c-441e-9c52-96ce4422f542 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:21.480719 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 436/868] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:21.486715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa7571-eef5-44f8-8213-f276b79c3cf5 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:21.487005 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa7571-eef5-44f8-8213-f276b79c3cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:21.487274 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa7571-eef5-44f8-8213-f276b79c3cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:21.509234 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-68fa7571-eef5-44f8-8213-f276b79c3cf5 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:21.510503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-68fa7571-eef5-44f8-8213-f276b79c3cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:21.518598 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe826b-5f63-4875-ac63-7bdcd983d612 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:21.520689 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe826b-5f63-4875-ac63-7bdcd983d612 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:21.543802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:21.596913 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 437/869] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:21 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:21.598456 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90058d3e-ae16-4438-9e6b-8b0029806cdd None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:21.598791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90058d3e-ae16-4438-9e6b-8b0029806cdd None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:21.599151 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90058d3e-ae16-4438-9e6b-8b0029806cdd None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:21.600714 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 438/870] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:21.605829 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28a372-65f6-43de-bdc8-a119d8151179 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:21.606116 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28a372-65f6-43de-bdc8-a119d8151179 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:21.606440 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28a372-65f6-43de-bdc8-a119d8151179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:21.626264 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-0e28a372-65f6-43de-bdc8-a119d8151179 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:21.627736 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0e28a372-65f6-43de-bdc8-a119d8151179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:21.656749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 433/871] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:45:21 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:45:21.663276 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe826b-5f63-4875-ac63-7bdcd983d612 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:21.708122 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 439/872] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:21 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:21.741630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:21.776326 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe826b-5f63-4875-ac63-7bdcd983d612 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:21.811780 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1190a9a-3615-4237-a00e-2d8d94ed632b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:21.812424 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1190a9a-3615-4237-a00e-2d8d94ed632b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:21.812705 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1190a9a-3615-4237-a00e-2d8d94ed632b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:21.812982 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1190a9a-3615-4237-a00e-2d8d94ed632b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:21.823253 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1190a9a-3615-4237-a00e-2d8d94ed632b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:21.824742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1190a9a-3615-4237-a00e-2d8d94ed632b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:21.839967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-b1190a9a-3615-4237-a00e-2d8d94ed632b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:21.839967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:21.839967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:21.839967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:21.839967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:21.839967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:21.839967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:21.839967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:21.839967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:21.839967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:21.839967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:21.839967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:21.839967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:21.839967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:21.839967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:21.839967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:21.840939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:21.840939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:21.840939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:21.840939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:21.840939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:21.840939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:21.840939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:21.840939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:21.840939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:21.840939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:21.840939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:21.840939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:21.840939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:21.840939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:21.840939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:21.840939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:21.840939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:21.842393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:21.842393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:21.842393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:21.842393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 434/873] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:21.847847 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28a372-65f6-43de-bdc8-a119d8151179 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:21.865943 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1190a9a-3615-4237-a00e-2d8d94ed632b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:21.941953 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:21.961173 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28a372-65f6-43de-bdc8-a119d8151179 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:21.993404 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1190a9a-3615-4237-a00e-2d8d94ed632b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:22.003852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119b05d-063a-480f-9e2c-1c126b17b3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:22.004601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119b05d-063a-480f-9e2c-1c126b17b3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:22.004883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119b05d-063a-480f-9e2c-1c126b17b3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:22.005157 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119b05d-063a-480f-9e2c-1c126b17b3a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:22.005809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119b05d-063a-480f-9e2c-1c126b17b3a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:22.006131 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119b05d-063a-480f-9e2c-1c126b17b3a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:22.007666 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119b05d-063a-480f-9e2c-1c126b17b3a9 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:22.016026 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:22.020434 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 440/874] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:22.023729 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119b05d-063a-480f-9e2c-1c126b17b3a9 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:22.034563 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc493b4-8935-4531-9565-c7dee99bfe4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:22.035196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc493b4-8935-4531-9565-c7dee99bfe4c None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:22.035500 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc493b4-8935-4531-9565-c7dee99bfe4c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:22.035767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc493b4-8935-4531-9565-c7dee99bfe4c None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:22.036417 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc493b4-8935-4531-9565-c7dee99bfe4c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:22.037798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc493b4-8935-4531-9565-c7dee99bfe4c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:22.055437 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 435/875] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Aug 30 11:45:21 2022] POST /identity/v3/services => generated 269 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:45:22.055437 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc493b4-8935-4531-9565-c7dee99bfe4c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:22.159530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119b05d-063a-480f-9e2c-1c126b17b3a9 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:22.182707 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc493b4-8935-4531-9565-c7dee99bfe4c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:22.200829 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052db4a3-15ad-4296-b5f8-23ef674b5d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:22.201444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052db4a3-15ad-4296-b5f8-23ef674b5d9a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:22.201815 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052db4a3-15ad-4296-b5f8-23ef674b5d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:22.202286 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052db4a3-15ad-4296-b5f8-23ef674b5d9a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:22.214535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052db4a3-15ad-4296-b5f8-23ef674b5d9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:45:22.222157 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-052db4a3-15ad-4296-b5f8-23ef674b5d9a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:45:22.222157 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:22.222157 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:22.222157 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:22.222157 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:22.222157 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:22.222157 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:22.222157 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:22.222157 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:22.222157 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:22.222157 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:22.222157 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:22.222157 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:45:22.222157 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:45:22.222157 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:45:22.222157 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:45:22.223073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:45:22.223073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:45:22.223073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:45:22.223073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:45:22.223073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:22.223073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:22.223073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:22.223073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:22.223073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:22.223073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:22.223073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:22.223073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:22.223073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:22.223073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:22.223073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:22.223073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:22.223984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:22.223984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:22.223984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:22.223984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:22.223984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:45:22.223984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:45:22.223984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:45:22.223984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:45:22.223984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:45:22.223984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:45:22.223984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:45:22.223984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:22.223984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 441/876] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Aug 30 11:45:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:22.226006 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76e166-99bb-470e-be99-9960e29bc0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:22.226232 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76e166-99bb-470e-be99-9960e29bc0b1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:22.226510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76e166-99bb-470e-be99-9960e29bc0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:22.226778 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76e166-99bb-470e-be99-9960e29bc0b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:22.229523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052db4a3-15ad-4296-b5f8-23ef674b5d9a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:22.233981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:22.236303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76e166-99bb-470e-be99-9960e29bc0b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:22.238654 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76e166-99bb-470e-be99-9960e29bc0b1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:22.251449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-dd76e166-99bb-470e-be99-9960e29bc0b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:22.251449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:22.251449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:22.251449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:22.251449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:22.251449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:22.251449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:22.251449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:22.251449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:22.251449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:22.251449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:22.251449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:22.251449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:45:22.251449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:45:22.251449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:45:22.252386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:45:22.252386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:22.252386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:22.252386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:22.252386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:22.252386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:22.252386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:22.252386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:22.252386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:22.252386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:22.252386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:22.252386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:22.252386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:22.252386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:22.252386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:22.252386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:22.252386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:22.253283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:45:22.253283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:45:22.253283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:45:22.253283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:45:22.253283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:45:22.253283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:45:22.253283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:22.253283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:22.253283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 436/877] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:22.258529 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76e166-99bb-470e-be99-9960e29bc0b1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:22.314473 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:22.369406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052db4a3-15ad-4296-b5f8-23ef674b5d9a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:22.395116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76e166-99bb-470e-be99-9960e29bc0b1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:22.412605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e05c54-d188-44e1-a59f-4672cd3b4c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:22.413258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e05c54-d188-44e1-a59f-4672cd3b4c5a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:22.413529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e05c54-d188-44e1-a59f-4672cd3b4c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:22.413758 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e05c54-d188-44e1-a59f-4672cd3b4c5a None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:22.414590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e05c54-d188-44e1-a59f-4672cd3b4c5a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:22.414899 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e05c54-d188-44e1-a59f-4672cd3b4c5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:22.416851 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e05c54-d188-44e1-a59f-4672cd3b4c5a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:22.431402 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 442/878] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Aug 30 11:45:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:22.432711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e05c54-d188-44e1-a59f-4672cd3b4c5a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:22.441916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e4d69-50ab-4f8c-9227-b2bcc9c4184a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:22.442599 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e4d69-50ab-4f8c-9227-b2bcc9c4184a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:22.442882 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e4d69-50ab-4f8c-9227-b2bcc9c4184a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:22.443159 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e4d69-50ab-4f8c-9227-b2bcc9c4184a None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:22.443928 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e4d69-50ab-4f8c-9227-b2bcc9c4184a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:22.444233 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e4d69-50ab-4f8c-9227-b2bcc9c4184a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:22.446811 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e4d69-50ab-4f8c-9227-b2bcc9c4184a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:22.464887 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 437/879] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:45:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:22.470480 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e4d69-50ab-4f8c-9227-b2bcc9c4184a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:22.521558 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:22.569447 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e05c54-d188-44e1-a59f-4672cd3b4c5a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:22.576679 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:22.583517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e4d69-50ab-4f8c-9227-b2bcc9c4184a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:22.620304 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005eb93-821a-4f2d-a22a-f619d2b8d604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:22.621963 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005eb93-821a-4f2d-a22a-f619d2b8d604 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:22.622708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005eb93-821a-4f2d-a22a-f619d2b8d604 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:22.623267 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005eb93-821a-4f2d-a22a-f619d2b8d604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:22.631699 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c57ce3-bec0-49e2-a8a7-26d25687d8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:22.632770 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c57ce3-bec0-49e2-a8a7-26d25687d8cf None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:22.633248 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c57ce3-bec0-49e2-a8a7-26d25687d8cf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:22.633715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c57ce3-bec0-49e2-a8a7-26d25687d8cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:22.634763 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c57ce3-bec0-49e2-a8a7-26d25687d8cf None admin] RBAC: Adding query filter params (role.id=4f4d8a6881ca496bb2d4845a6592fea8, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=8d27bfb8c0b64763b7db7cffa5f230f6) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:22.635141 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c57ce3-bec0-49e2-a8a7-26d25687d8cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:22.636692 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c57ce3-bec0-49e2-a8a7-26d25687d8cf None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:22.637341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005eb93-821a-4f2d-a22a-f619d2b8d604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:22.639017 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005eb93-821a-4f2d-a22a-f619d2b8d604 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:22.651395 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 438/880] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:45:22 2022] GET /identity/v3/role_assignments?user.id=8d27bfb8c0b64763b7db7cffa5f230f6&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=4f4d8a6881ca496bb2d4845a6592fea8 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:22.659820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-1005eb93-821a-4f2d-a22a-f619d2b8d604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:22.659820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:22.659820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:22.659820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:22.659820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:22.659820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:22.659820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:22.659820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:22.659820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:22.659820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:22.659820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:22.659820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:22.659820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:22.659820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:22.659820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:22.659820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:22.660852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:22.660852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:22.660852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:22.660852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:22.660852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:22.660852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:22.660852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:22.660852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:22.660852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:22.660852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:22.660852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:22.660852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:22.660852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:22.660852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:22.660852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:22.660852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:22.660852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:22.661731 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:22.661731 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:22.661731 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:22.661731 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 443/881] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:22.669045 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c57ce3-bec0-49e2-a8a7-26d25687d8cf None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:22.815871 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c57ce3-bec0-49e2-a8a7-26d25687d8cf None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:22.855342 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44225ee-f070-4a95-9187-5c2949a81875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:22.856001 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44225ee-f070-4a95-9187-5c2949a81875 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:22.856278 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44225ee-f070-4a95-9187-5c2949a81875 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:22.856546 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44225ee-f070-4a95-9187-5c2949a81875 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:22.857181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44225ee-f070-4a95-9187-5c2949a81875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:22.857479 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44225ee-f070-4a95-9187-5c2949a81875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:22.859072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44225ee-f070-4a95-9187-5c2949a81875 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:22.872875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 439/882] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:22.879007 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005eb93-821a-4f2d-a22a-f619d2b8d604 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:23.006406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005eb93-821a-4f2d-a22a-f619d2b8d604 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:23.025322 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:23.045297 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281bef7-301f-436f-bb7c-02b343479a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:23.046474 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281bef7-301f-436f-bb7c-02b343479a1b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:23.047077 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281bef7-301f-436f-bb7c-02b343479a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:23.047810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281bef7-301f-436f-bb7c-02b343479a1b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:23.056865 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281bef7-301f-436f-bb7c-02b343479a1b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:23.058358 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281bef7-301f-436f-bb7c-02b343479a1b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:23.072422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-b281bef7-301f-436f-bb7c-02b343479a1b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:45:23.072422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:23.072422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:23.072422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:23.072422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:23.072422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:23.072422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:23.072422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:23.072422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:23.072422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:23.072422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:23.072422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:23.072422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:45:23.072422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:45:23.072422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:45:23.072422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:45:23.073388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:23.073388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:23.073388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:45:23.073388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:23.073388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:45:23.073388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:23.073388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:23.073388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:23.073388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:23.073388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:23.073388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:23.073388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:23.073388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:23.073388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:23.073388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:23.073388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:23.073388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:23.073388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:23.074412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:23.074412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:23.074412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:45:23.074412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:45:23.074412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:45:23.074412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:45:23.074412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:45:23.074412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:45:23.074412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:45:23.074412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:23.074412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 444/883] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Aug 30 11:45:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:23.081435 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44225ee-f070-4a95-9187-5c2949a81875 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:23.120498 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:23.217172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44225ee-f070-4a95-9187-5c2949a81875 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:23.257630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51bfd4-771f-4719-a598-185144dcd40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:23.258512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51bfd4-771f-4719-a598-185144dcd40c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:23.258961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51bfd4-771f-4719-a598-185144dcd40c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:23.259537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51bfd4-771f-4719-a598-185144dcd40c None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:23.260411 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51bfd4-771f-4719-a598-185144dcd40c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:23.260854 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51bfd4-771f-4719-a598-185144dcd40c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:23.262445 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51bfd4-771f-4719-a598-185144dcd40c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:23.283103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 440/884] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Aug 30 11:45:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:23.291439 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281bef7-301f-436f-bb7c-02b343479a1b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:23.413466 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281bef7-301f-436f-bb7c-02b343479a1b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:23.451893 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8599c-d83d-4cb9-a134-673304744667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:23.452686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8599c-d83d-4cb9-a134-673304744667 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:23.453031 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8599c-d83d-4cb9-a134-673304744667 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:23.453312 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8599c-d83d-4cb9-a134-673304744667 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:23.492583 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7176ad-266b-4f10-af46-be29e421085f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:23.493102 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7176ad-266b-4f10-af46-be29e421085f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:23.493102 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7176ad-266b-4f10-af46-be29e421085f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:23.495903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 441/885] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:23.500269 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc370ce-d134-4aba-b618-5b2afd5fdfe2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:23.500552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc370ce-d134-4aba-b618-5b2afd5fdfe2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:23.500826 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc370ce-d134-4aba-b618-5b2afd5fdfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:23.517329 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:23.525811 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-dbc370ce-d134-4aba-b618-5b2afd5fdfe2 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:23.527294 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dbc370ce-d134-4aba-b618-5b2afd5fdfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:23.536785 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8599c-d83d-4cb9-a134-673304744667 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:23.538005 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8599c-d83d-4cb9-a134-673304744667 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:23.604304 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 442/886] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:45:23.667742 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 445/887] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:45:23 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:45:23.669329 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc370ce-d134-4aba-b618-5b2afd5fdfe2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:23.680298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:23.772744 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc370ce-d134-4aba-b618-5b2afd5fdfe2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:23.808383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d514fb8-bb2e-4809-85cc-2ede61268daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:23.809116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d514fb8-bb2e-4809-85cc-2ede61268daf None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:23.809390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d514fb8-bb2e-4809-85cc-2ede61268daf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:23.809656 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d514fb8-bb2e-4809-85cc-2ede61268daf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:23.820534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d514fb8-bb2e-4809-85cc-2ede61268daf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:23.821999 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d514fb8-bb2e-4809-85cc-2ede61268daf None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:23.837774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-2d514fb8-bb2e-4809-85cc-2ede61268daf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:23.837774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:23.837774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:23.837774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:23.837774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:23.837774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:23.837774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:23.837774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:23.837774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:23.837774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:23.837774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:23.837774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:23.837774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:23.837774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:23.837774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:23.837774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:23.840335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:23.840335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:23.840335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:23.840335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:23.840335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:23.840335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:23.840335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:23.840335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:23.840335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:23.840335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:23.840335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:23.840335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:23.840335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:23.840335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:23.840335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:23.840335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:23.840335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:23.842340 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:23.842340 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:23.842340 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:23.842340 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 443/888] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:23.845592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8599c-d83d-4cb9-a134-673304744667 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:23.901430 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d514fb8-bb2e-4809-85cc-2ede61268daf None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:23.930812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:23.954526 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8599c-d83d-4cb9-a134-673304744667 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:23.968623 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:23.993790 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d48b8c-daa1-47f6-a42c-8ce3d8e32d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:23.994455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d48b8c-daa1-47f6-a42c-8ce3d8e32d88 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:23.994736 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d48b8c-daa1-47f6-a42c-8ce3d8e32d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:23.995004 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d48b8c-daa1-47f6-a42c-8ce3d8e32d88 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:23.995668 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d48b8c-daa1-47f6-a42c-8ce3d8e32d88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:23.995969 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d48b8c-daa1-47f6-a42c-8ce3d8e32d88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:23.997369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d48b8c-daa1-47f6-a42c-8ce3d8e32d88 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:24.009776 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 446/889] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:24.015245 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d48b8c-daa1-47f6-a42c-8ce3d8e32d88 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:24.016509 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d514fb8-bb2e-4809-85cc-2ede61268daf None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:24.054553 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c60fa-4f72-450e-8757-65636b4f7913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:24.055191 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c60fa-4f72-450e-8757-65636b4f7913 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:24.055499 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c60fa-4f72-450e-8757-65636b4f7913 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:24.055773 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c60fa-4f72-450e-8757-65636b4f7913 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:24.056359 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c60fa-4f72-450e-8757-65636b4f7913 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:24.057832 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c60fa-4f72-450e-8757-65636b4f7913 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:24.067372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-b95c60fa-4f72-450e-8757-65636b4f7913 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 11:45:24.067372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:24.067372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:45:24.067372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:45:24.067372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:45:24.067372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:45:24.067372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:45:24.067372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:24.067372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 11:45:24.067372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:24.067372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:24.067372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:24.067372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:24.067372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:24.067372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:24.067372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:24.067372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:24.069537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:24.069537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:24.069537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:24.069537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:24.069537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:24.069537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:24.069537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:45:24.069537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:45:24.069537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:45:24.069537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:45:24.069537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:24.069537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:24.069537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:24.069537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:24.069537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:24.069537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:24.071444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:24.071444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:24.071444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:24.071444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:24.071444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:24.071444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:24.071444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:24.071444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:24.071444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:24.071444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:24.071444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:45:24.071444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:24.071444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 11:45:24.071444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:24.079461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 444/890] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Aug 30 11:45:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:24.079461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c60fa-4f72-450e-8757-65636b4f7913 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:24.125851 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d48b8c-daa1-47f6-a42c-8ce3d8e32d88 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:24.161695 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25ee99-6e89-437e-a045-bee04e8b6e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:24.162790 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25ee99-6e89-437e-a045-bee04e8b6e66 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:24.163264 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25ee99-6e89-437e-a045-bee04e8b6e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:24.163652 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25ee99-6e89-437e-a045-bee04e8b6e66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:24.170637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25ee99-6e89-437e-a045-bee04e8b6e66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:24.172122 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25ee99-6e89-437e-a045-bee04e8b6e66 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:24.173865 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:24.184058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-fe25ee99-6e89-437e-a045-bee04e8b6e66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:24.184058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:24.184058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:24.184058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:24.184058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:24.184058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:24.184058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:24.184058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:24.184058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:24.184058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:24.184058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:24.184058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:24.184058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:45:24.184058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:45:24.184058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:45:24.185993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:45:24.185993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:24.185993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:24.185993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:24.185993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:24.185993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:24.185993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:24.185993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:24.185993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:24.185993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:24.185993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:24.185993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:24.185993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:24.185993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:24.185993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:24.185993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:24.185993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:24.188435 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:45:24.188435 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:45:24.188435 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:45:24.188435 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:45:24.188435 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:45:24.188435 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:45:24.188435 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:24.188435 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:24.189385 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c60fa-4f72-450e-8757-65636b4f7913 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:24.189534 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 447/891] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:24.195429 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25ee99-6e89-437e-a045-bee04e8b6e66 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:24.213909 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:24.225622 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fa934-165f-4bff-a969-3cfb4a3f19e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:24.226241 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fa934-165f-4bff-a969-3cfb4a3f19e3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:24.226672 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fa934-165f-4bff-a969-3cfb4a3f19e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:24.226944 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fa934-165f-4bff-a969-3cfb4a3f19e3 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:24.228426 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fa934-165f-4bff-a969-3cfb4a3f19e3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:24.228732 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fa934-165f-4bff-a969-3cfb4a3f19e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:24.230106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fa934-165f-4bff-a969-3cfb4a3f19e3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:24.235400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 445/892] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Aug 30 11:45:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:24.236647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574413f6-ff9d-4a95-b438-16e15cb9e2b5 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:24.236921 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574413f6-ff9d-4a95-b438-16e15cb9e2b5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:24.237193 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574413f6-ff9d-4a95-b438-16e15cb9e2b5 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:24.238507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 446/893] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:24.243111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574413f6-ff9d-4a95-b438-16e15cb9e2b5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:24.302860 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25ee99-6e89-437e-a045-bee04e8b6e66 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:24.337920 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47edac-ad70-4898-8f14-0d8a03d28a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:24.338949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47edac-ad70-4898-8f14-0d8a03d28a20 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:24.339222 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47edac-ad70-4898-8f14-0d8a03d28a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:24.339517 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47edac-ad70-4898-8f14-0d8a03d28a20 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:24.340201 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47edac-ad70-4898-8f14-0d8a03d28a20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:24.340500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47edac-ad70-4898-8f14-0d8a03d28a20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:24.342001 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47edac-ad70-4898-8f14-0d8a03d28a20 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:24.351579 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574413f6-ff9d-4a95-b438-16e15cb9e2b5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:24.354761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 448/894] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:45:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:24.355989 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d566d88-47b4-43d9-8996-23977c8562fb None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:24.356272 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d566d88-47b4-43d9-8996-23977c8562fb None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:24.356540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d566d88-47b4-43d9-8996-23977c8562fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:24.374620 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-8d566d88-47b4-43d9-8996-23977c8562fb None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:24.375834 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8d566d88-47b4-43d9-8996-23977c8562fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:24.394196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359829ad-7f5e-4950-85d0-cfbb84dde225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:24.394820 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359829ad-7f5e-4950-85d0-cfbb84dde225 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:24.395097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359829ad-7f5e-4950-85d0-cfbb84dde225 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:24.395381 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359829ad-7f5e-4950-85d0-cfbb84dde225 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:24.396027 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359829ad-7f5e-4950-85d0-cfbb84dde225 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:24.396753 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359829ad-7f5e-4950-85d0-cfbb84dde225 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:24.398133 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359829ad-7f5e-4950-85d0-cfbb84dde225 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:24.403778 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 447/895] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Aug 30 11:45:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:24.404576 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359829ad-7f5e-4950-85d0-cfbb84dde225 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:24.436664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:24.450863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 449/896] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:24.451723 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d566d88-47b4-43d9-8996-23977c8562fb None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:24.463678 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:24.513282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359829ad-7f5e-4950-85d0-cfbb84dde225 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:24.551008 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c657466-92eb-43ae-bd5c-8a9eb9a52a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:24.551710 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c657466-92eb-43ae-bd5c-8a9eb9a52a80 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:24.551987 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c657466-92eb-43ae-bd5c-8a9eb9a52a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:24.552257 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c657466-92eb-43ae-bd5c-8a9eb9a52a80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:24.553081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c657466-92eb-43ae-bd5c-8a9eb9a52a80 None admin] RBAC: Adding query filter params (role.id=8c34d24ef14b407f81bb5fb31973ddb0, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=58c86110ce97463e9b3d53691ae3e12c) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:24.553274 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c657466-92eb-43ae-bd5c-8a9eb9a52a80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:24.554832 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c657466-92eb-43ae-bd5c-8a9eb9a52a80 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:24.567950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 448/897] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:45:24 2022] GET /identity/v3/role_assignments?user.id=58c86110ce97463e9b3d53691ae3e12c&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=8c34d24ef14b407f81bb5fb31973ddb0 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:24.582652 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d566d88-47b4-43d9-8996-23977c8562fb None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:24.622835 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ef486-ba1a-489e-ad17-644069586e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:24.623928 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ef486-ba1a-489e-ad17-644069586e6d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:24.624597 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ef486-ba1a-489e-ad17-644069586e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:24.625126 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ef486-ba1a-489e-ad17-644069586e6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:24.626058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ef486-ba1a-489e-ad17-644069586e6d None admin] RBAC: Adding query filter params (interface=public, service_id=6a2c2fea23bf4665ba982ff62688c035, region_id=RegionOne) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:24.626574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ef486-ba1a-489e-ad17-644069586e6d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:24.628248 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ef486-ba1a-489e-ad17-644069586e6d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:24.634886 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 450/898] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Aug 30 11:45:24 2022] GET /identity/v3/endpoints?service_id=6a2c2fea23bf4665ba982ff62688c035&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:24.640603 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c657466-92eb-43ae-bd5c-8a9eb9a52a80 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:24.723821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ef486-ba1a-489e-ad17-644069586e6d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:24.756818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c657466-92eb-43ae-bd5c-8a9eb9a52a80 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:24.774323 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:24.792820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:24.794028 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4764a11-0425-4940-a38d-cae1e7e03840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:24.794811 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4764a11-0425-4940-a38d-cae1e7e03840 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:24.795256 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4764a11-0425-4940-a38d-cae1e7e03840 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:24.796037 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4764a11-0425-4940-a38d-cae1e7e03840 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:24.796948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4764a11-0425-4940-a38d-cae1e7e03840 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:24.798334 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4764a11-0425-4940-a38d-cae1e7e03840 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:24.804810 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 449/899] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Aug 30 11:45:24 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:45:24.814382 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df8a85-491b-4f10-88bb-a2c0f71f3d0d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:24.814714 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df8a85-491b-4f10-88bb-a2c0f71f3d0d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:24.814948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df8a85-491b-4f10-88bb-a2c0f71f3d0d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:24.820649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 450/900] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:24.823898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731604c0-192c-4ff4-aca7-0aba561488cc None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:24.823898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731604c0-192c-4ff4-aca7-0aba561488cc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:24.823898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731604c0-192c-4ff4-aca7-0aba561488cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:24.844207 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-731604c0-192c-4ff4-aca7-0aba561488cc None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:24.845437 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-731604c0-192c-4ff4-aca7-0aba561488cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:24.861327 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ef486-ba1a-489e-ad17-644069586e6d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:24.915018 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25206229-f60a-4231-bac8-1e5d7335559d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:24.915707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25206229-f60a-4231-bac8-1e5d7335559d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:24.916016 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25206229-f60a-4231-bac8-1e5d7335559d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:24.917895 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25206229-f60a-4231-bac8-1e5d7335559d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:24.918517 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25206229-f60a-4231-bac8-1e5d7335559d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:24.920273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25206229-f60a-4231-bac8-1e5d7335559d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:24.931392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-25206229-f60a-4231-bac8-1e5d7335559d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 11:45:24.931392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:24.931392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:45:24.931392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:45:24.931392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:45:24.931392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:45:24.931392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:45:24.931392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:24.931392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 11:45:24.931392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:24.931392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:24.931392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:24.931392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:24.931392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:24.931392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:24.931392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:24.932546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:24.932546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:24.932546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:24.932546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:24.932546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:24.932546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:24.932546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:24.932546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:45:24.932546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:45:24.932546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:45:24.932546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:45:24.932546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:24.932546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:24.932546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:24.932546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:24.932546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:24.932546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:24.933664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:24.933664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:24.933664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:24.933664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:24.933664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:24.933664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:24.933664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:24.933664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:24.933664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:24.933664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:24.933664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:45:24.933664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:24.933664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 11:45:24.933664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:24.935119 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 451/901] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:24.935254 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 451/902] 10.222.0.27 () {56 vars in 1132 bytes} [Tue Aug 30 11:45:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:24.940523 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731604c0-192c-4ff4-aca7-0aba561488cc None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:25.048971 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731604c0-192c-4ff4-aca7-0aba561488cc None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:25.060542 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:25.086820 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a98eb-8130-4363-8bcf-8e9ae54ca3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:25.087465 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a98eb-8130-4363-8bcf-8e9ae54ca3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:25.087745 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a98eb-8130-4363-8bcf-8e9ae54ca3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:25.088009 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a98eb-8130-4363-8bcf-8e9ae54ca3a7 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:25.088999 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a98eb-8130-4363-8bcf-8e9ae54ca3a7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:25.089293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a98eb-8130-4363-8bcf-8e9ae54ca3a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:25.090661 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a98eb-8130-4363-8bcf-8e9ae54ca3a7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:25.095910 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 452/903] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Aug 30 11:45:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:25.101593 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25206229-f60a-4231-bac8-1e5d7335559d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:25.204897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a98eb-8130-4363-8bcf-8e9ae54ca3a7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:25.209501 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25206229-f60a-4231-bac8-1e5d7335559d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:25.230656 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:25.251345 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7ae4d-0ddd-4e4d-8861-085bc8cbd9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:25.252000 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7ae4d-0ddd-4e4d-8861-085bc8cbd9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:25.252273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7ae4d-0ddd-4e4d-8861-085bc8cbd9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:25.252538 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7ae4d-0ddd-4e4d-8861-085bc8cbd9a4 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:25.253162 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7ae4d-0ddd-4e4d-8861-085bc8cbd9a4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:25.253458 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7ae4d-0ddd-4e4d-8861-085bc8cbd9a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:25.254903 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7ae4d-0ddd-4e4d-8861-085bc8cbd9a4 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:25.260438 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 452/904] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Aug 30 11:45:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:25.266500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7ae4d-0ddd-4e4d-8861-085bc8cbd9a4 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:25.333792 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a98eb-8130-4363-8bcf-8e9ae54ca3a7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:25.371153 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fd777-95a6-4989-b490-fdac4aae97d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:25.372074 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fd777-95a6-4989-b490-fdac4aae97d4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:25.372815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fd777-95a6-4989-b490-fdac4aae97d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:25.373106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fd777-95a6-4989-b490-fdac4aae97d4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:25.374037 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fd777-95a6-4989-b490-fdac4aae97d4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:25.375454 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fd777-95a6-4989-b490-fdac4aae97d4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:25.375672 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7ae4d-0ddd-4e4d-8861-085bc8cbd9a4 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:25.387343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-453fd777-95a6-4989-b490-fdac4aae97d4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:45:25.387343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:25.387343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:45:25.387343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:45:25.387343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:45:25.387343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:45:25.387343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:45:25.387343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:25.387343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:45:25.387343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:25.387343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:25.387343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:25.387343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:25.387343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:25.387343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:25.387343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:25.387343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:25.389402 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:25.389402 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:25.389402 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:25.389402 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:25.389402 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:25.389402 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:25.389402 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:45:25.389402 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:45:25.389402 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:45:25.389402 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:45:25.389402 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:25.389402 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:25.389402 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:25.389402 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:25.389402 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:25.389402 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:25.390522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:25.390522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:25.390522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:25.390522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:25.390522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:25.390522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:25.390522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:25.390522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:25.390522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:25.390522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:25.390522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:45:25.390522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:25.390522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:45:25.390522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:25.390522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 453/905] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Aug 30 11:45:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:25.394823 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fd777-95a6-4989-b490-fdac4aae97d4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:25.427682 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cf91e-d810-4344-8520-f2131a5d5caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:25.428992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cf91e-d810-4344-8520-f2131a5d5caf None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:25.429281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cf91e-d810-4344-8520-f2131a5d5caf None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:25.429556 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cf91e-d810-4344-8520-f2131a5d5caf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:25.430536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cf91e-d810-4344-8520-f2131a5d5caf None admin] RBAC: Adding query filter params (interface=public, service_id=a067614af3754dacac70fb9744ca2438, region_id=RegionOne) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:25.430902 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cf91e-d810-4344-8520-f2131a5d5caf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:25.433226 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cf91e-d810-4344-8520-f2131a5d5caf None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:25.440572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 453/906] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Aug 30 11:45:25 2022] GET /identity/v3/endpoints?service_id=a067614af3754dacac70fb9744ca2438&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:25.448327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:25.449175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cf91e-d810-4344-8520-f2131a5d5caf None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:25.504662 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:25.520509 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fd777-95a6-4989-b490-fdac4aae97d4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:25.557679 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81423e0-b371-41a2-991e-54a841b86d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:25.558432 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81423e0-b371-41a2-991e-54a841b86d7a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:25.558711 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81423e0-b371-41a2-991e-54a841b86d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:25.559082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81423e0-b371-41a2-991e-54a841b86d7a None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:25.559742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81423e0-b371-41a2-991e-54a841b86d7a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:25.560044 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81423e0-b371-41a2-991e-54a841b86d7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:25.561729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81423e0-b371-41a2-991e-54a841b86d7a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:25.571748 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 454/907] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Aug 30 11:45:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:25.572748 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81423e0-b371-41a2-991e-54a841b86d7a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:25.575182 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cf91e-d810-4344-8520-f2131a5d5caf None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:25.619042 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21c653-33d3-4f36-beec-05aacd43171a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:25.619602 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21c653-33d3-4f36-beec-05aacd43171a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:25.619879 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21c653-33d3-4f36-beec-05aacd43171a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:25.620149 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21c653-33d3-4f36-beec-05aacd43171a None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:25.621161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21c653-33d3-4f36-beec-05aacd43171a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:25.622821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21c653-33d3-4f36-beec-05aacd43171a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:25.631168 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 454/908] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Aug 30 11:45:25 2022] GET /identity/v3/services => generated 1268 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:45:25.696481 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81423e0-b371-41a2-991e-54a841b86d7a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:25.698666 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:25.738014 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a943d61-75a9-4652-a0ff-83d6da6f535e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:25.739041 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a943d61-75a9-4652-a0ff-83d6da6f535e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:25.739553 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a943d61-75a9-4652-a0ff-83d6da6f535e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:25.739999 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a943d61-75a9-4652-a0ff-83d6da6f535e None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:25.740832 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a943d61-75a9-4652-a0ff-83d6da6f535e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:25.741357 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a943d61-75a9-4652-a0ff-83d6da6f535e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:25.743063 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a943d61-75a9-4652-a0ff-83d6da6f535e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:25.749151 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 455/909] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Aug 30 11:45:25 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:26.569188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a38eb-5e8e-46bd-83e2-ad208aaf8a05 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:26.570204 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a38eb-5e8e-46bd-83e2-ad208aaf8a05 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:26.570685 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a38eb-5e8e-46bd-83e2-ad208aaf8a05 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:26.572552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 455/910] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:26.578001 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a47720-e500-4fec-9e2e-0831029bf4cc None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:26.578814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a47720-e500-4fec-9e2e-0831029bf4cc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:26.579303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a47720-e500-4fec-9e2e-0831029bf4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:26.598654 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c9a47720-e500-4fec-9e2e-0831029bf4cc None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:26.600166 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c9a47720-e500-4fec-9e2e-0831029bf4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:26.671018 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 456/911] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:26.805065 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc9470-422b-4ee5-95a4-bc51f3896209 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:26.805720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc9470-422b-4ee5-95a4-bc51f3896209 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:26.806194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc9470-422b-4ee5-95a4-bc51f3896209 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:26.808076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 456/912] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:26.813664 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba86a5-dfc0-4c2d-a05f-61d1ccab43ff None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:26.814195 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba86a5-dfc0-4c2d-a05f-61d1ccab43ff None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:26.814674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba86a5-dfc0-4c2d-a05f-61d1ccab43ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:26.839570 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-72ba86a5-dfc0-4c2d-a05f-61d1ccab43ff None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:26.841065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-72ba86a5-dfc0-4c2d-a05f-61d1ccab43ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:26.910981 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 457/913] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:26.938924 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc9470-422b-4ee5-95a4-bc51f3896209 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:27.043787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc9470-422b-4ee5-95a4-bc51f3896209 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:27.053452 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:27.079993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320fad9-edac-498b-b15a-e38fc5a10c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:27.080632 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320fad9-edac-498b-b15a-e38fc5a10c2e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:27.080951 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320fad9-edac-498b-b15a-e38fc5a10c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:27.081227 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320fad9-edac-498b-b15a-e38fc5a10c2e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:27.092690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320fad9-edac-498b-b15a-e38fc5a10c2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:45:27.097578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-b320fad9-edac-498b-b15a-e38fc5a10c2e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:45:27.097578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:27.097578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:27.097578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:27.097578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:27.097578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:27.097578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:27.097578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:27.097578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:27.097578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:27.097578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:27.097578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:27.097578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:45:27.097578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:45:27.097578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:45:27.097578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:45:27.098512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:45:27.098512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:45:27.098512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:45:27.098512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:45:27.098512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:27.098512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:27.098512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:27.098512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:27.098512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:27.098512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:27.098512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:27.098512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:27.098512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:27.098512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:27.098512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:27.098512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:27.099388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:27.099388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:27.099388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:27.099388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:27.099388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:45:27.099388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:45:27.099388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:45:27.099388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:45:27.099388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:45:27.099388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:45:27.099388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:45:27.099388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:27.102616 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 457/914] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Aug 30 11:45:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:27.105933 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba86a5-dfc0-4c2d-a05f-61d1ccab43ff None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:27.136099 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:27.185990 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320fad9-edac-498b-b15a-e38fc5a10c2e None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:27.211593 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba86a5-dfc0-4c2d-a05f-61d1ccab43ff None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:27.257695 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc3bc2-3fe6-47ad-961a-aaf03bbc971f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:27.258327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc3bc2-3fe6-47ad-961a-aaf03bbc971f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:27.258607 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc3bc2-3fe6-47ad-961a-aaf03bbc971f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:27.258883 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc3bc2-3fe6-47ad-961a-aaf03bbc971f None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:27.259842 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc3bc2-3fe6-47ad-961a-aaf03bbc971f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:27.260148 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc3bc2-3fe6-47ad-961a-aaf03bbc971f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:27.261536 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc3bc2-3fe6-47ad-961a-aaf03bbc971f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:27.275400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 458/915] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Aug 30 11:45:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:27.279454 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc3bc2-3fe6-47ad-961a-aaf03bbc971f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:27.315924 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320fad9-edac-498b-b15a-e38fc5a10c2e None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:27.364944 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4bf88-7cef-4196-a5b0-cd1a11895ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:27.366425 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4bf88-7cef-4196-a5b0-cd1a11895ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:27.366881 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4bf88-7cef-4196-a5b0-cd1a11895ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:27.367342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4bf88-7cef-4196-a5b0-cd1a11895ec3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:27.368587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4bf88-7cef-4196-a5b0-cd1a11895ec3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:27.370586 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4bf88-7cef-4196-a5b0-cd1a11895ec3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:27.380765 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:27.384176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-b5e4bf88-7cef-4196-a5b0-cd1a11895ec3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 11:45:27.384176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:27.384176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:45:27.384176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:45:27.384176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:45:27.384176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:45:27.384176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:45:27.384176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:27.384176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 11:45:27.384176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:27.384176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:27.384176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:27.384176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:27.384176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:27.384176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:27.384176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:27.384176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:27.385552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:27.385552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:27.385552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:27.385552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:27.385552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:27.385552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:27.385552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:45:27.385552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:45:27.385552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:45:27.385552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:45:27.385552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:27.385552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:27.385552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:27.385552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:27.385552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:27.385552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:27.386394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:27.386394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:27.386394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:27.386394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:27.386394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:27.386394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:27.386394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:27.386394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:27.386394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:27.386394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:27.386394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:45:27.386394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:27.386394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 11:45:27.386394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:27.388988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 458/916] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Aug 30 11:45:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:27.394652 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4bf88-7cef-4196-a5b0-cd1a11895ec3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:27.400505 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc3bc2-3fe6-47ad-961a-aaf03bbc971f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:27.439111 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:27.448732 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f4959-60ea-42a0-bc9e-b35d0a4b4eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:27.449560 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f4959-60ea-42a0-bc9e-b35d0a4b4eba None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:27.449939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f4959-60ea-42a0-bc9e-b35d0a4b4eba None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:27.450337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f4959-60ea-42a0-bc9e-b35d0a4b4eba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:27.463106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f4959-60ea-42a0-bc9e-b35d0a4b4eba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:27.465147 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f4959-60ea-42a0-bc9e-b35d0a4b4eba None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:27.492103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-c83f4959-60ea-42a0-bc9e-b35d0a4b4eba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:27.492103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:27.492103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:27.492103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:27.492103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:27.492103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:27.492103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:27.492103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:27.492103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:27.492103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:27.492103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:27.492103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:27.492103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:27.492103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:27.492103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:27.492103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:27.493351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:27.493351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:27.493351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:27.493351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:27.493351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:27.493351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:27.493351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:27.493351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:27.493351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:27.493351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:27.493351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:27.493351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:27.493351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:27.493351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:27.493351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:27.493351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:27.493351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:27.494479 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:27.494479 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:27.494479 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:27.499783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 459/917] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:27.501206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f4959-60ea-42a0-bc9e-b35d0a4b4eba None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:27.528251 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4bf88-7cef-4196-a5b0-cd1a11895ec3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:27.566872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2791c-2479-49c3-a060-71f0d2f30e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:27.567657 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2791c-2479-49c3-a060-71f0d2f30e03 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:27.567998 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2791c-2479-49c3-a060-71f0d2f30e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:27.568340 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2791c-2479-49c3-a060-71f0d2f30e03 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:27.569027 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2791c-2479-49c3-a060-71f0d2f30e03 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:27.569389 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2791c-2479-49c3-a060-71f0d2f30e03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:27.570910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2791c-2479-49c3-a060-71f0d2f30e03 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:27.580847 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 459/918] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Aug 30 11:45:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:27.583154 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2791c-2479-49c3-a060-71f0d2f30e03 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:27.639107 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f4959-60ea-42a0-bc9e-b35d0a4b4eba None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:27.676764 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7c3c2-9d4b-4fd0-97f9-6f31204a5992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:27.677713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7c3c2-9d4b-4fd0-97f9-6f31204a5992 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:27.678212 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7c3c2-9d4b-4fd0-97f9-6f31204a5992 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:27.678682 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7c3c2-9d4b-4fd0-97f9-6f31204a5992 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:27.679632 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7c3c2-9d4b-4fd0-97f9-6f31204a5992 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:27.680244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7c3c2-9d4b-4fd0-97f9-6f31204a5992 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:27.681912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7c3c2-9d4b-4fd0-97f9-6f31204a5992 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:27.690459 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:27.692970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:27.696389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 460/919] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:27.696652 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2791c-2479-49c3-a060-71f0d2f30e03 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:27.698092 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3036ba-b182-4b6d-964d-a5dd69ae7e66 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:27.698585 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3036ba-b182-4b6d-964d-a5dd69ae7e66 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:27.699040 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3036ba-b182-4b6d-964d-a5dd69ae7e66 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:27.700337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 461/920] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:27.701645 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093dbe0-c3b0-48b0-9912-3dd54f8dbfa2 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:27.701955 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093dbe0-c3b0-48b0-9912-3dd54f8dbfa2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:27.702223 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093dbe0-c3b0-48b0-9912-3dd54f8dbfa2 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:27.703718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 462/921] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:27.708220 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093dbe0-c3b0-48b0-9912-3dd54f8dbfa2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:27.733713 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58790f-12a0-4d09-ad9f-a5e95d280be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:27.734336 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58790f-12a0-4d09-ad9f-a5e95d280be3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:27.734620 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58790f-12a0-4d09-ad9f-a5e95d280be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:27.734890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58790f-12a0-4d09-ad9f-a5e95d280be3 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:27.735559 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58790f-12a0-4d09-ad9f-a5e95d280be3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:27.735858 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58790f-12a0-4d09-ad9f-a5e95d280be3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:27.737251 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58790f-12a0-4d09-ad9f-a5e95d280be3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:27.742032 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 460/922] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Aug 30 11:45:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:27.743141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf678da-5ff7-4b72-aa28-b10ce756fdd9 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:27.743447 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf678da-5ff7-4b72-aa28-b10ce756fdd9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:27.743719 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf678da-5ff7-4b72-aa28-b10ce756fdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:27.761612 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-fcf678da-5ff7-4b72-aa28-b10ce756fdd9 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:27.762806 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-fcf678da-5ff7-4b72-aa28-b10ce756fdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:27.814058 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093dbe0-c3b0-48b0-9912-3dd54f8dbfa2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:27.849000 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 461/923] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:27.850582 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e549d-3f9c-4c68-a6db-9e3c99378a4a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:27.851033 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e549d-3f9c-4c68-a6db-9e3c99378a4a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:27.851544 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e549d-3f9c-4c68-a6db-9e3c99378a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:27.861944 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c7148-f194-4dd1-92e9-c9da75cc35a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:27.862995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c7148-f194-4dd1-92e9-c9da75cc35a9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:27.863553 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c7148-f194-4dd1-92e9-c9da75cc35a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:27.864009 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c7148-f194-4dd1-92e9-c9da75cc35a9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:27.876083 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c7148-f194-4dd1-92e9-c9da75cc35a9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:27.877528 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c7148-f194-4dd1-92e9-c9da75cc35a9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:27.881291 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-be5e549d-3f9c-4c68-a6db-9e3c99378a4a None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:27.882478 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-be5e549d-3f9c-4c68-a6db-9e3c99378a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:27.889912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-2e7c7148-f194-4dd1-92e9-c9da75cc35a9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:45:27.889912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:27.889912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:27.889912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:27.889912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:27.889912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:27.889912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:27.889912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:27.889912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:27.889912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:27.889912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:27.889912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:27.889912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:45:27.889912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:45:27.889912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:45:27.889912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:45:27.890964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:27.890964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:27.890964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:45:27.890964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:27.890964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:45:27.890964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:27.890964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:27.890964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:27.890964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:27.890964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:27.890964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:27.890964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:27.890964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:27.890964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:27.890964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:27.890964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:27.890964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:27.890964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:27.892238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:27.892238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:27.892238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:45:27.892238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:45:27.892238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:45:27.892238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:45:27.892238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:45:27.892238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:45:27.892238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:45:27.892238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:27.892238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 463/924] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Aug 30 11:45:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:27.892238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c7148-f194-4dd1-92e9-c9da75cc35a9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:27.957426 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:27.967481 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 462/925] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:27.967481 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e549d-3f9c-4c68-a6db-9e3c99378a4a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:27.999615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:28.003768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c7148-f194-4dd1-92e9-c9da75cc35a9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:28.038911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc43cc0-78de-4073-bd55-3a2f9de7f4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:28.039614 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc43cc0-78de-4073-bd55-3a2f9de7f4df None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:28.039838 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc43cc0-78de-4073-bd55-3a2f9de7f4df None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:28.040099 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc43cc0-78de-4073-bd55-3a2f9de7f4df None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:28.040819 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc43cc0-78de-4073-bd55-3a2f9de7f4df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:28.042238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc43cc0-78de-4073-bd55-3a2f9de7f4df None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:28.072150 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 464/926] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:45:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:45:28.121794 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc43cc0-78de-4073-bd55-3a2f9de7f4df None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:28.126490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e549d-3f9c-4c68-a6db-9e3c99378a4a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:28.173533 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d81a8-feeb-4c68-bc52-95c35dc5a76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:28.174067 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d81a8-feeb-4c68-bc52-95c35dc5a76e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:28.174341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d81a8-feeb-4c68-bc52-95c35dc5a76e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:28.174607 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d81a8-feeb-4c68-bc52-95c35dc5a76e None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:28.175337 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d81a8-feeb-4c68-bc52-95c35dc5a76e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:28.175668 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d81a8-feeb-4c68-bc52-95c35dc5a76e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:28.177135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d81a8-feeb-4c68-bc52-95c35dc5a76e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:28.201843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 463/927] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Aug 30 11:45:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:28.203014 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d81a8-feeb-4c68-bc52-95c35dc5a76e None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:28.241738 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc43cc0-78de-4073-bd55-3a2f9de7f4df None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:28.260023 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:28.283633 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660a936-96d4-4352-9488-15e95dd16311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:28.284291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660a936-96d4-4352-9488-15e95dd16311 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:28.284568 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660a936-96d4-4352-9488-15e95dd16311 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:28.284836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660a936-96d4-4352-9488-15e95dd16311 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:28.285432 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660a936-96d4-4352-9488-15e95dd16311 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:28.286804 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660a936-96d4-4352-9488-15e95dd16311 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:28.289780 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:28.296798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3660a936-96d4-4352-9488-15e95dd16311 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 11:45:28.296798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:28.296798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:45:28.296798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:45:28.296798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:45:28.296798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:45:28.296798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:45:28.296798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:28.296798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 11:45:28.296798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:28.296798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:28.296798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:28.296798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:28.296798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:28.296798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:28.296798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:28.297757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:28.297757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:28.297757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:28.297757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:28.297757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:28.297757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:28.297757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:28.297757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:45:28.297757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:45:28.297757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:45:28.297757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:45:28.297757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:28.297757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:28.297757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:28.297757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:28.297757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:28.297757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:28.298631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:28.298631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:28.298631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:28.298631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:28.298631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:28.298631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:28.298631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:28.298631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:28.298631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:28.298631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:28.298631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:45:28.298631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:28.298631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 11:45:28.298631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:28.298631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 465/928] 10.222.0.27 () {56 vars in 1132 bytes} [Tue Aug 30 11:45:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:28.299461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660a936-96d4-4352-9488-15e95dd16311 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:28.323445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d81a8-feeb-4c68-bc52-95c35dc5a76e None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:28.361285 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acfb0e-3abc-4096-a257-e76bb3cccfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:28.361935 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acfb0e-3abc-4096-a257-e76bb3cccfbf None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:28.362238 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acfb0e-3abc-4096-a257-e76bb3cccfbf None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:28.362510 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acfb0e-3abc-4096-a257-e76bb3cccfbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:28.373462 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acfb0e-3abc-4096-a257-e76bb3cccfbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:28.375114 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acfb0e-3abc-4096-a257-e76bb3cccfbf None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:28.390720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-24acfb0e-3abc-4096-a257-e76bb3cccfbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:28.390720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:28.390720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:28.390720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:28.390720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:28.390720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:28.390720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:28.390720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:28.390720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:28.390720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:28.390720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:28.390720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:28.390720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:28.390720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:28.390720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:28.390720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:28.391739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:28.391739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:28.391739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:28.391739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:28.391739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:28.391739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:28.391739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:28.391739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:28.391739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:28.391739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:28.391739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:28.391739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:28.391739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:28.391739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:28.391739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:28.391739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:28.391739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:28.392639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:28.392639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:28.392639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:28.392639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 464/929] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:28.392860 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acfb0e-3abc-4096-a257-e76bb3cccfbf None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:28.403714 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660a936-96d4-4352-9488-15e95dd16311 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:28.440160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5542fa-6b88-44fc-bbf3-bbcca9f130a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:28.440690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5542fa-6b88-44fc-bbf3-bbcca9f130a7 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:28.440966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5542fa-6b88-44fc-bbf3-bbcca9f130a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:28.441231 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5542fa-6b88-44fc-bbf3-bbcca9f130a7 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:28.441885 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5542fa-6b88-44fc-bbf3-bbcca9f130a7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:28.443251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5542fa-6b88-44fc-bbf3-bbcca9f130a7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:28.459623 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 466/930] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Aug 30 11:45:28 2022] POST /identity/v3/services => generated 241 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:45:28.460503 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5542fa-6b88-44fc-bbf3-bbcca9f130a7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:28.517523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acfb0e-3abc-4096-a257-e76bb3cccfbf None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:28.523764 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:28.554739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:28.579024 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bc73e-a266-4322-8d7a-c9c600ff998a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:28.579748 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bc73e-a266-4322-8d7a-c9c600ff998a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:28.579944 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bc73e-a266-4322-8d7a-c9c600ff998a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:28.580311 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bc73e-a266-4322-8d7a-c9c600ff998a None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:28.580981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bc73e-a266-4322-8d7a-c9c600ff998a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:28.581348 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bc73e-a266-4322-8d7a-c9c600ff998a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:28.582780 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bc73e-a266-4322-8d7a-c9c600ff998a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:28.589269 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 465/931] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Aug 30 11:45:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:28.597169 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bc73e-a266-4322-8d7a-c9c600ff998a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:28.603266 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5542fa-6b88-44fc-bbf3-bbcca9f130a7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:28.652963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007b242-ea83-4b93-adda-d32f56f7d02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:28.654277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007b242-ea83-4b93-adda-d32f56f7d02e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:28.654839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007b242-ea83-4b93-adda-d32f56f7d02e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:28.655261 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007b242-ea83-4b93-adda-d32f56f7d02e None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:28.655950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007b242-ea83-4b93-adda-d32f56f7d02e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:28.656252 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007b242-ea83-4b93-adda-d32f56f7d02e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:28.657743 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007b242-ea83-4b93-adda-d32f56f7d02e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:28.670958 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 467/932] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:28.676484 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007b242-ea83-4b93-adda-d32f56f7d02e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:28.733030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bc73e-a266-4322-8d7a-c9c600ff998a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:28.781068 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16904d-3d0c-4b07-a2d5-c732c0f77f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:28.781734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16904d-3d0c-4b07-a2d5-c732c0f77f96 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:28.782016 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16904d-3d0c-4b07-a2d5-c732c0f77f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:28.782289 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16904d-3d0c-4b07-a2d5-c732c0f77f96 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:28.782931 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16904d-3d0c-4b07-a2d5-c732c0f77f96 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:28.783501 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16904d-3d0c-4b07-a2d5-c732c0f77f96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:28.785614 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16904d-3d0c-4b07-a2d5-c732c0f77f96 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:28.788214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:28.791908 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007b242-ea83-4b93-adda-d32f56f7d02e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:28.792960 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 466/933] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Aug 30 11:45:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:28.798350 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16904d-3d0c-4b07-a2d5-c732c0f77f96 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:28.833772 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5050c1d-667c-4ce9-ba09-1dba40550c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:28.834617 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5050c1d-667c-4ce9-ba09-1dba40550c88 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:28.834991 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5050c1d-667c-4ce9-ba09-1dba40550c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:28.835369 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5050c1d-667c-4ce9-ba09-1dba40550c88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:28.843154 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5050c1d-667c-4ce9-ba09-1dba40550c88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:28.844721 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5050c1d-667c-4ce9-ba09-1dba40550c88 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:28.851856 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:28.856836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-b5050c1d-667c-4ce9-ba09-1dba40550c88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:28.856836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:28.856836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:28.856836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:28.856836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:28.856836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:28.856836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:28.856836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:28.856836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:28.856836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:28.856836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:28.856836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:28.856836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:45:28.856836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:45:28.856836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:45:28.857718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:45:28.857718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:28.857718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:28.857718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:28.857718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:28.857718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:28.857718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:28.857718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:28.857718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:28.857718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:28.857718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:28.857718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:28.857718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:28.857718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:28.857718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:28.857718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:28.857718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:28.858963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:45:28.858963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:45:28.858963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:45:28.858963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:45:28.858963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:45:28.858963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:45:28.858963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:28.858963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:28.858963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 468/934] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:28.872659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5050c1d-667c-4ce9-ba09-1dba40550c88 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:28.909883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16904d-3d0c-4b07-a2d5-c732c0f77f96 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:28.946171 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf042a-fa57-4972-bd53-6d0d52a1a4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:28.946780 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf042a-fa57-4972-bd53-6d0d52a1a4b5 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:28.947054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf042a-fa57-4972-bd53-6d0d52a1a4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:28.947322 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf042a-fa57-4972-bd53-6d0d52a1a4b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:28.948001 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf042a-fa57-4972-bd53-6d0d52a1a4b5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:28.949377 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf042a-fa57-4972-bd53-6d0d52a1a4b5 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:28.979553 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 467/935] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:45:28 2022] POST /identity/v3/endpoints => generated 347 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:45:28.994547 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5050c1d-667c-4ce9-ba09-1dba40550c88 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:29.040857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b92602-80f6-4287-a030-899f6096799a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:29.041501 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b92602-80f6-4287-a030-899f6096799a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:29.041780 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b92602-80f6-4287-a030-899f6096799a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:29.042054 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b92602-80f6-4287-a030-899f6096799a None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:29.042758 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b92602-80f6-4287-a030-899f6096799a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:29.043067 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b92602-80f6-4287-a030-899f6096799a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:29.044626 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b92602-80f6-4287-a030-899f6096799a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:29.060033 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 469/936] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:45:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:29.066081 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf042a-fa57-4972-bd53-6d0d52a1a4b5 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:29.183567 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf042a-fa57-4972-bd53-6d0d52a1a4b5 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:29.191286 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:29.222534 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d9641-d63e-4d62-bbde-3bbc45ed88f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:29.223210 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d9641-d63e-4d62-bbde-3bbc45ed88f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:29.223515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d9641-d63e-4d62-bbde-3bbc45ed88f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:29.223791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d9641-d63e-4d62-bbde-3bbc45ed88f5 None admin] PATH_INFO: `/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/58c86110ce97463e9b3d53691ae3e12c/roles/8c34d24ef14b407f81bb5fb31973ddb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:29.225946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d9641-d63e-4d62-bbde-3bbc45ed88f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba4dff9d637c4afcadfd3cd92b065a41, user_id=58c86110ce97463e9b3d53691ae3e12c, role_id=8c34d24ef14b407f81bb5fb31973ddb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:29.227427 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d9641-d63e-4d62-bbde-3bbc45ed88f5 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:29.249628 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 468/937] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:45:29 2022] PUT /identity/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/58c86110ce97463e9b3d53691ae3e12c/roles/8c34d24ef14b407f81bb5fb31973ddb0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:45:30.039661 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c6bfe-eaeb-4785-a52f-94440a52a9d2 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:30.040194 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c6bfe-eaeb-4785-a52f-94440a52a9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:30.040194 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c6bfe-eaeb-4785-a52f-94440a52a9d2 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:30.041774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 470/938] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:30.047391 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d0812-de09-4c60-8bdb-3ccf82dcbf99 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:30.047809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d0812-de09-4c60-8bdb-3ccf82dcbf99 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:30.047983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d0812-de09-4c60-8bdb-3ccf82dcbf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:30.066871 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-908d0812-de09-4c60-8bdb-3ccf82dcbf99 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:30.068108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-908d0812-de09-4c60-8bdb-3ccf82dcbf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:30.140024 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 469/939] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:45:30.403230 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c6bfe-eaeb-4785-a52f-94440a52a9d2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:30.422297 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:30.509484 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c6bfe-eaeb-4785-a52f-94440a52a9d2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:30.543950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c3ab6-697c-4584-a3f9-41a2edb2642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:30.544571 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c3ab6-697c-4584-a3f9-41a2edb2642d None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:30.544898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c3ab6-697c-4584-a3f9-41a2edb2642d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:30.545174 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c3ab6-697c-4584-a3f9-41a2edb2642d None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:30.545985 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c3ab6-697c-4584-a3f9-41a2edb2642d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:30.547135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e256aef-1b84-47a3-b035-10b2d16932f7 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:30.547452 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c3ab6-697c-4584-a3f9-41a2edb2642d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:30.547572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e256aef-1b84-47a3-b035-10b2d16932f7 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:30.547792 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e256aef-1b84-47a3-b035-10b2d16932f7 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:30.549402 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 470/940] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:30.550127 dv-cinder-839768-2-smb devstack@keystone.service[81554]: WARNING keystone.server.flask.common [None req-d37c3ab6-697c-4584-a3f9-41a2edb2642d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 11:45:30.554403 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793067c-e5b8-4e2d-95e6-55421e6aca9f None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:30.554683 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793067c-e5b8-4e2d-95e6-55421e6aca9f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:30.554953 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793067c-e5b8-4e2d-95e6-55421e6aca9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:30.571620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.sql.core [None req-d37c3ab6-697c-4584-a3f9-41a2edb2642d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 11:45:30.571620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 11:45:30.571620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [parameters: {'id': '9a8799e1916941bba78c2b4953efff8a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 11:45:30.571620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81554) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 11:45:30.574172 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-b793067c-e5b8-4e2d-95e6-55421e6aca9f None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:30.575375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b793067c-e5b8-4e2d-95e6-55421e6aca9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:30.581896 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-d37c3ab6-697c-4584-a3f9-41a2edb2642d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9a8799e1916941bba78c2b4953efff8a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9a8799e1916941bba78c2b4953efff8a. Aug 30 11:45:30.581896 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:30.581896 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 11:45:30.581896 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 11:45:30.581896 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 11:45:30.581896 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 11:45:30.581896 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 11:45:30.581896 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 11:45:30.581896 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 11:45:30.581896 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application conn.query(q) Aug 30 11:45:30.581896 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 11:45:30.581896 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 11:45:30.581896 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 11:45:30.582783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application result.read() Aug 30 11:45:30.582783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 11:45:30.582783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 11:45:30.582783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 11:45:30.582783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 11:45:30.582783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 11:45:30.582783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 11:45:30.582783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 11:45:30.582783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 11:45:30.582783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 11:45:30.582783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:30.582783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 11:45:30.582783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:30.582783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:30.582783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 11:45:30.582783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 11:45:30.582783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 30 11:45:30.582783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 30 11:45:30.583812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 11:45:30.583812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application next(self.gen) Aug 30 11:45:30.583812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 11:45:30.583812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application yield resource Aug 30 11:45:30.583812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 11:45:30.583812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application next(self.gen) Aug 30 11:45:30.583812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 11:45:30.583812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 11:45:30.583812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 11:45:30.583812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 11:45:30.583812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 11:45:30.583812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise self.value Aug 30 11:45:30.583812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 11:45:30.583812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 11:45:30.583812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 11:45:30.583812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application session.commit() Aug 30 11:45:30.583812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 11:45:30.584701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 11:45:30.584701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 11:45:30.584701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 11:45:30.584701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 11:45:30.584701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self.session.flush() Aug 30 11:45:30.584701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 11:45:30.584701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 11:45:30.584701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 11:45:30.584701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 11:45:30.584701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 11:45:30.584701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application compat.raise_( Aug 30 11:45:30.584701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 11:45:30.584701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception Aug 30 11:45:30.584701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 11:45:30.584701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 11:45:30.584701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 11:45:30.584701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 11:45:30.585619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 11:45:30.585619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 11:45:30.585619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 11:45:30.585619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 11:45:30.585619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 11:45:30.585619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 11:45:30.585619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 11:45:30.585619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 11:45:30.585619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 11:45:30.585619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 11:45:30.585619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 11:45:30.585619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 11:45:30.585619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 11:45:30.585619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 11:45:30.585619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 11:45:30.586416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 11:45:30.586416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 11:45:30.586416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception Aug 30 11:45:30.586416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 11:45:30.586416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 11:45:30.586416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 11:45:30.586416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 11:45:30.586416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 11:45:30.586416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 11:45:30.586416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 11:45:30.586416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application conn.query(q) Aug 30 11:45:30.586416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 11:45:30.586416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 11:45:30.586416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 11:45:30.586416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application result.read() Aug 30 11:45:30.586416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 11:45:30.586416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 11:45:30.587295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 11:45:30.587295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 11:45:30.587295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 11:45:30.587295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 11:45:30.587295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 11:45:30.587295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 11:45:30.587295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 11:45:30.587295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 11:45:30.587295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [parameters: {'id': '9a8799e1916941bba78c2b4953efff8a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 11:45:30.587295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 11:45:30.587295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:30.587295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:30.587295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:30.587295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:30.587295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 30 11:45:30.589548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 30 11:45:30.589548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 11:45:30.589548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 11:45:30.589548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 30 11:45:30.589548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:30.589548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:30.589548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:30.589548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:30.589548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:30.589548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:30.589548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:30.589548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:30.589548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:30.589548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:30.589548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:30.589548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:30.589548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:30.590476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:30.590476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 30 11:45:30.590476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 30 11:45:30.590476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:30.590476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:30.590476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 30 11:45:30.590476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 30 11:45:30.590476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9a8799e1916941bba78c2b4953efff8a. Aug 30 11:45:30.590476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:30.590476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 471/941] 10.222.0.27 () {60 vars in 1140 bytes} [Tue Aug 30 11:45:30 2022] POST /identity/v3/projects => generated 262 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:30.596159 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c3ab6-697c-4584-a3f9-41a2edb2642d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:30.675480 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 471/942] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:45:30.691872 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:30.716029 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c3ab6-697c-4584-a3f9-41a2edb2642d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:30.751757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b3223-a2c7-4d2c-87cf-802703074d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:30.752404 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b3223-a2c7-4d2c-87cf-802703074d2b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:30.752680 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b3223-a2c7-4d2c-87cf-802703074d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:30.752957 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b3223-a2c7-4d2c-87cf-802703074d2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:30.760511 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b3223-a2c7-4d2c-87cf-802703074d2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:30.762227 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b3223-a2c7-4d2c-87cf-802703074d2b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:30.774117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-b37b3223-a2c7-4d2c-87cf-802703074d2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:30.774117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:30.774117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:30.774117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:30.774117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:30.774117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:30.774117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:30.774117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:30.774117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:30.774117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:30.774117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:30.774117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:30.774117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:45:30.774117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:45:30.774117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:45:30.775020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:45:30.775020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:30.775020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:30.775020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:30.775020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:30.775020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:30.775020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:30.775020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:30.775020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:30.775020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:30.775020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:30.775020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:30.775020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:30.775020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:30.775020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:30.775020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:30.775020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:30.776211 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:45:30.776211 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:45:30.776211 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:45:30.776211 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:45:30.776211 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:45:30.776211 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:45:30.776211 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:30.776211 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:30.776211 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 472/943] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:30.785587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793067c-e5b8-4e2d-95e6-55421e6aca9f None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:30.814518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:30.889541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793067c-e5b8-4e2d-95e6-55421e6aca9f None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:30.923524 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0531e-361f-410a-b167-c6c742e376fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:30.924139 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0531e-361f-410a-b167-c6c742e376fc None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:30.924416 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0531e-361f-410a-b167-c6c742e376fc None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:30.924683 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0531e-361f-410a-b167-c6c742e376fc None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:30.925411 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0531e-361f-410a-b167-c6c742e376fc None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:30.925829 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0531e-361f-410a-b167-c6c742e376fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:30.927269 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0531e-361f-410a-b167-c6c742e376fc None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:30.945231 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 472/944] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Aug 30 11:45:30 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:30.967059 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8ca65-3211-4684-9d3a-5b7466ca24ea None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:30.967833 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8ca65-3211-4684-9d3a-5b7466ca24ea None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:30.968116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8ca65-3211-4684-9d3a-5b7466ca24ea None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:30.972843 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 473/945] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:30.977971 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0531e-361f-410a-b167-c6c742e376fc None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:30.980065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cd424-aa3c-4b6f-9df9-f78fc7ac906f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:30.980357 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cd424-aa3c-4b6f-9df9-f78fc7ac906f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:30.980633 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cd424-aa3c-4b6f-9df9-f78fc7ac906f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:31.006757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-223cd424-aa3c-4b6f-9df9-f78fc7ac906f None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:31.009578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-223cd424-aa3c-4b6f-9df9-f78fc7ac906f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:31.096929 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:31.107384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 474/946] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:31.126672 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0531e-361f-410a-b167-c6c742e376fc None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:31.163318 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bd91e-f59c-411c-8e89-1b46f0ac41b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:31.163959 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bd91e-f59c-411c-8e89-1b46f0ac41b7 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:31.164310 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bd91e-f59c-411c-8e89-1b46f0ac41b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:31.164575 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bd91e-f59c-411c-8e89-1b46f0ac41b7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:31.165159 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121bd91e-f59c-411c-8e89-1b46f0ac41b7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:31.166550 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121bd91e-f59c-411c-8e89-1b46f0ac41b7 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:31.176098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-121bd91e-f59c-411c-8e89-1b46f0ac41b7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:45:31.176098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:31.176098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:45:31.176098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:45:31.176098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:45:31.176098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:45:31.176098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:45:31.176098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:31.176098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:45:31.176098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:31.176098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:31.176098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:31.176098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:31.176098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:31.176098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:31.176098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:31.176098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:31.177088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:31.177088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:31.177088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:31.177088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:31.177088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:31.177088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:31.177088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:45:31.177088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:45:31.177088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:45:31.177088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:45:31.177088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:31.177088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:31.177088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:31.177088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:31.177088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:31.177088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:31.177917 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:31.177917 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:31.177917 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:31.177917 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:31.177917 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:31.177917 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:31.177917 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:31.177917 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:31.177917 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:31.177917 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:31.177917 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:45:31.177917 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:31.177917 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:45:31.177917 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:31.177917 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 473/947] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Aug 30 11:45:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:31.183376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cd424-aa3c-4b6f-9df9-f78fc7ac906f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:31.214996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3babf-8c03-45b4-8312-6f3de23aba07 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:31.215318 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3babf-8c03-45b4-8312-6f3de23aba07 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:31.215570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3babf-8c03-45b4-8312-6f3de23aba07 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:31.217690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 474/948] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:45:31.222975 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb2e71-2333-4119-b821-8252f45ea424 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:31.223546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb2e71-2333-4119-b821-8252f45ea424 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:31.224102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb2e71-2333-4119-b821-8252f45ea424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:31.243380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-c0bb2e71-2333-4119-b821-8252f45ea424 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:31.245013 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c0bb2e71-2333-4119-b821-8252f45ea424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:31.257741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:31.297813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cd424-aa3c-4b6f-9df9-f78fc7ac906f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:31.317753 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 475/949] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:45:31.333242 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d78fd0-3009-490f-a39e-2330f1d9dab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:31.333862 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d78fd0-3009-490f-a39e-2330f1d9dab3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:31.334136 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d78fd0-3009-490f-a39e-2330f1d9dab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:31.334406 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d78fd0-3009-490f-a39e-2330f1d9dab3 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:31.335031 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d78fd0-3009-490f-a39e-2330f1d9dab3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:31.335329 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d78fd0-3009-490f-a39e-2330f1d9dab3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:31.336916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d78fd0-3009-490f-a39e-2330f1d9dab3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:31.342492 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 475/950] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Aug 30 11:45:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:31.348102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb2e71-2333-4119-b821-8252f45ea424 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:31.376829 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d78fd0-3009-490f-a39e-2330f1d9dab3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:31.444071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:31.465360 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb2e71-2333-4119-b821-8252f45ea424 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:31.486943 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d78fd0-3009-490f-a39e-2330f1d9dab3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:31.502803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787daa4-112c-441c-b9e5-100bdd6eff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:31.503465 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787daa4-112c-441c-b9e5-100bdd6eff00 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:31.503745 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787daa4-112c-441c-b9e5-100bdd6eff00 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:31.504018 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787daa4-112c-441c-b9e5-100bdd6eff00 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:31.504747 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787daa4-112c-441c-b9e5-100bdd6eff00 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:31.505055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787daa4-112c-441c-b9e5-100bdd6eff00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:31.506721 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787daa4-112c-441c-b9e5-100bdd6eff00 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:31.512634 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 476/951] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Aug 30 11:45:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:31.515150 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:31.518493 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787daa4-112c-441c-b9e5-100bdd6eff00 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:31.524939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1c0c4-3858-4b2f-b131-d91a597fb8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:31.525319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1c0c4-3858-4b2f-b131-d91a597fb8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:31.525598 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1c0c4-3858-4b2f-b131-d91a597fb8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:31.525866 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1c0c4-3858-4b2f-b131-d91a597fb8b6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:31.526448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1c0c4-3858-4b2f-b131-d91a597fb8b6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:31.528162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1c0c4-3858-4b2f-b131-d91a597fb8b6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:31.538552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9eb1c0c4-3858-4b2f-b131-d91a597fb8b6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 11:45:31.538552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:31.538552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:45:31.538552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:45:31.538552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:45:31.538552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:45:31.538552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:45:31.538552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:31.538552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 11:45:31.538552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:31.538552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:31.538552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:31.538552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:31.538552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:31.538552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:31.538552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:31.538552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:31.539628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:31.539628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:31.539628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:31.539628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:31.539628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:31.539628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:31.539628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:45:31.539628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:45:31.539628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:45:31.539628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:45:31.539628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:31.539628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:31.539628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:31.539628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:31.539628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:31.539628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:31.540465 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:31.540465 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:31.540465 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:31.540465 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:31.540465 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:31.540465 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:31.540465 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:31.540465 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:31.540465 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:31.540465 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:31.540465 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:45:31.540465 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:31.540465 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 11:45:31.540465 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:31.543727 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 476/952] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:31.545829 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1c0c4-3858-4b2f-b131-d91a597fb8b6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:31.633330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787daa4-112c-441c-b9e5-100bdd6eff00 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:31.650152 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1c0c4-3858-4b2f-b131-d91a597fb8b6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:31.673854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e545e74-3fc7-47eb-be7e-e57c0852dfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:31.674412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e545e74-3fc7-47eb-be7e-e57c0852dfa1 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:31.674725 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e545e74-3fc7-47eb-be7e-e57c0852dfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:31.674958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e545e74-3fc7-47eb-be7e-e57c0852dfa1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:31.675699 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e545e74-3fc7-47eb-be7e-e57c0852dfa1 None admin] RBAC: Adding query filter params (interface=public, service_id=8f2b5fb3e7a240a58f64388ce682291e, region_id=RegionOne) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:31.676001 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e545e74-3fc7-47eb-be7e-e57c0852dfa1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:31.677379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e545e74-3fc7-47eb-be7e-e57c0852dfa1 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:31.682607 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 477/953] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Aug 30 11:45:31 2022] GET /identity/v3/endpoints?service_id=8f2b5fb3e7a240a58f64388ce682291e&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:31.684437 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e545e74-3fc7-47eb-be7e-e57c0852dfa1 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:31.687342 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdd6d8-543f-479e-8e2f-30cc4bd406fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:31.688236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdd6d8-543f-479e-8e2f-30cc4bd406fc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:31.688511 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdd6d8-543f-479e-8e2f-30cc4bd406fc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:31.688775 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdd6d8-543f-479e-8e2f-30cc4bd406fc None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:31.689399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdd6d8-543f-479e-8e2f-30cc4bd406fc None admin] RBAC: Adding query filter params (name=compute) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:31.689694 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdd6d8-543f-479e-8e2f-30cc4bd406fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:31.691047 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdd6d8-543f-479e-8e2f-30cc4bd406fc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:31.700605 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 477/954] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Aug 30 11:45:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:31.700795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:31.700898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdd6d8-543f-479e-8e2f-30cc4bd406fc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:31.756126 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:31.795258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e545e74-3fc7-47eb-be7e-e57c0852dfa1 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:31.806297 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdd6d8-543f-479e-8e2f-30cc4bd406fc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:31.830647 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14cbfe-95fe-41dd-bdde-4f5142f2c147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:31.831278 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14cbfe-95fe-41dd-bdde-4f5142f2c147 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:31.831580 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14cbfe-95fe-41dd-bdde-4f5142f2c147 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:31.831853 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14cbfe-95fe-41dd-bdde-4f5142f2c147 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:31.842615 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556699fa-5a60-4945-8305-e0d1788aa3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:31.842787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14cbfe-95fe-41dd-bdde-4f5142f2c147 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:45:31.843449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556699fa-5a60-4945-8305-e0d1788aa3a3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:31.843835 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556699fa-5a60-4945-8305-e0d1788aa3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:31.844212 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556699fa-5a60-4945-8305-e0d1788aa3a3 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:31.845060 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556699fa-5a60-4945-8305-e0d1788aa3a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:31.846593 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556699fa-5a60-4945-8305-e0d1788aa3a3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:31.847549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-1e14cbfe-95fe-41dd-bdde-4f5142f2c147 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:45:31.847549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:31.847549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:31.847549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:31.847549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:31.847549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:31.847549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:31.847549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:31.847549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:31.847549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:31.847549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:31.847549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:31.847549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:45:31.847549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:45:31.847549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:45:31.847549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:45:31.848671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:45:31.848671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:45:31.848671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:45:31.848671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:45:31.848671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:31.848671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:31.848671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:31.848671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:31.848671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:31.848671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:31.848671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:31.848671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:31.848671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:31.848671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:31.848671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:31.848671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:31.849637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:31.849637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:31.849637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:31.849637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:31.849637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:45:31.849637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:45:31.849637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:45:31.849637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:45:31.849637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:45:31.849637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:45:31.849637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:45:31.849637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:31.849637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 478/955] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Aug 30 11:45:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:31.849637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14cbfe-95fe-41dd-bdde-4f5142f2c147 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:31.859646 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 478/956] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Aug 30 11:45:31 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:45:31.860323 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556699fa-5a60-4945-8305-e0d1788aa3a3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:31.948464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:31.988017 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14cbfe-95fe-41dd-bdde-4f5142f2c147 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:32.000507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556699fa-5a60-4945-8305-e0d1788aa3a3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:32.024003 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:32.027912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70beb13b-8ff2-4197-b84c-a0550313783c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:32.028506 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70beb13b-8ff2-4197-b84c-a0550313783c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:32.028782 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70beb13b-8ff2-4197-b84c-a0550313783c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:32.029069 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70beb13b-8ff2-4197-b84c-a0550313783c None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:32.029925 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70beb13b-8ff2-4197-b84c-a0550313783c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:32.030047 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70beb13b-8ff2-4197-b84c-a0550313783c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:32.031765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70beb13b-8ff2-4197-b84c-a0550313783c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:32.037531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 479/957] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Aug 30 11:45:31 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:32.043417 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81972864-26f7-4af0-b53f-e92644929008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:32.044058 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81972864-26f7-4af0-b53f-e92644929008 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:32.044345 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81972864-26f7-4af0-b53f-e92644929008 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:32.044613 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81972864-26f7-4af0-b53f-e92644929008 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:32.045388 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81972864-26f7-4af0-b53f-e92644929008 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:32.045690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81972864-26f7-4af0-b53f-e92644929008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:32.047103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81972864-26f7-4af0-b53f-e92644929008 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:32.057283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 479/958] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Aug 30 11:45:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:32.063415 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70beb13b-8ff2-4197-b84c-a0550313783c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:32.183965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70beb13b-8ff2-4197-b84c-a0550313783c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:32.218256 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:32.228379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6611d5-cb72-43c7-92b9-5eb9407286a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:32.229034 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6611d5-cb72-43c7-92b9-5eb9407286a0 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:32.229315 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6611d5-cb72-43c7-92b9-5eb9407286a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:32.229590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6611d5-cb72-43c7-92b9-5eb9407286a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:32.241093 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6611d5-cb72-43c7-92b9-5eb9407286a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:32.242501 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6611d5-cb72-43c7-92b9-5eb9407286a0 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:32.257981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-2a6611d5-cb72-43c7-92b9-5eb9407286a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:32.257981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:32.257981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:32.257981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:32.257981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:32.257981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:32.257981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:32.257981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:32.257981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:32.257981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:32.257981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:32.257981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:32.257981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:32.257981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:32.257981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:32.257981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:32.258954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:32.258954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:32.258954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:32.258954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:32.258954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:32.258954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:32.258954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:32.258954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:32.258954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:32.258954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:32.258954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:32.258954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:32.258954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:32.258954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:32.258954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:32.258954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:32.258954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:32.260150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:32.260150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:32.260150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:32.260150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 480/959] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:32.266796 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81972864-26f7-4af0-b53f-e92644929008 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:32.373607 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81972864-26f7-4af0-b53f-e92644929008 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:32.408064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272c0ce-068b-45a4-8d69-ac9127331dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:32.408686 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272c0ce-068b-45a4-8d69-ac9127331dca None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:32.408967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272c0ce-068b-45a4-8d69-ac9127331dca None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:32.409238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272c0ce-068b-45a4-8d69-ac9127331dca None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:32.409884 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272c0ce-068b-45a4-8d69-ac9127331dca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:32.410188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272c0ce-068b-45a4-8d69-ac9127331dca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:32.411586 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272c0ce-068b-45a4-8d69-ac9127331dca None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:32.424563 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 480/960] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:32.430020 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6611d5-cb72-43c7-92b9-5eb9407286a0 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:32.541379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6611d5-cb72-43c7-92b9-5eb9407286a0 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:32.576894 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d347f-a5a5-4efb-9d7a-8a0f4039284f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:32.577531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d347f-a5a5-4efb-9d7a-8a0f4039284f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:32.577804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d347f-a5a5-4efb-9d7a-8a0f4039284f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:32.578067 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d347f-a5a5-4efb-9d7a-8a0f4039284f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:32.585632 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d347f-a5a5-4efb-9d7a-8a0f4039284f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:32.587082 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d347f-a5a5-4efb-9d7a-8a0f4039284f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:32.598706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-e33d347f-a5a5-4efb-9d7a-8a0f4039284f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:45:32.598706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:32.598706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:32.598706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:32.598706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:32.598706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:32.598706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:32.598706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:32.598706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:32.598706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:32.598706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:32.598706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:32.598706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:45:32.598706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:45:32.598706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:45:32.598706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:45:32.599814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:32.599814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:32.599814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:45:32.599814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:32.599814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:45:32.599814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:32.599814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:32.599814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:32.599814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:32.599814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:32.599814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:32.599814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:32.599814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:32.599814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:32.599814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:32.599814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:32.599814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:32.599814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:32.600828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:32.600828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:32.600828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:45:32.600828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:45:32.600828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:45:32.600828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:45:32.600828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:45:32.600828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:45:32.600828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 11:45:32.600828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:32.604673 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 481/961] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Aug 30 11:45:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:32.607301 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272c0ce-068b-45a4-8d69-ac9127331dca None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:32.654458 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:32.713670 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272c0ce-068b-45a4-8d69-ac9127331dca None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:32.749181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448c456-a083-4c1a-ae0c-4d94978d3d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:32.749801 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448c456-a083-4c1a-ae0c-4d94978d3d0c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:32.750078 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448c456-a083-4c1a-ae0c-4d94978d3d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:32.750352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448c456-a083-4c1a-ae0c-4d94978d3d0c None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:32.751080 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448c456-a083-4c1a-ae0c-4d94978d3d0c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:32.751441 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448c456-a083-4c1a-ae0c-4d94978d3d0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:32.752843 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448c456-a083-4c1a-ae0c-4d94978d3d0c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:32.771409 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 481/962] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Aug 30 11:45:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:32.777103 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d347f-a5a5-4efb-9d7a-8a0f4039284f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:32.831972 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:32.890304 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d347f-a5a5-4efb-9d7a-8a0f4039284f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:32.929354 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86668251-eadd-4045-bfa2-0d6039132640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:32.930253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86668251-eadd-4045-bfa2-0d6039132640 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:32.930671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86668251-eadd-4045-bfa2-0d6039132640 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:32.931079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86668251-eadd-4045-bfa2-0d6039132640 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:33.005637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86668251-eadd-4045-bfa2-0d6039132640 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:33.007122 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86668251-eadd-4045-bfa2-0d6039132640 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:33.052866 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:33.068892 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c918d3-9e7f-4e2b-8380-190f03d58fb7 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:33.069173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c918d3-9e7f-4e2b-8380-190f03d58fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:33.069512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c918d3-9e7f-4e2b-8380-190f03d58fb7 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:33.072118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 482/963] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:45:33.080333 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1655644-bdf1-4e1a-8388-a6bbdaa4ebaf None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:33.080333 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1655644-bdf1-4e1a-8388-a6bbdaa4ebaf None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:33.080748 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1655644-bdf1-4e1a-8388-a6bbdaa4ebaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:33.101204 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e1655644-bdf1-4e1a-8388-a6bbdaa4ebaf None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:33.102318 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e1655644-bdf1-4e1a-8388-a6bbdaa4ebaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:33.118290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 482/964] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:45:32 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:45:33.124022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86668251-eadd-4045-bfa2-0d6039132640 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:33.192414 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 483/965] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:33.236257 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86668251-eadd-4045-bfa2-0d6039132640 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:33.275566 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63f3eb-597c-45a0-a2ca-e7dbfa1cb0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:33.276199 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63f3eb-597c-45a0-a2ca-e7dbfa1cb0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:33.276471 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63f3eb-597c-45a0-a2ca-e7dbfa1cb0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:33.276737 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63f3eb-597c-45a0-a2ca-e7dbfa1cb0e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:33.287973 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63f3eb-597c-45a0-a2ca-e7dbfa1cb0e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:33.289550 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63f3eb-597c-45a0-a2ca-e7dbfa1cb0e0 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:33.292215 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:33.305703 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-3b63f3eb-597c-45a0-a2ca-e7dbfa1cb0e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:33.305703 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:33.305703 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:33.305703 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:33.305703 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:33.305703 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:33.305703 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:33.305703 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:33.305703 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:33.305703 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:33.305703 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:33.305703 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:33.305703 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:33.305703 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:33.305703 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:33.305703 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:33.306696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:33.306696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:33.306696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:33.306696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:33.306696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:33.306696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:33.306696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:33.306696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:33.306696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:33.306696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:33.306696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:33.306696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:33.306696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:33.306696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:33.306696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:33.306696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:33.306696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:33.307831 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:33.307831 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:33.307831 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:33.311483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 483/966] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:33.313878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1655644-bdf1-4e1a-8388-a6bbdaa4ebaf None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:33.347821 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:33.424951 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1655644-bdf1-4e1a-8388-a6bbdaa4ebaf None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:33.461257 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404951a-7add-4d87-b25b-6d5115999f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:33.463701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404951a-7add-4d87-b25b-6d5115999f3a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:33.463701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404951a-7add-4d87-b25b-6d5115999f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:33.463701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404951a-7add-4d87-b25b-6d5115999f3a None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:33.463701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404951a-7add-4d87-b25b-6d5115999f3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:33.464293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404951a-7add-4d87-b25b-6d5115999f3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:33.465523 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404951a-7add-4d87-b25b-6d5115999f3a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:33.478634 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63f3eb-597c-45a0-a2ca-e7dbfa1cb0e0 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:33.479027 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 484/967] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:33.485739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404951a-7add-4d87-b25b-6d5115999f3a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:33.585625 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:33.601213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404951a-7add-4d87-b25b-6d5115999f3a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:33.606179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63f3eb-597c-45a0-a2ca-e7dbfa1cb0e0 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:33.641140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44388a-a5c5-4274-9595-ac2ab847e7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:33.641788 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44388a-a5c5-4274-9595-ac2ab847e7be None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:33.642065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44388a-a5c5-4274-9595-ac2ab847e7be None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:33.642335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44388a-a5c5-4274-9595-ac2ab847e7be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:33.649806 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738062d3-58c5-4452-b283-9a070a47fbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:33.650425 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738062d3-58c5-4452-b283-9a070a47fbf6 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:33.650722 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738062d3-58c5-4452-b283-9a070a47fbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:33.650966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738062d3-58c5-4452-b283-9a070a47fbf6 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:33.651663 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738062d3-58c5-4452-b283-9a070a47fbf6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:33.652367 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44388a-a5c5-4274-9595-ac2ab847e7be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:33.653108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738062d3-58c5-4452-b283-9a070a47fbf6 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:33.654244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44388a-a5c5-4274-9595-ac2ab847e7be None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:33.655730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: WARNING keystone.server.flask.common [None req-738062d3-58c5-4452-b283-9a070a47fbf6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 11:45:33.668825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.sql.core [None req-738062d3-58c5-4452-b283-9a070a47fbf6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 11:45:33.668825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 11:45:33.668825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [parameters: {'user_id': 'f0fb7a4b16324f9d9c9ec1e38d888df9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 11:45:33.668825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81553) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 11:45:33.669814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4f44388a-a5c5-4274-9595-ac2ab847e7be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:33.669814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:33.669814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:33.669814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:33.669814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:33.669814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:33.669814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:33.669814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:33.669814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:33.669814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:33.669814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:33.669814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:33.669814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:45:33.669814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:45:33.669814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:45:33.671495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:45:33.671495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:33.671495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:33.671495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:33.671495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:33.671495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:33.671495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:33.671495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:33.671495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:33.671495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:33.671495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:33.671495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:33.671495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:33.671495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:33.671495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:33.671495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:33.671495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:33.672418 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:45:33.672418 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:45:33.672418 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:45:33.672418 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:45:33.672418 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:45:33.672418 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:45:33.672418 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:33.672418 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:33.674821 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 485/968] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:33.683285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44388a-a5c5-4274-9595-ac2ab847e7be None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:33.688518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-738062d3-58c5-4452-b283-9a070a47fbf6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 11:45:33.688518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:33.688518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 11:45:33.688518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 11:45:33.688518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 11:45:33.688518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 11:45:33.688518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 11:45:33.688518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 11:45:33.688518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 11:45:33.688518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application conn.query(q) Aug 30 11:45:33.688518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 11:45:33.688518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 11:45:33.688518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 11:45:33.688518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application result.read() Aug 30 11:45:33.688518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 11:45:33.689622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 11:45:33.689622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 11:45:33.689622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 11:45:33.689622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 11:45:33.689622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 11:45:33.689622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 11:45:33.689622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 11:45:33.689622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 11:45:33.689622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:33.689622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 11:45:33.689622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:33.689622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:33.689622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 11:45:33.689622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 11:45:33.689622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 30 11:45:33.689622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 30 11:45:33.689622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 11:45:33.689622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application next(self.gen) Aug 30 11:45:33.690867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 11:45:33.690867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application yield resource Aug 30 11:45:33.690867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 11:45:33.690867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application next(self.gen) Aug 30 11:45:33.690867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 11:45:33.690867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 11:45:33.690867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 11:45:33.690867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 11:45:33.690867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 11:45:33.690867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise self.value Aug 30 11:45:33.690867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 11:45:33.690867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 11:45:33.690867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 11:45:33.690867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application session.commit() Aug 30 11:45:33.690867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 11:45:33.690867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 11:45:33.690867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 11:45:33.692804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 11:45:33.692804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 11:45:33.692804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self.session.flush() Aug 30 11:45:33.692804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 11:45:33.692804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 11:45:33.692804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 11:45:33.692804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 11:45:33.692804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 11:45:33.692804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application compat.raise_( Aug 30 11:45:33.692804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 11:45:33.692804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception Aug 30 11:45:33.692804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 11:45:33.692804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 11:45:33.692804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 11:45:33.692804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 11:45:33.692804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 11:45:33.692804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 11:45:33.694891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 11:45:33.694891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 11:45:33.694891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 11:45:33.694891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 30 11:45:33.694891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 11:45:33.694891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 11:45:33.694891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 11:45:33.694891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 11:45:33.694891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 11:45:33.694891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 11:45:33.694891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 11:45:33.694891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 11:45:33.694891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 11:45:33.694891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 11:45:33.694891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 11:45:33.694891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception Aug 30 11:45:33.697436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 11:45:33.697436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 11:45:33.697436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 11:45:33.697436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 11:45:33.697436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 11:45:33.697436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 11:45:33.697436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 11:45:33.697436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application conn.query(q) Aug 30 11:45:33.697436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 11:45:33.697436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 11:45:33.697436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 11:45:33.697436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application result.read() Aug 30 11:45:33.697436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 11:45:33.697436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 11:45:33.697436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 11:45:33.697436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 11:45:33.698305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 11:45:33.698305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 11:45:33.698305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 11:45:33.698305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 11:45:33.698305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 11:45:33.698305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 11:45:33.698305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f0fb7a4b16324f9d9c9ec1e38d888df9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 11:45:33.698305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 11:45:33.698305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:33.698305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:33.698305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:33.698305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:33.698305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:33.698305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:33.698305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:33.699140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:33.699140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:33.699140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:33.699140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:33.699140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:33.699140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:33.699140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:33.699140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 30 11:45:33.699140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 30 11:45:33.699140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:33.699140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:33.699140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:45:33.699140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:33.699140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:45:33.699140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:33.699140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 30 11:45:33.699140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 30 11:45:33.700109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 30 11:45:33.700109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 30 11:45:33.700109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 11:45:33.700109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 11:45:33.700109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 11:45:33.700109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:33.700109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 484/969] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Aug 30 11:45:33 2022] POST /identity/v3/users => generated 160 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:33.700109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738062d3-58c5-4452-b283-9a070a47fbf6 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:33.764145 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:33.793639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44388a-a5c5-4274-9595-ac2ab847e7be None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:33.814954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738062d3-58c5-4452-b283-9a070a47fbf6 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:33.829651 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ca9a5-65d1-46d5-8f1b-0483f5e60ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:33.830585 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ca9a5-65d1-46d5-8f1b-0483f5e60ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:33.831044 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ca9a5-65d1-46d5-8f1b-0483f5e60ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:33.831539 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ca9a5-65d1-46d5-8f1b-0483f5e60ee5 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:33.832425 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ca9a5-65d1-46d5-8f1b-0483f5e60ee5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:33.832908 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ca9a5-65d1-46d5-8f1b-0483f5e60ee5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:33.834498 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ca9a5-65d1-46d5-8f1b-0483f5e60ee5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:33.853000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 486/970] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:45:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:33.854728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ca9a5-65d1-46d5-8f1b-0483f5e60ee5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:33.856569 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0078a3-f3cf-436e-93a0-cf7e1a615e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:33.857390 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0078a3-f3cf-436e-93a0-cf7e1a615e00 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:33.857779 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0078a3-f3cf-436e-93a0-cf7e1a615e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:33.858257 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0078a3-f3cf-436e-93a0-cf7e1a615e00 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:33.867150 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:33.867419 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0078a3-f3cf-436e-93a0-cf7e1a615e00 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:33.869212 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0078a3-f3cf-436e-93a0-cf7e1a615e00 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:33.882854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-fa0078a3-f3cf-436e-93a0-cf7e1a615e00 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 11:45:33.882854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:33.882854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:33.882854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:33.882854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:33.882854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:33.882854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:33.882854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:33.882854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:33.882854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:33.882854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:33.882854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:33.882854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:45:33.882854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:45:33.882854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:45:33.882854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:45:33.883908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:33.883908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:33.883908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:45:33.883908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:33.883908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:45:33.883908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:33.883908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:33.883908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:33.883908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:33.883908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:33.883908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:33.883908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:33.883908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:33.883908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:33.883908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:33.883908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:33.883908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:33.883908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:33.884831 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:33.884831 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:33.884831 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:45:33.884831 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:45:33.884831 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:45:33.884831 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:45:33.884831 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:45:33.884831 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:45:33.884831 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 11:45:33.884831 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:33.889068 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 485/971] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:45:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:33.890150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0078a3-f3cf-436e-93a0-cf7e1a615e00 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:33.967963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ca9a5-65d1-46d5-8f1b-0483f5e60ee5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:33.997030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0078a3-f3cf-436e-93a0-cf7e1a615e00 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:34.004646 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6e8aa-a086-4d80-8721-06bc4bb9b808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:34.005235 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6e8aa-a086-4d80-8721-06bc4bb9b808 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:34.005510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6e8aa-a086-4d80-8721-06bc4bb9b808 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:34.005776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6e8aa-a086-4d80-8721-06bc4bb9b808 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:34.006502 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6e8aa-a086-4d80-8721-06bc4bb9b808 None admin] RBAC: Adding query filter params (role.id=8c34d24ef14b407f81bb5fb31973ddb0, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=58c86110ce97463e9b3d53691ae3e12c) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:34.007063 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6e8aa-a086-4d80-8721-06bc4bb9b808 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:34.008273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6e8aa-a086-4d80-8721-06bc4bb9b808 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:34.015020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 487/972] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:45:33 2022] GET /identity/v3/role_assignments?user.id=58c86110ce97463e9b3d53691ae3e12c&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=8c34d24ef14b407f81bb5fb31973ddb0 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:34.015892 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70fc8f-c225-48f7-be2e-74f4ea6be2f3 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:34.016173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70fc8f-c225-48f7-be2e-74f4ea6be2f3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:34.016444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70fc8f-c225-48f7-be2e-74f4ea6be2f3 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:34.017639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 488/973] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:34.031508 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d9e6f-6c3a-4a1a-9421-4e0d972f4f43 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:34.031508 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d9e6f-6c3a-4a1a-9421-4e0d972f4f43 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:34.031508 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d9e6f-6c3a-4a1a-9421-4e0d972f4f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:34.032785 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:34.051604 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-531d9e6f-6c3a-4a1a-9421-4e0d972f4f43 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:34.053221 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-531d9e6f-6c3a-4a1a-9421-4e0d972f4f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:34.053580 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2b32e-e3d3-4ab5-bb39-3fe3e92232a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:34.054224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2b32e-e3d3-4ab5-bb39-3fe3e92232a7 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:34.054500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2b32e-e3d3-4ab5-bb39-3fe3e92232a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:34.054769 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2b32e-e3d3-4ab5-bb39-3fe3e92232a7 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:34.055518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2b32e-e3d3-4ab5-bb39-3fe3e92232a7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:34.055820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2b32e-e3d3-4ab5-bb39-3fe3e92232a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:34.057285 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2b32e-e3d3-4ab5-bb39-3fe3e92232a7 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:34.120850 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 486/974] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Aug 30 11:45:33 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:34.120850 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b434b7-1d19-44ea-9225-4336e84c9c66 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:34.120850 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b434b7-1d19-44ea-9225-4336e84c9c66 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:34.120850 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b434b7-1d19-44ea-9225-4336e84c9c66 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:34.120850 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 487/975] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:34.123881 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16299d8b-f217-40e2-aff1-7c829b8f8fb7 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:34.124210 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16299d8b-f217-40e2-aff1-7c829b8f8fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:34.124432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16299d8b-f217-40e2-aff1-7c829b8f8fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:34.137529 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 489/976] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:45:34.147463 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-16299d8b-f217-40e2-aff1-7c829b8f8fb7 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:34.149170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-16299d8b-f217-40e2-aff1-7c829b8f8fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:34.232964 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 488/977] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:34.413890 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d9e6f-6c3a-4a1a-9421-4e0d972f4f43 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:34.416179 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:34.507068 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16299d8b-f217-40e2-aff1-7c829b8f8fb7 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:34.519588 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d9e6f-6c3a-4a1a-9421-4e0d972f4f43 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:34.556916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf031f-fc3a-4e6b-acd5-580c2534525a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:34.557548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf031f-fc3a-4e6b-acd5-580c2534525a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:34.557823 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf031f-fc3a-4e6b-acd5-580c2534525a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:34.558089 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf031f-fc3a-4e6b-acd5-580c2534525a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:34.558667 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf031f-fc3a-4e6b-acd5-580c2534525a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:34.560067 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf031f-fc3a-4e6b-acd5-580c2534525a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:34.569869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-87cf031f-fc3a-4e6b-acd5-580c2534525a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:45:34.569869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:34.569869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:45:34.569869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:45:34.569869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:45:34.569869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:45:34.569869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:45:34.569869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:34.569869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:45:34.569869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:34.569869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:34.569869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:34.569869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:34.569869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:34.569869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:34.569869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:34.569869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:34.570966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:34.570966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:34.570966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:34.570966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:34.570966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:34.570966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:34.570966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:45:34.570966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:45:34.570966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:45:34.570966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:45:34.570966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:34.570966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:34.570966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:34.570966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:34.570966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:34.570966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:34.572882 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:34.572882 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:34.572882 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:34.572882 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:34.572882 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:34.572882 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:34.572882 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:34.572882 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:34.572882 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:34.572882 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:34.572882 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:45:34.572882 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:34.572882 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:45:34.572882 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:34.572882 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 490/978] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Aug 30 11:45:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:34.576922 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf031f-fc3a-4e6b-acd5-580c2534525a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:34.613523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16299d8b-f217-40e2-aff1-7c829b8f8fb7 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:34.621109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:34.649739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:34.650334 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61708c4-3533-441d-babd-e3de14fdace3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:34.652873 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61708c4-3533-441d-babd-e3de14fdace3 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:34.653366 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61708c4-3533-441d-babd-e3de14fdace3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:34.653826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61708c4-3533-441d-babd-e3de14fdace3 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:34.655221 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61708c4-3533-441d-babd-e3de14fdace3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:34.657706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61708c4-3533-441d-babd-e3de14fdace3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:34.674916 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 489/979] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Aug 30 11:45:34 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:45:34.695108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf031f-fc3a-4e6b-acd5-580c2534525a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:34.742742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75291045-2373-49bb-823a-467cfd1e5780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:34.743396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75291045-2373-49bb-823a-467cfd1e5780 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:34.743670 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75291045-2373-49bb-823a-467cfd1e5780 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:34.743937 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75291045-2373-49bb-823a-467cfd1e5780 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:34.744583 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75291045-2373-49bb-823a-467cfd1e5780 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:34.744873 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75291045-2373-49bb-823a-467cfd1e5780 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:34.746250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75291045-2373-49bb-823a-467cfd1e5780 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:34.757404 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 491/980] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Aug 30 11:45:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:34.758304 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61708c4-3533-441d-babd-e3de14fdace3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:34.870505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61708c4-3533-441d-babd-e3de14fdace3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:34.903073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807caca-0b04-48e8-847a-09bde41c2324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:34.903714 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807caca-0b04-48e8-847a-09bde41c2324 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:34.903987 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807caca-0b04-48e8-847a-09bde41c2324 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:34.904256 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807caca-0b04-48e8-847a-09bde41c2324 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:34.904946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807caca-0b04-48e8-847a-09bde41c2324 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:34.905337 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807caca-0b04-48e8-847a-09bde41c2324 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:34.906725 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807caca-0b04-48e8-847a-09bde41c2324 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:34.911727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 490/981] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Aug 30 11:45:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:34.917293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75291045-2373-49bb-823a-467cfd1e5780 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:35.021476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75291045-2373-49bb-823a-467cfd1e5780 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:35.047926 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:35.058195 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c268dfd-a18e-4d4d-ad71-c7a4e203125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:35.058861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c268dfd-a18e-4d4d-ad71-c7a4e203125a None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:35.059140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c268dfd-a18e-4d4d-ad71-c7a4e203125a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:35.059431 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c268dfd-a18e-4d4d-ad71-c7a4e203125a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:35.060118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c268dfd-a18e-4d4d-ad71-c7a4e203125a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:35.061763 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c268dfd-a18e-4d4d-ad71-c7a4e203125a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:35.084884 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 492/982] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:45:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:45:36.045501 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195899a-816d-4888-add6-ebd9fb360fce None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:36.046116 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195899a-816d-4888-add6-ebd9fb360fce None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:36.046116 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195899a-816d-4888-add6-ebd9fb360fce None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:36.047538 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 491/983] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:36.052943 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199f261-c08e-4576-8f9f-211e2ddd0077 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:36.053375 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199f261-c08e-4576-8f9f-211e2ddd0077 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:36.053642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199f261-c08e-4576-8f9f-211e2ddd0077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:36.073218 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6199f261-c08e-4576-8f9f-211e2ddd0077 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:36.074413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6199f261-c08e-4576-8f9f-211e2ddd0077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:36.163406 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 493/984] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:36.423768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195899a-816d-4888-add6-ebd9fb360fce None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:36.458370 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:36.535460 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195899a-816d-4888-add6-ebd9fb360fce None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:36.571007 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6926d3-ce68-49fe-8bd0-18e8954ae2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:36.571676 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6926d3-ce68-49fe-8bd0-18e8954ae2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:36.571997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6926d3-ce68-49fe-8bd0-18e8954ae2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:36.572254 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6926d3-ce68-49fe-8bd0-18e8954ae2d8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:36.572868 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6926d3-ce68-49fe-8bd0-18e8954ae2d8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:36.574257 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6926d3-ce68-49fe-8bd0-18e8954ae2d8 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:36.583503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-3f6926d3-ce68-49fe-8bd0-18e8954ae2d8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 11:45:36.583503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:36.583503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:45:36.583503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:45:36.583503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:45:36.583503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:45:36.583503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:45:36.583503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:36.583503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 11:45:36.583503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:36.583503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:36.583503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:36.583503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:36.583503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:36.583503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:36.583503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:36.583503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:36.584548 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:36.584548 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:36.584548 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:36.584548 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:36.584548 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:36.584548 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:36.584548 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:45:36.584548 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:45:36.584548 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:45:36.584548 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:45:36.584548 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:36.584548 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:36.584548 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:36.584548 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:36.584548 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:36.584548 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:36.586085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:36.586085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:36.586085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:36.586085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:36.586085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:36.586085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:36.586085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:36.586085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:36.586085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:36.586085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:36.586085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:45:36.586085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:36.586085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 11:45:36.586085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:36.587288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 492/985] 10.222.0.27 () {56 vars in 1105 bytes} [Tue Aug 30 11:45:36 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:36.588225 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaa96c-ee02-40c7-94b7-c6fbdaf57dec None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:36.588405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaa96c-ee02-40c7-94b7-c6fbdaf57dec None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:36.588721 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaa96c-ee02-40c7-94b7-c6fbdaf57dec None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:36.590498 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 494/986] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:36.590637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6926d3-ce68-49fe-8bd0-18e8954ae2d8 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:36.595119 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e3c9b-13ef-4d0b-96b1-2aadfc4d8ad8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:36.595436 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e3c9b-13ef-4d0b-96b1-2aadfc4d8ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:36.595711 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e3c9b-13ef-4d0b-96b1-2aadfc4d8ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:36.615309 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-807e3c9b-13ef-4d0b-96b1-2aadfc4d8ad8 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:36.616525 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-807e3c9b-13ef-4d0b-96b1-2aadfc4d8ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:36.691555 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 495/987] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:45:36.692599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:36.700284 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6926d3-ce68-49fe-8bd0-18e8954ae2d8 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:36.734944 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dc8dd-bcbd-4785-89f7-3c662bed476d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:36.735583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dc8dd-bcbd-4785-89f7-3c662bed476d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:36.735859 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dc8dd-bcbd-4785-89f7-3c662bed476d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:36.736177 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dc8dd-bcbd-4785-89f7-3c662bed476d None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:36.736796 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7dc8dd-bcbd-4785-89f7-3c662bed476d None admin] RBAC: Adding query filter params (name=image) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:36.737094 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7dc8dd-bcbd-4785-89f7-3c662bed476d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:36.738465 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7dc8dd-bcbd-4785-89f7-3c662bed476d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:36.743452 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 493/988] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:36.749302 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e3c9b-13ef-4d0b-96b1-2aadfc4d8ad8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:36.790035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:36.854085 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e3c9b-13ef-4d0b-96b1-2aadfc4d8ad8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:36.889469 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76d6dc-1b50-4757-8edb-ec291b289745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:36.890083 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76d6dc-1b50-4757-8edb-ec291b289745 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:36.890353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76d6dc-1b50-4757-8edb-ec291b289745 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:36.890618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76d6dc-1b50-4757-8edb-ec291b289745 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:36.891238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76d6dc-1b50-4757-8edb-ec291b289745 None admin] RBAC: Adding query filter params (type=image) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:36.891563 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76d6dc-1b50-4757-8edb-ec291b289745 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:36.892939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76d6dc-1b50-4757-8edb-ec291b289745 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:36.897808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 496/989] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:36.952715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dc8dd-bcbd-4785-89f7-3c662bed476d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:37.001950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acbc79-1907-4255-a344-dd48eccf8ee3 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:37.002229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acbc79-1907-4255-a344-dd48eccf8ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:37.002497 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acbc79-1907-4255-a344-dd48eccf8ee3 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:37.003909 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 497/990] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:37.009520 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4821b64-7458-41bf-9f89-7ef6f2f771e5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:37.010203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4821b64-7458-41bf-9f89-7ef6f2f771e5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:37.010203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4821b64-7458-41bf-9f89-7ef6f2f771e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:37.029672 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e4821b64-7458-41bf-9f89-7ef6f2f771e5 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:37.031096 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e4821b64-7458-41bf-9f89-7ef6f2f771e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:37.071448 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dc8dd-bcbd-4785-89f7-3c662bed476d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:37.110857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62d64f-f3fa-47ce-b36d-d670200708af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:37.111840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62d64f-f3fa-47ce-b36d-d670200708af None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:37.112118 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62d64f-f3fa-47ce-b36d-d670200708af None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:37.112433 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62d64f-f3fa-47ce-b36d-d670200708af None admin] PATH_INFO: `/v3/services/compute` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:37.113174 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62d64f-f3fa-47ce-b36d-d670200708af None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:37.115111 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62d64f-f3fa-47ce-b36d-d670200708af None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:37.123394 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 498/991] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:37.124424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-1d62d64f-f3fa-47ce-b36d-d670200708af None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 11:45:37.124424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:37.124424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:45:37.124424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:45:37.124424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:45:37.124424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:45:37.124424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:45:37.124424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:37.124424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 11:45:37.124424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:37.124424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:37.124424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:37.124424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:37.124424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:37.124424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:37.124424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:37.124424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:37.125500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:37.125500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:37.125500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:37.125500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:37.125500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:37.125500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:37.125500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:45:37.125500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:45:37.125500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:45:37.125500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:45:37.125500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:37.125500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:37.125500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:37.125500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:37.125500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:37.125500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:37.126339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:37.126339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:37.126339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:37.126339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:37.126339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:37.126339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:37.126339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:37.126339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:37.126339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:37.126339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:37.126339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:45:37.126339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:37.126339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 11:45:37.126339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:37.126339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 494/992] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:37.131716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4821b64-7458-41bf-9f89-7ef6f2f771e5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:37.163953 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:37.235989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4821b64-7458-41bf-9f89-7ef6f2f771e5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:37.270623 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3757382-341b-4993-b892-def3faf990ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:37.271226 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3757382-341b-4993-b892-def3faf990ef None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:37.271541 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3757382-341b-4993-b892-def3faf990ef None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:37.271812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3757382-341b-4993-b892-def3faf990ef None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:37.272447 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3757382-341b-4993-b892-def3faf990ef None admin] RBAC: Adding query filter params (name=compute) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:37.272799 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3757382-341b-4993-b892-def3faf990ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:37.274169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3757382-341b-4993-b892-def3faf990ef None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:37.279251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 499/993] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Aug 30 11:45:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:37.285025 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62d64f-f3fa-47ce-b36d-d670200708af None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:37.310304 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:37.385979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3757382-341b-4993-b892-def3faf990ef None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:37.393612 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62d64f-f3fa-47ce-b36d-d670200708af None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:37.430551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f32c6-4638-42f7-9ff2-ab54e1aea8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:37.431170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f32c6-4638-42f7-9ff2-ab54e1aea8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:37.431480 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f32c6-4638-42f7-9ff2-ab54e1aea8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:37.431750 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f32c6-4638-42f7-9ff2-ab54e1aea8c5 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:37.432375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f32c6-4638-42f7-9ff2-ab54e1aea8c5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:37.432682 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f32c6-4638-42f7-9ff2-ab54e1aea8c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:37.434068 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f32c6-4638-42f7-9ff2-ab54e1aea8c5 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:37.439268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 495/994] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Aug 30 11:45:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:37.444849 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f32c6-4638-42f7-9ff2-ab54e1aea8c5 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:37.491033 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:37.497809 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3757382-341b-4993-b892-def3faf990ef None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:37.535286 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf9946-19f5-45e0-bc99-c5d240f7e3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:37.535961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf9946-19f5-45e0-bc99-c5d240f7e3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:37.536240 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf9946-19f5-45e0-bc99-c5d240f7e3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:37.536596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf9946-19f5-45e0-bc99-c5d240f7e3c5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:37.537086 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf9946-19f5-45e0-bc99-c5d240f7e3c5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:37.538452 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf9946-19f5-45e0-bc99-c5d240f7e3c5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:37.541617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:37.549160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-bdaf9946-19f5-45e0-bc99-c5d240f7e3c5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:45:37.549160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:37.549160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:45:37.549160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:45:37.549160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:45:37.549160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:45:37.549160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:45:37.549160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:37.549160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:45:37.549160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:37.549160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:37.549160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:37.549160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:37.549160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:37.549160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:37.549160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:37.549160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:37.550173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:37.550173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:37.550173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:37.550173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:37.550173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:37.550173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:37.550173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:45:37.550173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:45:37.550173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:45:37.550173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:45:37.550173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:37.550173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:37.550173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:37.550173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:37.550173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:37.550173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:37.551010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:37.551010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:37.551010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:37.551010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:37.551010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:37.551010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:37.551010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:37.551010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:37.551010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:37.551010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:37.551010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:45:37.551010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:37.551010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:45:37.551010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:37.551010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 500/995] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Aug 30 11:45:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:37.556105 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf9946-19f5-45e0-bc99-c5d240f7e3c5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:37.561156 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f32c6-4638-42f7-9ff2-ab54e1aea8c5 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:37.595964 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999cdc2-2af3-458d-9c4f-ab00df6eed36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:37.596580 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999cdc2-2af3-458d-9c4f-ab00df6eed36 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:37.596857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999cdc2-2af3-458d-9c4f-ab00df6eed36 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:37.597128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999cdc2-2af3-458d-9c4f-ab00df6eed36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:37.597818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999cdc2-2af3-458d-9c4f-ab00df6eed36 None admin] RBAC: Adding query filter params (interface=public, service_id=e708847ae84d47729f1290d9620286b9, region_id=RegionOne) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:37.598128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999cdc2-2af3-458d-9c4f-ab00df6eed36 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:37.599536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999cdc2-2af3-458d-9c4f-ab00df6eed36 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:37.604866 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 496/996] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Aug 30 11:45:37 2022] GET /identity/v3/endpoints?service_id=e708847ae84d47729f1290d9620286b9&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:37.610492 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999cdc2-2af3-458d-9c4f-ab00df6eed36 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:37.663758 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf9946-19f5-45e0-bc99-c5d240f7e3c5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:37.697510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbaa434-79f2-49db-a55a-a8449edb99da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:37.698127 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaa434-79f2-49db-a55a-a8449edb99da None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:37.698406 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaa434-79f2-49db-a55a-a8449edb99da None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:37.698682 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaa434-79f2-49db-a55a-a8449edb99da None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:37.699308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbaa434-79f2-49db-a55a-a8449edb99da None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:37.699638 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbaa434-79f2-49db-a55a-a8449edb99da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:37.701028 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbaa434-79f2-49db-a55a-a8449edb99da None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:37.705775 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 501/997] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Aug 30 11:45:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:37.711523 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbaa434-79f2-49db-a55a-a8449edb99da None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:37.721438 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999cdc2-2af3-458d-9c4f-ab00df6eed36 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:37.738623 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:37.759596 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcab31-470b-4266-befc-e8e345bbf356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:37.760135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcab31-470b-4266-befc-e8e345bbf356 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:37.760434 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcab31-470b-4266-befc-e8e345bbf356 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:37.760700 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcab31-470b-4266-befc-e8e345bbf356 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:37.761379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcab31-470b-4266-befc-e8e345bbf356 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:37.762754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcab31-470b-4266-befc-e8e345bbf356 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:37.769510 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 497/998] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Aug 30 11:45:37 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:45:37.824335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbaa434-79f2-49db-a55a-a8449edb99da None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:37.863767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7915801-c50d-4767-bb39-12213add38e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:37.864407 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7915801-c50d-4767-bb39-12213add38e0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:37.864681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7915801-c50d-4767-bb39-12213add38e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:37.864949 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7915801-c50d-4767-bb39-12213add38e0 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:37.865693 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7915801-c50d-4767-bb39-12213add38e0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:37.866012 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7915801-c50d-4767-bb39-12213add38e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:37.867466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7915801-c50d-4767-bb39-12213add38e0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:37.873590 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 502/999] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Aug 30 11:45:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:37.879606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcab31-470b-4266-befc-e8e345bbf356 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:37.898487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:37.995572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcab31-470b-4266-befc-e8e345bbf356 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:38.032872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606bcd6-5f3d-41da-b7f5-c99094be8a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:38.033390 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606bcd6-5f3d-41da-b7f5-c99094be8a20 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:38.033637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606bcd6-5f3d-41da-b7f5-c99094be8a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:38.033935 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606bcd6-5f3d-41da-b7f5-c99094be8a20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:38.034802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606bcd6-5f3d-41da-b7f5-c99094be8a20 None admin] RBAC: Adding query filter params (interface=admin, service_id=8f2b5fb3e7a240a58f64388ce682291e, region_id=RegionOne) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:38.035329 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606bcd6-5f3d-41da-b7f5-c99094be8a20 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:38.036944 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606bcd6-5f3d-41da-b7f5-c99094be8a20 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:38.042866 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 498/1000] 10.222.0.27 () {56 vars in 1249 bytes} [Tue Aug 30 11:45:37 2022] GET /identity/v3/endpoints?service_id=8f2b5fb3e7a240a58f64388ce682291e&interface=admin®ion_id=RegionOne => generated 193 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:38.049011 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7915801-c50d-4767-bb39-12213add38e0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:38.152153 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:38.166891 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7915801-c50d-4767-bb39-12213add38e0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:38.202193 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90a07d-a3f0-477c-9be6-9731707ef467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:38.202871 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90a07d-a3f0-477c-9be6-9731707ef467 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:38.203150 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90a07d-a3f0-477c-9be6-9731707ef467 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:38.203439 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90a07d-a3f0-477c-9be6-9731707ef467 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:38.204085 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90a07d-a3f0-477c-9be6-9731707ef467 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:38.205458 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90a07d-a3f0-477c-9be6-9731707ef467 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:38.212331 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 503/1001] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Aug 30 11:45:38 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:45:38.785931 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894043c8-c896-4acf-99bf-44266858d5db None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:38.786508 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894043c8-c896-4acf-99bf-44266858d5db None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:38.786508 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894043c8-c896-4acf-99bf-44266858d5db None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:38.788088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 499/1002] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:38.793524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2dc052-bd61-47e4-99a7-46039bffdd50 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:38.793810 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2dc052-bd61-47e4-99a7-46039bffdd50 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:38.794078 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2dc052-bd61-47e4-99a7-46039bffdd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:38.813022 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1a2dc052-bd61-47e4-99a7-46039bffdd50 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:38.814209 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1a2dc052-bd61-47e4-99a7-46039bffdd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:38.888498 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 504/1003] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:39.152606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894043c8-c896-4acf-99bf-44266858d5db None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:39.237210 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:39.260266 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894043c8-c896-4acf-99bf-44266858d5db None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:39.296977 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4fa4a-42cf-476a-ad10-39d0e2f50f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:39.297636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4fa4a-42cf-476a-ad10-39d0e2f50f71 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:39.297921 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4fa4a-42cf-476a-ad10-39d0e2f50f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:39.298184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4fa4a-42cf-476a-ad10-39d0e2f50f71 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:39.298848 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4fa4a-42cf-476a-ad10-39d0e2f50f71 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:39.300262 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4fa4a-42cf-476a-ad10-39d0e2f50f71 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:39.316807 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 500/1004] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Aug 30 11:45:39 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:45:39.662975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6279d-d365-499f-91e1-c51b657259ad None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:39.663555 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6279d-d365-499f-91e1-c51b657259ad None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:39.663555 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6279d-d365-499f-91e1-c51b657259ad None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:39.665102 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 505/1005] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:39.670299 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86dc816-8db5-4513-9d09-6fb68e18330e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:39.670562 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86dc816-8db5-4513-9d09-6fb68e18330e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:39.670841 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86dc816-8db5-4513-9d09-6fb68e18330e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:39.689532 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f86dc816-8db5-4513-9d09-6fb68e18330e None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:39.690697 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f86dc816-8db5-4513-9d09-6fb68e18330e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:39.769137 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 501/1006] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:39 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:45:40.026862 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6279d-d365-499f-91e1-c51b657259ad None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:40.118044 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:40.118627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da531e-26bf-48cc-84c0-22cf947c52e6 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:40.119116 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da531e-26bf-48cc-84c0-22cf947c52e6 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:40.119211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da531e-26bf-48cc-84c0-22cf947c52e6 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:40.120996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 502/1007] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:40.126906 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700139d-cfa8-4ec6-9813-2f22d0248b63 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:40.127194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700139d-cfa8-4ec6-9813-2f22d0248b63 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:40.127826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700139d-cfa8-4ec6-9813-2f22d0248b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:40.143310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6279d-d365-499f-91e1-c51b657259ad None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:40.145956 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-9700139d-cfa8-4ec6-9813-2f22d0248b63 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:40.147155 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9700139d-cfa8-4ec6-9813-2f22d0248b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:40.181378 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8c67e-cce5-45d6-ae37-53ac049557b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:40.182012 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8c67e-cce5-45d6-ae37-53ac049557b7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:40.182287 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8c67e-cce5-45d6-ae37-53ac049557b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:40.182554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8c67e-cce5-45d6-ae37-53ac049557b7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:40.183126 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8c67e-cce5-45d6-ae37-53ac049557b7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:40.184563 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8c67e-cce5-45d6-ae37-53ac049557b7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:40.194365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-80f8c67e-cce5-45d6-ae37-53ac049557b7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 11:45:40.194365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:40.194365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:45:40.194365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:45:40.194365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:45:40.194365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:45:40.194365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:45:40.194365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:40.194365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 11:45:40.194365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:40.194365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:40.194365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:40.194365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:40.194365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:40.194365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:40.194365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:40.194365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:40.195644 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:40.195644 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:40.195644 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:40.195644 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:40.195644 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:40.195644 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:40.195644 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:45:40.195644 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:45:40.195644 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:45:40.195644 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:45:40.195644 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:40.195644 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:40.195644 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:40.195644 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:40.195644 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:40.195644 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:40.196535 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:40.196535 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:40.196535 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:40.196535 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:40.196535 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:40.196535 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:40.196535 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:40.196535 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:40.196535 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:40.196535 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:40.196535 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:45:40.196535 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:40.196535 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 11:45:40.196535 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:40.196535 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 506/1008] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:40.201279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8c67e-cce5-45d6-ae37-53ac049557b7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:40.213353 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:40.229044 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 503/1009] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:40 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:45:40.308377 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8c67e-cce5-45d6-ae37-53ac049557b7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:40.343859 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afa01a-1885-4626-98a5-9637d2d4e85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:40.344475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afa01a-1885-4626-98a5-9637d2d4e85b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:40.344747 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afa01a-1885-4626-98a5-9637d2d4e85b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:40.345067 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afa01a-1885-4626-98a5-9637d2d4e85b None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:40.345690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afa01a-1885-4626-98a5-9637d2d4e85b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:40.345985 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afa01a-1885-4626-98a5-9637d2d4e85b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:40.347343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afa01a-1885-4626-98a5-9637d2d4e85b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:40.356799 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 507/1010] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Aug 30 11:45:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:40.358053 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700139d-cfa8-4ec6-9813-2f22d0248b63 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:40.462391 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700139d-cfa8-4ec6-9813-2f22d0248b63 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:40.489824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afa01a-1885-4626-98a5-9637d2d4e85b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:40.498453 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8f610-08f4-4a80-b8a8-b3a4161c41ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:40.499327 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8f610-08f4-4a80-b8a8-b3a4161c41ec None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:40.499647 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8f610-08f4-4a80-b8a8-b3a4161c41ec None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:40.499918 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8f610-08f4-4a80-b8a8-b3a4161c41ec None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:40.500540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8f610-08f4-4a80-b8a8-b3a4161c41ec None admin] RBAC: Adding query filter params (type=compute) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:40.500838 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8f610-08f4-4a80-b8a8-b3a4161c41ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:40.502211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8f610-08f4-4a80-b8a8-b3a4161c41ec None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:40.502882 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:40.512708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 504/1011] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Aug 30 11:45:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:40.513718 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8f610-08f4-4a80-b8a8-b3a4161c41ec None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:40.577814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:40.598481 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afa01a-1885-4626-98a5-9637d2d4e85b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:40.621370 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8f610-08f4-4a80-b8a8-b3a4161c41ec None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:40.634068 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc3109-fe8f-4635-80ab-97f796d1e557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:40.634709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc3109-fe8f-4635-80ab-97f796d1e557 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:40.634982 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc3109-fe8f-4635-80ab-97f796d1e557 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:40.635248 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc3109-fe8f-4635-80ab-97f796d1e557 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:40.635897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc3109-fe8f-4635-80ab-97f796d1e557 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:40.637340 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc3109-fe8f-4635-80ab-97f796d1e557 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:40.646110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-bdbc3109-fe8f-4635-80ab-97f796d1e557 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:45:40.646110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:40.646110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:45:40.646110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:45:40.646110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:45:40.646110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:45:40.646110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:45:40.646110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:40.646110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:45:40.646110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:40.646110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:40.646110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:40.646110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:40.646110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:40.646110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:40.646110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:40.646110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:40.647169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:40.647169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:40.647169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:40.647169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:40.647169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:40.647169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:40.647169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:45:40.647169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:45:40.647169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:45:40.647169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:45:40.647169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:40.647169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:40.647169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:40.647169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:40.647169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:40.647169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:40.648566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:40.648566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:40.648566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:40.648566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:40.648566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:40.648566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:40.648566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:40.648566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:40.648566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:40.648566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:40.648566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:45:40.648566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:40.648566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 11:45:40.648566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:40.648566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 508/1012] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Aug 30 11:45:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:40.652998 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc3109-fe8f-4635-80ab-97f796d1e557 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:40.661809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd4470-8f58-456a-a4ea-8a86f33bfdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:40.662427 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd4470-8f58-456a-a4ea-8a86f33bfdcf None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:40.662699 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd4470-8f58-456a-a4ea-8a86f33bfdcf None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:40.662960 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd4470-8f58-456a-a4ea-8a86f33bfdcf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:40.663639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd4470-8f58-456a-a4ea-8a86f33bfdcf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:40.665013 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd4470-8f58-456a-a4ea-8a86f33bfdcf None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:40.691448 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 505/1013] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:45:40 2022] POST /identity/v3/endpoints => generated 334 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:45:40.747479 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:40.776817 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc3109-fe8f-4635-80ab-97f796d1e557 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:40.821773 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feccd6f-7c25-4ad5-a5d4-6cab0e46218f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:40.822397 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feccd6f-7c25-4ad5-a5d4-6cab0e46218f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:40.822634 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feccd6f-7c25-4ad5-a5d4-6cab0e46218f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:40.822933 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feccd6f-7c25-4ad5-a5d4-6cab0e46218f None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:40.823594 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feccd6f-7c25-4ad5-a5d4-6cab0e46218f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:40.823875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feccd6f-7c25-4ad5-a5d4-6cab0e46218f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:40.825273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feccd6f-7c25-4ad5-a5d4-6cab0e46218f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:40.831292 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 509/1014] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Aug 30 11:45:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:40.836883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd4470-8f58-456a-a4ea-8a86f33bfdcf None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:40.942815 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd4470-8f58-456a-a4ea-8a86f33bfdcf None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:40.958783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:40.980831 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7481647-272f-41ec-99fd-bb52e3719914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:40.981455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7481647-272f-41ec-99fd-bb52e3719914 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:40.981735 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7481647-272f-41ec-99fd-bb52e3719914 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:40.982012 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7481647-272f-41ec-99fd-bb52e3719914 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:40.982934 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7481647-272f-41ec-99fd-bb52e3719914 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:40.983239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7481647-272f-41ec-99fd-bb52e3719914 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:40.984740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7481647-272f-41ec-99fd-bb52e3719914 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:40.990245 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 506/1015] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Aug 30 11:45:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:40.996216 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feccd6f-7c25-4ad5-a5d4-6cab0e46218f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:41.099780 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feccd6f-7c25-4ad5-a5d4-6cab0e46218f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:41.138664 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c67817-4e8b-460e-8fec-5e5b01b26381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:41.139428 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c67817-4e8b-460e-8fec-5e5b01b26381 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:41.139770 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c67817-4e8b-460e-8fec-5e5b01b26381 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:41.140100 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c67817-4e8b-460e-8fec-5e5b01b26381 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:41.140826 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c67817-4e8b-460e-8fec-5e5b01b26381 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:41.142261 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c67817-4e8b-460e-8fec-5e5b01b26381 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:41.147006 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:41.160746 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 510/1016] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:45:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:45:41.234998 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931715a2-78ff-49bc-89d3-592766758e32 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:41.235561 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931715a2-78ff-49bc-89d3-592766758e32 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:41.235561 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931715a2-78ff-49bc-89d3-592766758e32 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:41.237146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 507/1017] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:41.242793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e263d6-5d62-446a-a987-607e743f972e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:41.243076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e263d6-5d62-446a-a987-607e743f972e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:41.243346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e263d6-5d62-446a-a987-607e743f972e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:41.264665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-42e263d6-5d62-446a-a987-607e743f972e None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:41.264665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-42e263d6-5d62-446a-a987-607e743f972e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:41.347820 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 511/1018] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:41.614785 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931715a2-78ff-49bc-89d3-592766758e32 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:41.719654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931715a2-78ff-49bc-89d3-592766758e32 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:41.753188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c13fc5-9f9c-404a-a368-94c9d7f4bd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:41.753815 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c13fc5-9f9c-404a-a368-94c9d7f4bd76 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:41.754093 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c13fc5-9f9c-404a-a368-94c9d7f4bd76 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:41.754362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c13fc5-9f9c-404a-a368-94c9d7f4bd76 None admin] PATH_INFO: `/v3/services/image` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:41.754935 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c13fc5-9f9c-404a-a368-94c9d7f4bd76 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:41.756348 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c13fc5-9f9c-404a-a368-94c9d7f4bd76 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:41.765502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-41c13fc5-9f9c-404a-a368-94c9d7f4bd76 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 11:45:41.765502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:41.765502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:45:41.765502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:45:41.765502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:45:41.765502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:45:41.765502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:45:41.765502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:41.765502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 11:45:41.765502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:41.765502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:41.765502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:41.765502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:41.765502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:41.765502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:41.765502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:41.765502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:41.766658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:41.766658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:41.766658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:41.766658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:41.766658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:41.766658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:41.766658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:45:41.766658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:45:41.766658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:45:41.766658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:45:41.766658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:41.766658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:41.766658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:41.766658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:41.766658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:41.766658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:41.768216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:41.768216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:41.768216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:41.768216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:41.768216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:41.768216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:41.768216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:41.768216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:41.768216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:41.768216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:41.768216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:45:41.768216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:41.768216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 11:45:41.768216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:41.768216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 508/1019] 10.222.0.27 () {56 vars in 1105 bytes} [Tue Aug 30 11:45:41 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:41.772532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e263d6-5d62-446a-a987-607e743f972e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:41.873536 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e263d6-5d62-446a-a987-607e743f972e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:41.896493 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:41.914753 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e82fb2-fc67-417e-970b-3fa011cb9acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:41.915398 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e82fb2-fc67-417e-970b-3fa011cb9acb None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:41.915679 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e82fb2-fc67-417e-970b-3fa011cb9acb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:41.915958 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e82fb2-fc67-417e-970b-3fa011cb9acb None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:41.916595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e82fb2-fc67-417e-970b-3fa011cb9acb None admin] RBAC: Adding query filter params (name=image) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:41.916888 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e82fb2-fc67-417e-970b-3fa011cb9acb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:41.918259 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e82fb2-fc67-417e-970b-3fa011cb9acb None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:41.924086 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 512/1020] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:41.929659 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c13fc5-9f9c-404a-a368-94c9d7f4bd76 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:41.975082 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:42.032669 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c13fc5-9f9c-404a-a368-94c9d7f4bd76 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:42.066641 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4976533-e689-4279-9ea7-038c5ab13c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:42.067244 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4976533-e689-4279-9ea7-038c5ab13c45 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:42.067621 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4976533-e689-4279-9ea7-038c5ab13c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:42.067891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4976533-e689-4279-9ea7-038c5ab13c45 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:42.068514 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4976533-e689-4279-9ea7-038c5ab13c45 None admin] RBAC: Adding query filter params (type=image) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:42.068811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4976533-e689-4279-9ea7-038c5ab13c45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:42.070194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4976533-e689-4279-9ea7-038c5ab13c45 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:42.075242 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 509/1021] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:42.081232 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e82fb2-fc67-417e-970b-3fa011cb9acb None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:42.192089 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e82fb2-fc67-417e-970b-3fa011cb9acb None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:42.228726 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3771f77-ac5f-453b-9f15-74adf9b6333a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:42.229357 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3771f77-ac5f-453b-9f15-74adf9b6333a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:42.229636 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3771f77-ac5f-453b-9f15-74adf9b6333a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:42.229908 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3771f77-ac5f-453b-9f15-74adf9b6333a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:42.230622 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3771f77-ac5f-453b-9f15-74adf9b6333a None admin] RBAC: Adding query filter params (interface=public, service_id=b4b8fdf6ac894ed7bfe7b8b2326e03e6, region_id=RegionOne) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:42.230930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3771f77-ac5f-453b-9f15-74adf9b6333a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:42.232478 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3771f77-ac5f-453b-9f15-74adf9b6333a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:42.240579 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 513/1022] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Aug 30 11:45:42 2022] GET /identity/v3/endpoints?service_id=b4b8fdf6ac894ed7bfe7b8b2326e03e6&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:42.246060 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4976533-e689-4279-9ea7-038c5ab13c45 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:42.354637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4976533-e689-4279-9ea7-038c5ab13c45 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:42.362387 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:42.392764 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8032c02-ca2a-4a35-a3af-983205e9ffd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:42.393376 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8032c02-ca2a-4a35-a3af-983205e9ffd6 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:42.393631 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8032c02-ca2a-4a35-a3af-983205e9ffd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:42.393909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8032c02-ca2a-4a35-a3af-983205e9ffd6 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:42.394519 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8032c02-ca2a-4a35-a3af-983205e9ffd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:42.395944 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8032c02-ca2a-4a35-a3af-983205e9ffd6 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:42.402982 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 510/1023] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Aug 30 11:45:42 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:45:42.708234 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd433e-9ed6-404a-97a1-31bba1e97b23 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:42.708494 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd433e-9ed6-404a-97a1-31bba1e97b23 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:42.708741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd433e-9ed6-404a-97a1-31bba1e97b23 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:42.710292 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 514/1024] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:42.715741 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8abbca-ed2c-47e9-82e7-44d5c82eb79d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:42.716037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8abbca-ed2c-47e9-82e7-44d5c82eb79d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:42.716264 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8abbca-ed2c-47e9-82e7-44d5c82eb79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:42.734762 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2d8abbca-ed2c-47e9-82e7-44d5c82eb79d None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:42.735962 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2d8abbca-ed2c-47e9-82e7-44d5c82eb79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:42.806453 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 511/1025] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:43.068940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd433e-9ed6-404a-97a1-31bba1e97b23 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:43.089858 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaffa16-bd94-46ca-a8eb-1a8f4c4d3098 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:43.090233 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaffa16-bd94-46ca-a8eb-1a8f4c4d3098 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:43.090431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaffa16-bd94-46ca-a8eb-1a8f4c4d3098 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:43.092225 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 512/1026] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:43.098922 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f5146-96b0-480b-a865-acaa59d1a1b3 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:43.099204 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f5146-96b0-480b-a865-acaa59d1a1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:43.099552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f5146-96b0-480b-a865-acaa59d1a1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:43.121970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-8d3f5146-96b0-480b-a865-acaa59d1a1b3 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:43.123404 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8d3f5146-96b0-480b-a865-acaa59d1a1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:43.134724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:43.191352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd433e-9ed6-404a-97a1-31bba1e97b23 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:43.197120 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 513/1027] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:45:43.227529 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a10ea-bb76-4b41-a15c-a44cd9071cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:43.228476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a10ea-bb76-4b41-a15c-a44cd9071cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:43.228972 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a10ea-bb76-4b41-a15c-a44cd9071cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:43.229448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a10ea-bb76-4b41-a15c-a44cd9071cf9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:43.240699 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a10ea-bb76-4b41-a15c-a44cd9071cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:45:43.245619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3f3a10ea-bb76-4b41-a15c-a44cd9071cf9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:45:43.245619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:43.245619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:43.245619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:43.245619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:43.245619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:43.245619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:43.245619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:43.245619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:43.245619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:43.245619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:43.245619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:43.245619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:45:43.245619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:45:43.245619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:45:43.245619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:45:43.246554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:45:43.246554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:45:43.246554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:45:43.246554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:45:43.246554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:43.246554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:43.246554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:43.246554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:43.246554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:43.246554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:43.246554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:43.246554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:43.246554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:43.246554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:43.246554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:43.246554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:43.248950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:43.248950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:43.248950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:43.248950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:43.248950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:45:43.248950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:45:43.248950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:45:43.248950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:45:43.248950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:45:43.248950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:45:43.248950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:45:43.248950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:43.248950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 515/1028] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Aug 30 11:45:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:43.253840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f5146-96b0-480b-a865-acaa59d1a1b3 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:43.284982 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:43.358165 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f5146-96b0-480b-a865-acaa59d1a1b3 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:43.391553 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf4c1c-46dc-4d43-90a8-f94070f5896c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:43.392164 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf4c1c-46dc-4d43-90a8-f94070f5896c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:43.392435 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf4c1c-46dc-4d43-90a8-f94070f5896c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:43.392699 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf4c1c-46dc-4d43-90a8-f94070f5896c None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:43.393353 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf4c1c-46dc-4d43-90a8-f94070f5896c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:43.393649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf4c1c-46dc-4d43-90a8-f94070f5896c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:43.395032 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf4c1c-46dc-4d43-90a8-f94070f5896c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:43.403646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 514/1029] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Aug 30 11:45:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:43.409347 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a10ea-bb76-4b41-a15c-a44cd9071cf9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:43.483755 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf4c1c-46dc-4d43-90a8-f94070f5896c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:43.516819 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a10ea-bb76-4b41-a15c-a44cd9071cf9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:43.525699 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:43.553491 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c78fc-5f09-4fbb-847a-f0036df1d92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:43.554559 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c78fc-5f09-4fbb-847a-f0036df1d92d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:43.555050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c78fc-5f09-4fbb-847a-f0036df1d92d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:43.555508 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c78fc-5f09-4fbb-847a-f0036df1d92d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:43.570701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c78fc-5f09-4fbb-847a-f0036df1d92d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:43.572550 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c78fc-5f09-4fbb-847a-f0036df1d92d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:43.585850 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:43.589205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9f2c78fc-5f09-4fbb-847a-f0036df1d92d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:43.589205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:43.589205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:43.589205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:43.589205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:43.589205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:43.589205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:43.589205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:43.589205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:43.589205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:43.589205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:43.589205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:43.589205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:43.589205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:43.589205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:43.589205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:43.590171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:43.590171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:43.590171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:43.590171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:43.590171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:43.590171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:43.590171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:43.590171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:43.590171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:43.590171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:43.590171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:43.590171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:43.590171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:43.590171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:43.590171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:43.590171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:43.590171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:43.591521 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:43.591521 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:43.591521 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:43.591521 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 516/1030] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:43.596888 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c78fc-5f09-4fbb-847a-f0036df1d92d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:43.599938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf4c1c-46dc-4d43-90a8-f94070f5896c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:43.637691 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da42b1-8e87-4ea0-8b44-e0f0f543bb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:43.638255 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da42b1-8e87-4ea0-8b44-e0f0f543bb52 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:43.638582 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da42b1-8e87-4ea0-8b44-e0f0f543bb52 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:43.639423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da42b1-8e87-4ea0-8b44-e0f0f543bb52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:43.640563 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da42b1-8e87-4ea0-8b44-e0f0f543bb52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:43.642073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da42b1-8e87-4ea0-8b44-e0f0f543bb52 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:43.643706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 515/1031] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:43.649319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da42b1-8e87-4ea0-8b44-e0f0f543bb52 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:43.708557 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c78fc-5f09-4fbb-847a-f0036df1d92d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:43.752097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13fd02-e293-4c42-bad0-eb8aa7508042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:43.752716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13fd02-e293-4c42-bad0-eb8aa7508042 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:43.752958 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13fd02-e293-4c42-bad0-eb8aa7508042 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:43.753247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13fd02-e293-4c42-bad0-eb8aa7508042 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:43.753732 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da42b1-8e87-4ea0-8b44-e0f0f543bb52 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:43.753863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13fd02-e293-4c42-bad0-eb8aa7508042 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:43.754164 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13fd02-e293-4c42-bad0-eb8aa7508042 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:43.755774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13fd02-e293-4c42-bad0-eb8aa7508042 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:43.772516 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 517/1032] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:43.777985 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13fd02-e293-4c42-bad0-eb8aa7508042 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:43.794109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85413f68-55fa-49b4-8bde-6733ce004976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:43.795384 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85413f68-55fa-49b4-8bde-6733ce004976 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:43.796067 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85413f68-55fa-49b4-8bde-6733ce004976 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:43.796485 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85413f68-55fa-49b4-8bde-6733ce004976 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:43.797557 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85413f68-55fa-49b4-8bde-6733ce004976 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:43.799605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85413f68-55fa-49b4-8bde-6733ce004976 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:43.801519 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:43.831523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 516/1033] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Aug 30 11:45:43 2022] POST /identity/v3/projects => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:45:43.905000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13fd02-e293-4c42-bad0-eb8aa7508042 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:43.943120 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092eca12-5075-4532-b963-9e1c35b4cd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:43.943809 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092eca12-5075-4532-b963-9e1c35b4cd8c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:43.944082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092eca12-5075-4532-b963-9e1c35b4cd8c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:43.944347 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092eca12-5075-4532-b963-9e1c35b4cd8c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:43.952649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092eca12-5075-4532-b963-9e1c35b4cd8c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:43.954121 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092eca12-5075-4532-b963-9e1c35b4cd8c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:43.967995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-092eca12-5075-4532-b963-9e1c35b4cd8c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:45:43.967995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:43.967995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:43.967995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:43.967995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:43.967995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:43.967995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:43.967995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:43.967995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:43.967995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:43.967995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:43.967995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:43.967995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:45:43.967995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:45:43.967995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:45:43.967995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:45:43.969057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:43.969057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:43.969057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:45:43.969057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:43.969057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:45:43.969057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:43.969057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:43.969057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:43.969057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:43.969057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:43.969057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:43.969057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:43.969057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:43.969057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:43.969057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:43.969057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:43.969057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:43.969057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:43.970247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:43.970247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:43.970247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:45:43.970247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:45:43.970247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:45:43.970247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:45:43.970247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:45:43.970247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:45:43.970247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:45:43.970247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:43.970247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 518/1034] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Aug 30 11:45:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:43.975228 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85413f68-55fa-49b4-8bde-6733ce004976 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:43.993537 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:44.084262 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85413f68-55fa-49b4-8bde-6733ce004976 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:44.125746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435b473-93bc-4bc8-a2d5-8f44b2dfac54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:44.126367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435b473-93bc-4bc8-a2d5-8f44b2dfac54 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:44.126651 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435b473-93bc-4bc8-a2d5-8f44b2dfac54 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:44.126925 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435b473-93bc-4bc8-a2d5-8f44b2dfac54 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:44.127673 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435b473-93bc-4bc8-a2d5-8f44b2dfac54 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:44.127979 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435b473-93bc-4bc8-a2d5-8f44b2dfac54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:44.129426 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435b473-93bc-4bc8-a2d5-8f44b2dfac54 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:44.156953 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 517/1035] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Aug 30 11:45:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:44.158235 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092eca12-5075-4532-b963-9e1c35b4cd8c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:44.268658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:44.290970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092eca12-5075-4532-b963-9e1c35b4cd8c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:44.294040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e5bb2-28af-4e34-b217-eea37db66037 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:44.294519 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e5bb2-28af-4e34-b217-eea37db66037 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:44.294648 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e5bb2-28af-4e34-b217-eea37db66037 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:44.296883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 518/1036] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:45:44.301913 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0673f47-161d-47ef-9fab-544e7b7c0d43 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:44.302160 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0673f47-161d-47ef-9fab-544e7b7c0d43 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:44.302433 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0673f47-161d-47ef-9fab-544e7b7c0d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:44.322629 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-c0673f47-161d-47ef-9fab-544e7b7c0d43 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:44.323916 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c0673f47-161d-47ef-9fab-544e7b7c0d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:44.330275 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893512b-cca0-4be8-8561-9c42b801585d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:44.331318 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893512b-cca0-4be8-8561-9c42b801585d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:44.331800 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893512b-cca0-4be8-8561-9c42b801585d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:44.332283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893512b-cca0-4be8-8561-9c42b801585d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:44.394875 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:44.400837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 519/1037] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:45:44.412139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893512b-cca0-4be8-8561-9c42b801585d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:44.413562 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893512b-cca0-4be8-8561-9c42b801585d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:44.498337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:44.523510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 519/1038] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:45:44 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:45:44.525913 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0673f47-161d-47ef-9fab-544e7b7c0d43 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:44.630450 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0673f47-161d-47ef-9fab-544e7b7c0d43 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:44.665309 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0aaca4-750f-448b-a964-a169d8a144b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:44.665913 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0aaca4-750f-448b-a964-a169d8a144b3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:44.666193 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0aaca4-750f-448b-a964-a169d8a144b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:44.666459 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0aaca4-750f-448b-a964-a169d8a144b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:44.676555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0aaca4-750f-448b-a964-a169d8a144b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:44.678068 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0aaca4-750f-448b-a964-a169d8a144b3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:44.679634 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893512b-cca0-4be8-8561-9c42b801585d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:44.695595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-9a0aaca4-750f-448b-a964-a169d8a144b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:44.695595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:44.695595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:44.695595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:44.695595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:44.695595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:44.695595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:44.695595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:44.695595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:44.695595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:44.695595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:44.695595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:44.695595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:44.695595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:44.695595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:44.695595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:44.696590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:44.696590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:44.696590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:44.696590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:44.696590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:44.696590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:44.696590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:44.696590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:44.696590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:44.696590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:44.696590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:44.696590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:44.696590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:44.696590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:44.696590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:44.696590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:44.696590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:44.697715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:44.697715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:44.697715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:44.697715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 520/1039] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:44.702651 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0aaca4-750f-448b-a964-a169d8a144b3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:44.758337 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:44.788917 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893512b-cca0-4be8-8561-9c42b801585d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:44.817537 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0aaca4-750f-448b-a964-a169d8a144b3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:44.822825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c36b7-0b37-4cc9-a70d-5d7cc9d0cb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:44.823507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c36b7-0b37-4cc9-a70d-5d7cc9d0cb18 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:44.823787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c36b7-0b37-4cc9-a70d-5d7cc9d0cb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:44.824056 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c36b7-0b37-4cc9-a70d-5d7cc9d0cb18 None admin] PATH_INFO: `/v3/services/image` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:44.824636 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c36b7-0b37-4cc9-a70d-5d7cc9d0cb18 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:44.826071 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c36b7-0b37-4cc9-a70d-5d7cc9d0cb18 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:44.839415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-0f0c36b7-0b37-4cc9-a70d-5d7cc9d0cb18 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 11:45:44.839415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:44.839415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:45:44.839415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:45:44.839415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:45:44.839415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:45:44.839415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:45:44.839415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:44.839415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 11:45:44.839415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:44.839415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:45:44.839415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:44.839415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:44.839415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:44.839415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:44.839415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:44.839415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:44.840776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:44.840776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:44.840776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:44.840776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:44.840776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:44.840776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:44.840776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:45:44.840776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:45:44.840776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:45:44.840776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:45:44.840776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:44.840776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:44.840776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:44.840776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:44.840776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:44.840776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:44.841855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:44.841855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:44.841855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:44.841855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:44.841855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:44.841855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:44.841855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:44.841855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:44.841855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:44.841855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:44.841855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:45:44.841855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:45:44.841855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 11:45:44.841855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:44.841855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 520/1040] 10.222.0.27 () {56 vars in 1105 bytes} [Tue Aug 30 11:45:44 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:44.844215 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c36b7-0b37-4cc9-a70d-5d7cc9d0cb18 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:44.861568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5d046-d094-4f6d-b3a4-c67a42300d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:44.862190 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5d046-d094-4f6d-b3a4-c67a42300d34 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:44.862453 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5d046-d094-4f6d-b3a4-c67a42300d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:44.862725 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5d046-d094-4f6d-b3a4-c67a42300d34 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:44.863387 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5d046-d094-4f6d-b3a4-c67a42300d34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:44.863689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5d046-d094-4f6d-b3a4-c67a42300d34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:44.865088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5d046-d094-4f6d-b3a4-c67a42300d34 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:44.877545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 521/1041] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:44.883512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5d046-d094-4f6d-b3a4-c67a42300d34 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:44.900617 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:44.964555 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c36b7-0b37-4cc9-a70d-5d7cc9d0cb18 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:44.992948 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5d046-d094-4f6d-b3a4-c67a42300d34 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:45.000416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d59224-c5eb-40af-837b-c3b620d24506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:45.001070 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d59224-c5eb-40af-837b-c3b620d24506 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:45.001352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d59224-c5eb-40af-837b-c3b620d24506 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:45.001604 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d59224-c5eb-40af-837b-c3b620d24506 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:45.002293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d59224-c5eb-40af-837b-c3b620d24506 None admin] RBAC: Adding query filter params (name=image) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:45.002634 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d59224-c5eb-40af-837b-c3b620d24506 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:45.004158 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d59224-c5eb-40af-837b-c3b620d24506 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:45.007265 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:45.010905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 521/1042] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:45.017598 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d59224-c5eb-40af-837b-c3b620d24506 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:45.031935 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a77672-17dc-4822-ac94-a715a849bed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:45.032662 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a77672-17dc-4822-ac94-a715a849bed1 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:45.032856 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a77672-17dc-4822-ac94-a715a849bed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:45.033125 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a77672-17dc-4822-ac94-a715a849bed1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:45.039993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a77672-17dc-4822-ac94-a715a849bed1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:45.041437 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a77672-17dc-4822-ac94-a715a849bed1 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:45.052791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-99a77672-17dc-4822-ac94-a715a849bed1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:45.052791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:45.052791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:45.052791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:45.052791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:45.052791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:45.052791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:45.052791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:45.052791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:45.052791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:45.052791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:45.052791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:45.052791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:45:45.052791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:45:45.052791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:45:45.053681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:45:45.053681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:45.053681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:45.053681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:45.053681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:45.053681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:45.053681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:45.053681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:45.053681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:45.053681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:45.053681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:45.053681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:45.053681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:45.053681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:45.053681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:45.053681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:45.053681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:45.054609 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:45:45.054609 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:45:45.054609 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:45:45.054609 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:45:45.054609 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:45:45.054609 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:45:45.054609 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:45.054609 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:45.054609 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 522/1043] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:45.059862 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a77672-17dc-4822-ac94-a715a849bed1 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:45.130566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d59224-c5eb-40af-837b-c3b620d24506 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:45.139918 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:45.166053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731af7f3-2ba3-4a49-901d-1ba44dad8a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:45.166700 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731af7f3-2ba3-4a49-901d-1ba44dad8a87 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:45.166930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731af7f3-2ba3-4a49-901d-1ba44dad8a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:45.167197 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731af7f3-2ba3-4a49-901d-1ba44dad8a87 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:45.167850 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731af7f3-2ba3-4a49-901d-1ba44dad8a87 None admin] RBAC: Adding query filter params (type=image) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:45.168149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731af7f3-2ba3-4a49-901d-1ba44dad8a87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:45.169559 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731af7f3-2ba3-4a49-901d-1ba44dad8a87 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:45.174662 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 522/1044] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:45.176261 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a77672-17dc-4822-ac94-a715a849bed1 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:45.179871 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731af7f3-2ba3-4a49-901d-1ba44dad8a87 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:45.213570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cf2ee-bcf4-405f-a6a1-97709b73364e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:45.214176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cf2ee-bcf4-405f-a6a1-97709b73364e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:45.214479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cf2ee-bcf4-405f-a6a1-97709b73364e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:45.214797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cf2ee-bcf4-405f-a6a1-97709b73364e None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:45.215405 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23cf2ee-bcf4-405f-a6a1-97709b73364e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:45.215707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23cf2ee-bcf4-405f-a6a1-97709b73364e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:45.217240 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23cf2ee-bcf4-405f-a6a1-97709b73364e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:45.232053 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 523/1045] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:45:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:45.237889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cf2ee-bcf4-405f-a6a1-97709b73364e None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:45.271819 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:45.288713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731af7f3-2ba3-4a49-901d-1ba44dad8a87 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:45.324607 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60db071-b5d9-48da-9e5b-a7c90cf725cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:45.325219 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60db071-b5d9-48da-9e5b-a7c90cf725cd None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:45.325491 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60db071-b5d9-48da-9e5b-a7c90cf725cd None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:45.325811 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60db071-b5d9-48da-9e5b-a7c90cf725cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:45.326625 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60db071-b5d9-48da-9e5b-a7c90cf725cd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:45.328295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60db071-b5d9-48da-9e5b-a7c90cf725cd None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:45.345440 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cf2ee-bcf4-405f-a6a1-97709b73364e None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:45.351174 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 523/1046] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:45:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:45:45.397507 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d6a7f-ae43-472c-a275-93773c204dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:45.398135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d6a7f-ae43-472c-a275-93773c204dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:45.398408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d6a7f-ae43-472c-a275-93773c204dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:45.398674 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d6a7f-ae43-472c-a275-93773c204dd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:45.399447 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d6a7f-ae43-472c-a275-93773c204dd7 None admin] RBAC: Adding query filter params (role.id=8c34d24ef14b407f81bb5fb31973ddb0, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=8d17f1d0577a41ed8859706073f79d77) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:45.399772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d6a7f-ae43-472c-a275-93773c204dd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:45.401270 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d6a7f-ae43-472c-a275-93773c204dd7 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:45.408326 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 524/1047] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:45:45 2022] GET /identity/v3/role_assignments?user.id=8d17f1d0577a41ed8859706073f79d77&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=8c34d24ef14b407f81bb5fb31973ddb0 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:45.787413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f9716-41dd-4c02-b435-d5bb99d53094 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:45.787824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f9716-41dd-4c02-b435-d5bb99d53094 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:45.787998 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f9716-41dd-4c02-b435-d5bb99d53094 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:45.789498 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 524/1048] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:45.794731 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a9e88-905b-4b8d-8d0b-19565a373a2f None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:45.794999 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a9e88-905b-4b8d-8d0b-19565a373a2f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:45.795298 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a9e88-905b-4b8d-8d0b-19565a373a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:45.815130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-940a9e88-905b-4b8d-8d0b-19565a373a2f None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:45.816381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-940a9e88-905b-4b8d-8d0b-19565a373a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:45.894847 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 525/1049] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:46.164950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f9716-41dd-4c02-b435-d5bb99d53094 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:46.196742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:46.277030 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f9716-41dd-4c02-b435-d5bb99d53094 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:46.311151 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc838e-9299-4ff3-ab38-95b69dc73833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:46.311852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc838e-9299-4ff3-ab38-95b69dc73833 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:46.312130 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc838e-9299-4ff3-ab38-95b69dc73833 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:46.312393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc838e-9299-4ff3-ab38-95b69dc73833 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:46.313531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc838e-9299-4ff3-ab38-95b69dc73833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:46.314964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc838e-9299-4ff3-ab38-95b69dc73833 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:46.316747 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 525/1050] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:46.322438 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a9e88-905b-4b8d-8d0b-19565a373a2f None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:46.348482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:46.427771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a9e88-905b-4b8d-8d0b-19565a373a2f None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:46.464222 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac2093-0177-46a5-83d3-803f5a2f8a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:46.465002 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac2093-0177-46a5-83d3-803f5a2f8a3b None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:46.465371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac2093-0177-46a5-83d3-803f5a2f8a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:46.465748 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac2093-0177-46a5-83d3-803f5a2f8a3b None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:46.466401 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac2093-0177-46a5-83d3-803f5a2f8a3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:46.467988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac2093-0177-46a5-83d3-803f5a2f8a3b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:46.491137 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 526/1051] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Aug 30 11:45:46 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:45:47.278385 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cf0d2-0ed4-473d-8577-11ada365a968 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:47.278951 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cf0d2-0ed4-473d-8577-11ada365a968 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:47.279030 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cf0d2-0ed4-473d-8577-11ada365a968 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:47.280647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 526/1052] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:47.281784 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8c0f3-7635-4ebf-8694-94d79918a0d4 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:47.282070 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8c0f3-7635-4ebf-8694-94d79918a0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:47.282348 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8c0f3-7635-4ebf-8694-94d79918a0d4 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:47.283851 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 527/1053] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:45:47.285490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492d44c-069e-49aa-82d5-1b244d534641 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:47.285779 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492d44c-069e-49aa-82d5-1b244d534641 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:47.286055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492d44c-069e-49aa-82d5-1b244d534641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:47.288353 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f958f-76cd-4d6e-b8a6-f2fd58de082e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:47.288639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f958f-76cd-4d6e-b8a6-f2fd58de082e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:47.288910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f958f-76cd-4d6e-b8a6-f2fd58de082e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:47.305566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0492d44c-069e-49aa-82d5-1b244d534641 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:47.306739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2a5f958f-76cd-4d6e-b8a6-f2fd58de082e None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:47.306852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0492d44c-069e-49aa-82d5-1b244d534641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:47.307921 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2a5f958f-76cd-4d6e-b8a6-f2fd58de082e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:47.379827 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 528/1054] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:45:47.382038 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 527/1055] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:47.640615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f958f-76cd-4d6e-b8a6-f2fd58de082e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:47.644746 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492d44c-069e-49aa-82d5-1b244d534641 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:47.653523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:47.672032 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:47.752998 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492d44c-069e-49aa-82d5-1b244d534641 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:47.758732 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f958f-76cd-4d6e-b8a6-f2fd58de082e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:47.789009 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46152c87-c8cc-4366-b531-58a404b4b5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:47.789620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46152c87-c8cc-4366-b531-58a404b4b5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:47.789896 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46152c87-c8cc-4366-b531-58a404b4b5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:47.790159 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46152c87-c8cc-4366-b531-58a404b4b5a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:47.793285 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9cf2b-6e9b-4b4f-9f81-a11219f1320c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:47.793912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9cf2b-6e9b-4b4f-9f81-a11219f1320c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:47.794184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9cf2b-6e9b-4b4f-9f81-a11219f1320c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:47.794524 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9cf2b-6e9b-4b4f-9f81-a11219f1320c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:47.804765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9cf2b-6e9b-4b4f-9f81-a11219f1320c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:45:47.809540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-93e9cf2b-6e9b-4b4f-9f81-a11219f1320c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:45:47.809540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:47.809540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:47.809540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:47.809540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:47.809540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:47.809540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:47.809540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:47.809540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:47.809540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:47.809540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:47.809540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:47.809540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:45:47.809540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:45:47.809540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:45:47.809540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:45:47.810660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:45:47.810660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:45:47.810660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:45:47.810660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:45:47.810660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:47.810660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:47.810660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:47.810660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:47.810660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:47.810660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:47.810660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:47.810660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:47.810660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:47.810660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:47.810660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:47.810660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:47.811554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:47.811554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:47.811554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:47.811554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:47.811554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:45:47.811554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:45:47.811554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:45:47.811554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:45:47.811554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:45:47.811554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:45:47.811554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:45:47.811554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:47.811554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 529/1056] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Aug 30 11:45:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:47.816528 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9cf2b-6e9b-4b4f-9f81-a11219f1320c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:47.868859 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46152c87-c8cc-4366-b531-58a404b4b5a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:47.871101 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46152c87-c8cc-4366-b531-58a404b4b5a7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:47.887792 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:47.901946 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:47.926103 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9cf2b-6e9b-4b4f-9f81-a11219f1320c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:47.963259 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3b8d9-a983-44c3-a650-129adc1c4630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:47.964010 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3b8d9-a983-44c3-a650-129adc1c4630 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:47.964286 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3b8d9-a983-44c3-a650-129adc1c4630 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:47.964557 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3b8d9-a983-44c3-a650-129adc1c4630 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:47.965213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3b8d9-a983-44c3-a650-129adc1c4630 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:47.965513 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3b8d9-a983-44c3-a650-129adc1c4630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:47.966927 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3b8d9-a983-44c3-a650-129adc1c4630 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:47.975217 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 530/1057] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Aug 30 11:45:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:47.981249 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3b8d9-a983-44c3-a650-129adc1c4630 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:47.984487 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 528/1058] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:45:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 11:45:47.990013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46152c87-c8cc-4366-b531-58a404b4b5a7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:48.091598 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46152c87-c8cc-4366-b531-58a404b4b5a7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:48.097135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3b8d9-a983-44c3-a650-129adc1c4630 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:48.124216 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:48.132394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:48.134376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de237a0-68d3-4ad1-b500-b63ce03f5c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:48.135122 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de237a0-68d3-4ad1-b500-b63ce03f5c35 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:48.135385 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de237a0-68d3-4ad1-b500-b63ce03f5c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:48.135661 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de237a0-68d3-4ad1-b500-b63ce03f5c35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:48.139887 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88957e5f-5d4f-4fb2-ae53-2ab793d600be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:48.140527 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88957e5f-5d4f-4fb2-ae53-2ab793d600be None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:48.140810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88957e5f-5d4f-4fb2-ae53-2ab793d600be None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:48.141085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88957e5f-5d4f-4fb2-ae53-2ab793d600be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:48.146706 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de237a0-68d3-4ad1-b500-b63ce03f5c35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:48.148187 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de237a0-68d3-4ad1-b500-b63ce03f5c35 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:48.152742 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88957e5f-5d4f-4fb2-ae53-2ab793d600be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:48.154461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88957e5f-5d4f-4fb2-ae53-2ab793d600be None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:48.166734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-6de237a0-68d3-4ad1-b500-b63ce03f5c35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:48.166734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:48.166734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:48.166734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:48.166734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:48.166734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:48.166734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:48.166734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:48.166734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:48.166734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:48.166734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:48.166734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:48.166734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:48.166734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:48.166734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:48.166734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:48.167945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:48.167945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:48.167945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:48.167945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:48.167945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:48.167945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:48.167945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:48.167945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:48.167945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:48.167945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:48.167945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:48.167945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:48.167945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:48.167945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:48.167945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:48.167945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:48.167945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:48.168852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:48.168852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:48.168852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:48.169782 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 529/1059] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:48.169965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-88957e5f-5d4f-4fb2-ae53-2ab793d600be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:48.169965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:48.169965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:48.169965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:48.169965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:48.169965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:48.169965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:48.169965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:48.169965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:48.169965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:48.169965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:48.169965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:48.169965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:48.169965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:48.169965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:48.169965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:48.170817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:48.170817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:48.170817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:48.170817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:48.170817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:48.170817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:48.170817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:48.170817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:48.170817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:48.170817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:48.170817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:48.170817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:48.170817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:48.170817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:48.170817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:48.170817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:48.170817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:48.171760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:48.171760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:48.171760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:48.173792 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de237a0-68d3-4ad1-b500-b63ce03f5c35 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:48.175678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 531/1060] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:45:48.176716 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88957e5f-5d4f-4fb2-ae53-2ab793d600be None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:48.282683 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de237a0-68d3-4ad1-b500-b63ce03f5c35 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:48.285271 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88957e5f-5d4f-4fb2-ae53-2ab793d600be None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:48.317362 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4169e5-ab7d-4f52-bd16-3a4d285e1aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:48.318274 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4169e5-ab7d-4f52-bd16-3a4d285e1aee None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:48.318529 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4169e5-ab7d-4f52-bd16-3a4d285e1aee None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:48.318816 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4169e5-ab7d-4f52-bd16-3a4d285e1aee None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:48.319476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4169e5-ab7d-4f52-bd16-3a4d285e1aee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:48.319775 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4169e5-ab7d-4f52-bd16-3a4d285e1aee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:48.321143 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4169e5-ab7d-4f52-bd16-3a4d285e1aee None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:48.321395 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1a9eb-0ef6-416a-9b66-377cece9faba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:48.322007 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1a9eb-0ef6-416a-9b66-377cece9faba None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:48.322308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1a9eb-0ef6-416a-9b66-377cece9faba None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:48.322662 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1a9eb-0ef6-416a-9b66-377cece9faba None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:48.323390 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1a9eb-0ef6-416a-9b66-377cece9faba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:48.323701 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1a9eb-0ef6-416a-9b66-377cece9faba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:48.325080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1a9eb-0ef6-416a-9b66-377cece9faba None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:48.343466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 530/1061] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:48.348458 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 532/1062] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:48.354258 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4169e5-ab7d-4f52-bd16-3a4d285e1aee None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:48.398853 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:48.432219 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6da9d-9e2a-4024-990a-60a247098c94 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:48.432746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6da9d-9e2a-4024-990a-60a247098c94 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:48.432746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6da9d-9e2a-4024-990a-60a247098c94 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:48.434131 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 533/1063] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:45:48.440190 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4986cbd-f909-4832-9f47-d1536ed02078 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:48.440517 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4986cbd-f909-4832-9f47-d1536ed02078 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:48.440720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4986cbd-f909-4832-9f47-d1536ed02078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:48.459978 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-c4986cbd-f909-4832-9f47-d1536ed02078 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:48.461356 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c4986cbd-f909-4832-9f47-d1536ed02078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:48.471071 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4169e5-ab7d-4f52-bd16-3a4d285e1aee None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:48.506212 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:48.514891 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea180e0c-b45f-41af-bd97-428cf2728844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:48.515565 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea180e0c-b45f-41af-bd97-428cf2728844 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:48.515841 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea180e0c-b45f-41af-bd97-428cf2728844 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:48.516110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea180e0c-b45f-41af-bd97-428cf2728844 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:48.523519 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea180e0c-b45f-41af-bd97-428cf2728844 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:48.524961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea180e0c-b45f-41af-bd97-428cf2728844 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:48.537881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ea180e0c-b45f-41af-bd97-428cf2728844 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:45:48.537881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:48.537881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:48.537881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:48.537881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:48.537881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:48.537881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:48.537881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:48.537881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:48.537881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:48.537881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:48.537881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:48.537881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:45:48.537881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:45:48.537881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:45:48.537881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:45:48.538861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:48.538861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:48.538861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:45:48.538861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:48.538861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:45:48.538861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:48.538861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:48.538861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:48.538861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:48.538861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:48.538861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:48.538861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:48.538861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:48.538861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:48.538861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:48.538861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:48.538861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:48.538861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:48.539939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:48.539939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:48.539939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:45:48.539939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:45:48.539939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:45:48.539939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:45:48.539939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:45:48.539939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:45:48.539939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:45:48.539939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:48.539939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 531/1064] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Aug 30 11:45:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:48.545120 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea180e0c-b45f-41af-bd97-428cf2728844 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:48.545709 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 534/1065] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:45:48.645961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:48.649953 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea180e0c-b45f-41af-bd97-428cf2728844 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:48.685510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b586b7-2772-4547-9d4b-3a5636b763ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:48.686030 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b586b7-2772-4547-9d4b-3a5636b763ce None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:48.686304 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b586b7-2772-4547-9d4b-3a5636b763ce None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:48.686568 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b586b7-2772-4547-9d4b-3a5636b763ce None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:48.687282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b586b7-2772-4547-9d4b-3a5636b763ce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:48.687609 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b586b7-2772-4547-9d4b-3a5636b763ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:48.689041 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b586b7-2772-4547-9d4b-3a5636b763ce None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:48.711622 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 532/1066] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Aug 30 11:45:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:48.713275 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4986cbd-f909-4832-9f47-d1536ed02078 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:48.815667 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4986cbd-f909-4832-9f47-d1536ed02078 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:48.818352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b586b7-2772-4547-9d4b-3a5636b763ce None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:48.852786 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc17be6-0fca-4c2b-86fe-9e37a169c85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:48.853415 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc17be6-0fca-4c2b-86fe-9e37a169c85f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:48.853682 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc17be6-0fca-4c2b-86fe-9e37a169c85f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:48.853933 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc17be6-0fca-4c2b-86fe-9e37a169c85f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:48.864376 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc17be6-0fca-4c2b-86fe-9e37a169c85f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:48.865828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc17be6-0fca-4c2b-86fe-9e37a169c85f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:48.881128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-8cc17be6-0fca-4c2b-86fe-9e37a169c85f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:48.881128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:48.881128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:48.881128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:48.881128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:48.881128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:48.881128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:48.881128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:48.881128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:48.881128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:48.881128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:48.881128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:48.881128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:48.881128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:48.881128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:48.881128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:48.882282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:48.882282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:48.882282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:48.882282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:48.882282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:48.882282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:48.882282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:48.882282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:48.882282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:48.882282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:48.882282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:48.882282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:48.882282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:48.882282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:48.882282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:48.882282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:48.882282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:48.883435 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:48.883435 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:48.883435 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:48.883435 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 535/1067] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:48.888065 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc17be6-0fca-4c2b-86fe-9e37a169c85f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:48.914928 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:48.923178 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b586b7-2772-4547-9d4b-3a5636b763ce None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:48.956763 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c046b-c425-4bba-b3cc-347f09f299f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:48.957312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c046b-c425-4bba-b3cc-347f09f299f2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:48.957585 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c046b-c425-4bba-b3cc-347f09f299f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:48.957848 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c046b-c425-4bba-b3cc-347f09f299f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:48.968148 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c046b-c425-4bba-b3cc-347f09f299f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:45:48.972900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-c72c046b-c425-4bba-b3cc-347f09f299f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:45:48.972900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:48.972900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:48.972900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:48.972900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:48.972900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:48.972900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:48.972900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:48.972900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:48.972900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:48.972900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:48.972900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:48.972900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:45:48.972900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:45:48.972900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:45:48.972900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:45:48.973875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:45:48.973875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:45:48.973875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:45:48.973875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:45:48.973875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:48.973875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:48.973875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:48.973875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:48.973875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:48.973875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:48.973875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:48.973875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:48.973875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:48.973875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:48.973875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:48.973875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:48.974734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:48.974734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:48.974734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:48.974734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:48.974734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:45:48.974734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:45:48.974734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:45:48.974734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:45:48.974734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:45:48.974734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:45:48.974734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:45:48.974734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:48.974734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 533/1068] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:45:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:48.980016 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c046b-c425-4bba-b3cc-347f09f299f2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:48.997308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc17be6-0fca-4c2b-86fe-9e37a169c85f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:48.999155 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:49.031263 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1df2d-b251-44b6-a021-71b37d7cf656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:49.031903 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1df2d-b251-44b6-a021-71b37d7cf656 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:49.032182 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1df2d-b251-44b6-a021-71b37d7cf656 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:49.032450 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1df2d-b251-44b6-a021-71b37d7cf656 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:49.033086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1df2d-b251-44b6-a021-71b37d7cf656 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:49.033384 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1df2d-b251-44b6-a021-71b37d7cf656 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:49.034770 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1df2d-b251-44b6-a021-71b37d7cf656 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:49.047155 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 536/1069] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:49.052913 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1df2d-b251-44b6-a021-71b37d7cf656 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:49.092605 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c046b-c425-4bba-b3cc-347f09f299f2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:49.130772 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bec22-29f3-4ab4-960d-5f3d6cb2a524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:49.131411 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bec22-29f3-4ab4-960d-5f3d6cb2a524 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:49.131693 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bec22-29f3-4ab4-960d-5f3d6cb2a524 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:49.131964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bec22-29f3-4ab4-960d-5f3d6cb2a524 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:49.132626 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bec22-29f3-4ab4-960d-5f3d6cb2a524 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:49.132929 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bec22-29f3-4ab4-960d-5f3d6cb2a524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:49.134300 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bec22-29f3-4ab4-960d-5f3d6cb2a524 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:49.141244 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:49.142395 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 534/1070] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:45:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:49.148429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bec22-29f3-4ab4-960d-5f3d6cb2a524 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:49.158460 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1df2d-b251-44b6-a021-71b37d7cf656 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:49.194140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49bdf3-8786-4113-8a07-a4fdb28d0438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:49.194777 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49bdf3-8786-4113-8a07-a4fdb28d0438 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:49.195057 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49bdf3-8786-4113-8a07-a4fdb28d0438 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:49.195328 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49bdf3-8786-4113-8a07-a4fdb28d0438 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:49.202293 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49bdf3-8786-4113-8a07-a4fdb28d0438 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:49.203790 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49bdf3-8786-4113-8a07-a4fdb28d0438 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:49.215744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-6f49bdf3-8786-4113-8a07-a4fdb28d0438 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:49.215744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:49.215744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:49.215744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:49.215744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:49.215744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:49.215744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:49.215744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:49.215744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:49.215744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:49.215744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:49.215744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:49.215744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:45:49.215744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:45:49.215744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:45:49.216680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:45:49.216680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:49.216680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:49.216680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:49.216680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:49.216680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:49.216680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:49.216680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:49.216680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:49.216680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:49.216680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:49.216680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:49.216680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:49.216680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:49.216680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:49.216680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:49.216680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:49.217766 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:45:49.217766 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:45:49.217766 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:45:49.217766 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:45:49.217766 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:45:49.217766 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:45:49.217766 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:49.217766 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:49.217766 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 537/1071] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:49.223140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49bdf3-8786-4113-8a07-a4fdb28d0438 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:49.228753 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:49.251096 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bec22-29f3-4ab4-960d-5f3d6cb2a524 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:49.284136 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d7574-2f30-4970-a5f8-d87a22fb5349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:49.284831 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d7574-2f30-4970-a5f8-d87a22fb5349 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:49.285037 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d7574-2f30-4970-a5f8-d87a22fb5349 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:49.285337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d7574-2f30-4970-a5f8-d87a22fb5349 None admin] PATH_INFO: `/v3/users/cd1a6669cb1742f5b25d54cfb14050e3` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:49.298590 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d7574-2f30-4970-a5f8-d87a22fb5349 None admin] RBAC: Authorizing `identity:get_user(user_id=cd1a6669cb1742f5b25d54cfb14050e3)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:49.300048 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d7574-2f30-4970-a5f8-d87a22fb5349 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:49.301704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 535/1072] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:45:49 2022] GET /identity/v3/users/cd1a6669cb1742f5b25d54cfb14050e3 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:49.307543 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d7574-2f30-4970-a5f8-d87a22fb5349 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:49.323182 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49bdf3-8786-4113-8a07-a4fdb28d0438 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:49.363645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84175c36-97f5-4927-9284-9cf46c302d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:49.364294 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84175c36-97f5-4927-9284-9cf46c302d5c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:49.364581 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84175c36-97f5-4927-9284-9cf46c302d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:49.365047 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84175c36-97f5-4927-9284-9cf46c302d5c None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:49.366032 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84175c36-97f5-4927-9284-9cf46c302d5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:49.366445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84175c36-97f5-4927-9284-9cf46c302d5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:49.368364 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84175c36-97f5-4927-9284-9cf46c302d5c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:49.382339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 538/1073] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:45:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:49.389393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84175c36-97f5-4927-9284-9cf46c302d5c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:49.393250 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:49.412925 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d7574-2f30-4970-a5f8-d87a22fb5349 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:49.445379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15726059-0dc3-4b4e-80f3-cb1987cc268e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:49.445984 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15726059-0dc3-4b4e-80f3-cb1987cc268e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:49.446254 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15726059-0dc3-4b4e-80f3-cb1987cc268e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:49.446522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15726059-0dc3-4b4e-80f3-cb1987cc268e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:49.449794 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:49.491501 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84175c36-97f5-4927-9284-9cf46c302d5c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:49.514731 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15726059-0dc3-4b4e-80f3-cb1987cc268e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:49.516201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15726059-0dc3-4b4e-80f3-cb1987cc268e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:49.525568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fd88d-f8b8-4e24-9874-73363fce22df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:49.526235 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fd88d-f8b8-4e24-9874-73363fce22df None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:49.526515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fd88d-f8b8-4e24-9874-73363fce22df None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:49.526792 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fd88d-f8b8-4e24-9874-73363fce22df None admin] PATH_INFO: `/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/8d17f1d0577a41ed8859706073f79d77/roles/8c34d24ef14b407f81bb5fb31973ddb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:49.529625 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fd88d-f8b8-4e24-9874-73363fce22df None admin] RBAC: Authorizing `identity:create_grant(project_id=ba4dff9d637c4afcadfd3cd92b065a41, user_id=8d17f1d0577a41ed8859706073f79d77, role_id=8c34d24ef14b407f81bb5fb31973ddb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:49.531069 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fd88d-f8b8-4e24-9874-73363fce22df None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:49.546108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 539/1074] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:45:49 2022] PUT /identity/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/8d17f1d0577a41ed8859706073f79d77/roles/8c34d24ef14b407f81bb5fb31973ddb0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:45:49.624060 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 536/1075] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:45:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:45:49.630433 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fd88d-f8b8-4e24-9874-73363fce22df None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:49.702958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:49.744691 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fd88d-f8b8-4e24-9874-73363fce22df None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:49.779714 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b067612-fa32-4bb9-8f06-3f93aedbc600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:49.780347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b067612-fa32-4bb9-8f06-3f93aedbc600 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:49.780625 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b067612-fa32-4bb9-8f06-3f93aedbc600 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:49.780896 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b067612-fa32-4bb9-8f06-3f93aedbc600 None admin] PATH_INFO: `/v3/projects/9ba1bc6062c246219442dca00cb06b68` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:49.782037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b067612-fa32-4bb9-8f06-3f93aedbc600 None admin] RBAC: Authorizing `identity:get_project(project_id=9ba1bc6062c246219442dca00cb06b68)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:49.783528 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b067612-fa32-4bb9-8f06-3f93aedbc600 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:49.785185 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 540/1076] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:45:49 2022] GET /identity/v3/projects/9ba1bc6062c246219442dca00cb06b68 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:49.791628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15726059-0dc3-4b4e-80f3-cb1987cc268e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:49.827313 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:49.895320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15726059-0dc3-4b4e-80f3-cb1987cc268e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:49.930291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db001b81-c01a-40eb-b480-4f14934f881f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:49.930900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db001b81-c01a-40eb-b480-4f14934f881f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:49.931174 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db001b81-c01a-40eb-b480-4f14934f881f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:49.931470 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db001b81-c01a-40eb-b480-4f14934f881f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:49.932294 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db001b81-c01a-40eb-b480-4f14934f881f None admin] RBAC: Adding query filter params (role.id=4f4d8a6881ca496bb2d4845a6592fea8, scope.project.id=9ba1bc6062c246219442dca00cb06b68, user.id=cd1a6669cb1742f5b25d54cfb14050e3) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:49.932599 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db001b81-c01a-40eb-b480-4f14934f881f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:49.934022 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db001b81-c01a-40eb-b480-4f14934f881f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:49.939654 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 537/1077] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:45:49 2022] GET /identity/v3/role_assignments?user.id=cd1a6669cb1742f5b25d54cfb14050e3&scope.project.id=9ba1bc6062c246219442dca00cb06b68&role.id=4f4d8a6881ca496bb2d4845a6592fea8 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:51.402933 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fcec5-81bc-49a5-85c5-17d695ee1e68 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:51.403481 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fcec5-81bc-49a5-85c5-17d695ee1e68 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:51.403481 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fcec5-81bc-49a5-85c5-17d695ee1e68 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:51.404945 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 541/1078] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:51.410211 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b946a4a-82d3-45b8-b6f4-ab035e3f9de8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:51.410628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b946a4a-82d3-45b8-b6f4-ab035e3f9de8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:51.410733 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b946a4a-82d3-45b8-b6f4-ab035e3f9de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:51.429188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4b946a4a-82d3-45b8-b6f4-ab035e3f9de8 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:51.430361 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4b946a4a-82d3-45b8-b6f4-ab035e3f9de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:51.502459 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 538/1079] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:51.764428 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fcec5-81bc-49a5-85c5-17d695ee1e68 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:51.782936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761b09a-e612-4ea8-a43b-0f2f9cec29e1 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:51.783231 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761b09a-e612-4ea8-a43b-0f2f9cec29e1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:51.783505 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761b09a-e612-4ea8-a43b-0f2f9cec29e1 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:51.784881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 539/1080] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:51.790652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142e2d6-643a-4f8b-8f5f-12b9c275d0bb None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:51.791083 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142e2d6-643a-4f8b-8f5f-12b9c275d0bb None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:51.791393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142e2d6-643a-4f8b-8f5f-12b9c275d0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:51.811653 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b142e2d6-643a-4f8b-8f5f-12b9c275d0bb None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:51.812889 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b142e2d6-643a-4f8b-8f5f-12b9c275d0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:51.839478 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:51.872942 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fcec5-81bc-49a5-85c5-17d695ee1e68 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:51.886468 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 540/1081] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:51.902545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:51.908232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07106e-7807-4bbd-8bb9-9412b6f2dd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:51.908863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07106e-7807-4bbd-8bb9-9412b6f2dd4f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:51.909137 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07106e-7807-4bbd-8bb9-9412b6f2dd4f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:51.909405 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07106e-7807-4bbd-8bb9-9412b6f2dd4f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:51.919992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b07106e-7807-4bbd-8bb9-9412b6f2dd4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:45:51.924798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-9b07106e-7807-4bbd-8bb9-9412b6f2dd4f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:45:51.924798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:51.924798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:51.924798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:51.924798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:51.924798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:51.924798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:51.924798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:51.924798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:51.924798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:51.924798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:51.924798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:51.924798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:45:51.924798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:45:51.924798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:45:51.924798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:45:51.925772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:45:51.925772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:45:51.925772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:45:51.925772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:45:51.925772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:51.925772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:51.925772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:51.925772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:51.925772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:51.925772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:51.925772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:51.925772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:51.925772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:51.925772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:51.925772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:51.925772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:51.926997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:51.926997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:51.926997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:51.926997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:51.926997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:45:51.926997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:45:51.926997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:45:51.926997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:45:51.926997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:45:51.926997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:45:51.926997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 11:45:51.926997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:51.926997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 542/1082] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Aug 30 11:45:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:51.931991 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142e2d6-643a-4f8b-8f5f-12b9c275d0bb None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:52.033742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142e2d6-643a-4f8b-8f5f-12b9c275d0bb None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:52.069579 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab33eb-c975-40e5-9d7f-502ed8518723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:52.070178 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab33eb-c975-40e5-9d7f-502ed8518723 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:52.070448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab33eb-c975-40e5-9d7f-502ed8518723 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:52.070713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab33eb-c975-40e5-9d7f-502ed8518723 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:52.071379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab33eb-c975-40e5-9d7f-502ed8518723 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:52.071685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab33eb-c975-40e5-9d7f-502ed8518723 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:52.073053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab33eb-c975-40e5-9d7f-502ed8518723 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:52.081319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 541/1083] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Aug 30 11:45:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:52.086858 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07106e-7807-4bbd-8bb9-9412b6f2dd4f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:52.147269 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab33eb-c975-40e5-9d7f-502ed8518723 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:52.173609 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:52.194097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07106e-7807-4bbd-8bb9-9412b6f2dd4f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:52.227644 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040e95c-a594-40fb-8ee0-d17fb83c9d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:52.228275 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040e95c-a594-40fb-8ee0-d17fb83c9d3f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:52.228552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040e95c-a594-40fb-8ee0-d17fb83c9d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:52.228820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040e95c-a594-40fb-8ee0-d17fb83c9d3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:52.238745 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040e95c-a594-40fb-8ee0-d17fb83c9d3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:52.240240 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040e95c-a594-40fb-8ee0-d17fb83c9d3f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:52.249759 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab33eb-c975-40e5-9d7f-502ed8518723 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:52.254665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-0040e95c-a594-40fb-8ee0-d17fb83c9d3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:52.254665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:52.254665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:52.254665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:52.254665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:52.254665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:52.254665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:52.254665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:52.254665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:52.254665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:52.254665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:52.254665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:52.254665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:52.254665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:52.254665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:52.254665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:52.255740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:52.255740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:52.255740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:52.255740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:52.255740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:52.255740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:52.255740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:52.255740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:52.255740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:52.255740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:52.255740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:52.255740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:52.255740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:52.255740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:52.255740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:52.255740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:52.255740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:52.256634 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:52.256634 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:52.256634 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:52.256634 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 543/1084] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:52.261589 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040e95c-a594-40fb-8ee0-d17fb83c9d3f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:52.289425 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd107d-3ddd-4a0e-b3c6-bd9608fd6a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:52.289981 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd107d-3ddd-4a0e-b3c6-bd9608fd6a30 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:52.290252 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd107d-3ddd-4a0e-b3c6-bd9608fd6a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:52.290518 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd107d-3ddd-4a0e-b3c6-bd9608fd6a30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:52.302038 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd107d-3ddd-4a0e-b3c6-bd9608fd6a30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:45:52.306489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:52.306728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-5cdd107d-3ddd-4a0e-b3c6-bd9608fd6a30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:45:52.306728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:52.306728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:52.306728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:52.306728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:52.306728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:52.306728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:52.306728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:52.306728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:52.306728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:52.306728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:52.306728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:52.306728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:45:52.306728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:45:52.306728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:45:52.306728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:45:52.307677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:45:52.307677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:45:52.307677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:45:52.307677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:45:52.307677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:52.307677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:52.307677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:52.307677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:52.307677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:52.307677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:52.307677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:52.307677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:52.307677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:52.307677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:52.307677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:52.307677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:52.308876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:52.308876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:52.308876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:52.308876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:52.308876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:45:52.308876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:45:52.308876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:45:52.308876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:45:52.308876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:45:52.308876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:45:52.308876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:45:52.308876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:52.308876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 542/1085] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:45:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:52.313997 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd107d-3ddd-4a0e-b3c6-bd9608fd6a30 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:52.365747 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040e95c-a594-40fb-8ee0-d17fb83c9d3f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:52.396891 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:52.399696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7788c-4d8f-4579-8990-373b05a1f91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:52.400494 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7788c-4d8f-4579-8990-373b05a1f91a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:52.400952 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7788c-4d8f-4579-8990-373b05a1f91a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:52.401216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7788c-4d8f-4579-8990-373b05a1f91a None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:52.401841 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7788c-4d8f-4579-8990-373b05a1f91a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:52.402140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7788c-4d8f-4579-8990-373b05a1f91a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:52.403567 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7788c-4d8f-4579-8990-373b05a1f91a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:52.415399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 544/1086] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:52.415606 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd107d-3ddd-4a0e-b3c6-bd9608fd6a30 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:52.421191 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7788c-4d8f-4579-8990-373b05a1f91a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:52.449457 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc9cd1-ed56-46b9-b1ff-d906ae2428d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:52.450069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc9cd1-ed56-46b9-b1ff-d906ae2428d7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:52.450345 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc9cd1-ed56-46b9-b1ff-d906ae2428d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:52.450722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc9cd1-ed56-46b9-b1ff-d906ae2428d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:52.451638 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc9cd1-ed56-46b9-b1ff-d906ae2428d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:52.451929 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc9cd1-ed56-46b9-b1ff-d906ae2428d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:52.453301 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc9cd1-ed56-46b9-b1ff-d906ae2428d7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:52.467469 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 543/1087] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:45:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:52.468352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc9cd1-ed56-46b9-b1ff-d906ae2428d7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:52.521179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7788c-4d8f-4579-8990-373b05a1f91a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:52.523546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:52.556308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227a903-ead7-4623-afc7-eba70c885fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:52.556937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227a903-ead7-4623-afc7-eba70c885fbc None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:52.557214 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227a903-ead7-4623-afc7-eba70c885fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:52.557482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227a903-ead7-4623-afc7-eba70c885fbc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:52.564668 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227a903-ead7-4623-afc7-eba70c885fbc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:52.566127 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227a903-ead7-4623-afc7-eba70c885fbc None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:52.568899 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc9cd1-ed56-46b9-b1ff-d906ae2428d7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:52.577470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-3227a903-ead7-4623-afc7-eba70c885fbc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:45:52.577470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:52.577470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:52.577470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:52.577470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:52.577470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:52.577470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:52.577470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:52.577470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:52.577470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:52.577470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:52.577470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:52.577470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:45:52.577470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:45:52.577470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:45:52.577470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:45:52.578468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:52.578468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:52.578468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:45:52.578468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:52.578468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:45:52.578468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:45:52.578468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:52.578468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:52.578468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:52.578468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:52.578468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:52.578468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:52.578468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:52.578468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:52.578468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:52.578468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:52.578468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:52.578468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:52.579883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:52.579883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:52.579883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:45:52.579883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:45:52.579883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:45:52.579883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:45:52.579883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:45:52.579883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:45:52.579883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 11:45:52.579883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:52.579883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 545/1088] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Aug 30 11:45:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:52.584380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227a903-ead7-4623-afc7-eba70c885fbc None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:52.604459 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29938f11-57b3-4277-ab4c-e44b39cf37ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:52.605087 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29938f11-57b3-4277-ab4c-e44b39cf37ff None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:52.605356 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29938f11-57b3-4277-ab4c-e44b39cf37ff None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:52.605624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29938f11-57b3-4277-ab4c-e44b39cf37ff None admin] PATH_INFO: `/v3/users/cd1a6669cb1742f5b25d54cfb14050e3` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:52.607065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29938f11-57b3-4277-ab4c-e44b39cf37ff None admin] RBAC: Authorizing `identity:get_user(user_id=cd1a6669cb1742f5b25d54cfb14050e3)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:52.608922 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29938f11-57b3-4277-ab4c-e44b39cf37ff None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:52.610520 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 544/1089] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:45:52 2022] GET /identity/v3/users/cd1a6669cb1742f5b25d54cfb14050e3 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:52.616507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29938f11-57b3-4277-ab4c-e44b39cf37ff None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:52.631167 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:52.683216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227a903-ead7-4623-afc7-eba70c885fbc None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:52.715679 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29938f11-57b3-4277-ab4c-e44b39cf37ff None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:52.717236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be42aef-b1e2-4b71-a7a6-b8872850517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:52.717843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be42aef-b1e2-4b71-a7a6-b8872850517f None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:52.718124 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be42aef-b1e2-4b71-a7a6-b8872850517f None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:52.718390 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be42aef-b1e2-4b71-a7a6-b8872850517f None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:52.719108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be42aef-b1e2-4b71-a7a6-b8872850517f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:52.719443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be42aef-b1e2-4b71-a7a6-b8872850517f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:52.720884 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be42aef-b1e2-4b71-a7a6-b8872850517f None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:52.737830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 546/1090] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Aug 30 11:45:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:52.743670 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be42aef-b1e2-4b71-a7a6-b8872850517f None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:52.750243 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db92c2-10b5-44a9-adf8-1e59267b0c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:52.750880 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db92c2-10b5-44a9-adf8-1e59267b0c1e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:52.751158 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db92c2-10b5-44a9-adf8-1e59267b0c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:52.751458 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db92c2-10b5-44a9-adf8-1e59267b0c1e None admin] PATH_INFO: `/v3/projects/9ba1bc6062c246219442dca00cb06b68` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:52.752569 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db92c2-10b5-44a9-adf8-1e59267b0c1e None admin] RBAC: Authorizing `identity:get_project(project_id=9ba1bc6062c246219442dca00cb06b68)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:52.754028 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db92c2-10b5-44a9-adf8-1e59267b0c1e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:52.761564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 545/1091] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:45:52 2022] GET /identity/v3/projects/9ba1bc6062c246219442dca00cb06b68 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:52.764268 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db92c2-10b5-44a9-adf8-1e59267b0c1e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:52.774923 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:52.845961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:52.851941 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be42aef-b1e2-4b71-a7a6-b8872850517f None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:52.865986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db92c2-10b5-44a9-adf8-1e59267b0c1e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:52.887886 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b21fe6-056f-47bd-a20d-b4880e43b832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:52.888497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b21fe6-056f-47bd-a20d-b4880e43b832 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:52.888776 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b21fe6-056f-47bd-a20d-b4880e43b832 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:52.889053 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b21fe6-056f-47bd-a20d-b4880e43b832 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:52.900473 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4fa1b-648e-4409-9e16-0dc8694994c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:52.901118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4fa1b-648e-4409-9e16-0dc8694994c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:52.901403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4fa1b-648e-4409-9e16-0dc8694994c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:52.901645 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4fa1b-648e-4409-9e16-0dc8694994c5 None admin] PATH_INFO: `/v3/projects/9ba1bc6062c246219442dca00cb06b68/users/cd1a6669cb1742f5b25d54cfb14050e3/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:52.903719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4fa1b-648e-4409-9e16-0dc8694994c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ba1bc6062c246219442dca00cb06b68, user_id=cd1a6669cb1742f5b25d54cfb14050e3, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:52.905144 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4fa1b-648e-4409-9e16-0dc8694994c5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:52.918945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 546/1092] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:45:52 2022] PUT /identity/v3/projects/9ba1bc6062c246219442dca00cb06b68/users/cd1a6669cb1742f5b25d54cfb14050e3/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:45:52.964902 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b21fe6-056f-47bd-a20d-b4880e43b832 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:52.966746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b21fe6-056f-47bd-a20d-b4880e43b832 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:52.995241 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:53.086514 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 547/1093] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:45:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 11:45:53.093223 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4fa1b-648e-4409-9e16-0dc8694994c5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:53.199816 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4fa1b-648e-4409-9e16-0dc8694994c5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:53.235122 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc224e-06ef-4fa2-84ad-bfc8f4837b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:53.235770 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc224e-06ef-4fa2-84ad-bfc8f4837b81 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:53.236045 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc224e-06ef-4fa2-84ad-bfc8f4837b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:53.236312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc224e-06ef-4fa2-84ad-bfc8f4837b81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:53.244652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:53.247055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc224e-06ef-4fa2-84ad-bfc8f4837b81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:53.248908 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc224e-06ef-4fa2-84ad-bfc8f4837b81 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:53.264766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-dbfc224e-06ef-4fa2-84ad-bfc8f4837b81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:53.264766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:53.264766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:53.264766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:53.264766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:53.264766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:53.264766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:53.264766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:53.264766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:53.264766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:53.264766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:53.264766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:53.264766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:45:53.264766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:45:53.264766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:45:53.264766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:45:53.265787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:53.265787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:53.265787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:53.265787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:53.265787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:53.265787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:53.265787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:53.265787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:53.265787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:53.265787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:53.265787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:53.265787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:53.265787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:53.265787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:53.265787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:53.265787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:53.265787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:45:53.266680 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:45:53.266680 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:45:53.266680 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:53.266680 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 547/1094] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:53.271671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b21fe6-056f-47bd-a20d-b4880e43b832 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:53.376715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b21fe6-056f-47bd-a20d-b4880e43b832 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:53.399880 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:53.413671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38798836-bb41-4881-97d5-2c7e6c4e1885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:53.414301 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38798836-bb41-4881-97d5-2c7e6c4e1885 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:53.414534 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38798836-bb41-4881-97d5-2c7e6c4e1885 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:53.414799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38798836-bb41-4881-97d5-2c7e6c4e1885 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:53.415473 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38798836-bb41-4881-97d5-2c7e6c4e1885 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:53.415773 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38798836-bb41-4881-97d5-2c7e6c4e1885 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:53.417152 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38798836-bb41-4881-97d5-2c7e6c4e1885 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:53.428630 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 548/1095] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:53.434364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc224e-06ef-4fa2-84ad-bfc8f4837b81 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:53.537325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc224e-06ef-4fa2-84ad-bfc8f4837b81 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:53.572091 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3a699-01f9-4cd2-9cb9-a0afaf8a1196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:53.572715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3a699-01f9-4cd2-9cb9-a0afaf8a1196 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:53.572991 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3a699-01f9-4cd2-9cb9-a0afaf8a1196 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:53.573240 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3a699-01f9-4cd2-9cb9-a0afaf8a1196 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:53.579917 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3a699-01f9-4cd2-9cb9-a0afaf8a1196 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:53.581351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3a699-01f9-4cd2-9cb9-a0afaf8a1196 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:53.592978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-10b3a699-01f9-4cd2-9cb9-a0afaf8a1196 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:53.592978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:53.592978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:53.592978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:53.592978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:53.592978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:53.592978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:53.592978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:53.592978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:53.592978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:53.592978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:53.592978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:53.592978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:45:53.592978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:45:53.592978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:45:53.593881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:45:53.593881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:53.593881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:53.593881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:53.593881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:53.593881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:53.593881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:53.593881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:53.593881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:53.593881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:53.593881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:53.593881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:53.593881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:53.593881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:53.593881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:53.593881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:53.593881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:53.594767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:45:53.594767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:45:53.594767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:45:53.594767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:45:53.594767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:45:53.594767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:45:53.594767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:45:53.594767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:45:53.598964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 548/1096] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:45:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:53.599995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38798836-bb41-4881-97d5-2c7e6c4e1885 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:53.702795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38798836-bb41-4881-97d5-2c7e6c4e1885 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:53.737299 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640223b-2379-4e70-92ab-760f24bde6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:53.737901 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640223b-2379-4e70-92ab-760f24bde6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:53.738179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640223b-2379-4e70-92ab-760f24bde6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:53.738461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640223b-2379-4e70-92ab-760f24bde6a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:53.739146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640223b-2379-4e70-92ab-760f24bde6a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:53.739483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640223b-2379-4e70-92ab-760f24bde6a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:53.740920 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640223b-2379-4e70-92ab-760f24bde6a9 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:53.754276 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 549/1097] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:45:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:53.761485 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3a699-01f9-4cd2-9cb9-a0afaf8a1196 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:53.819905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:53.871767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3a699-01f9-4cd2-9cb9-a0afaf8a1196 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:53.907857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ac0cf-8904-4bf2-b996-5328ad1f4df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:53.908472 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ac0cf-8904-4bf2-b996-5328ad1f4df1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:53.908753 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ac0cf-8904-4bf2-b996-5328ad1f4df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:53.909021 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ac0cf-8904-4bf2-b996-5328ad1f4df1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:53.909743 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ac0cf-8904-4bf2-b996-5328ad1f4df1 None admin] RBAC: Adding query filter params (role.id=8c34d24ef14b407f81bb5fb31973ddb0, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=8d17f1d0577a41ed8859706073f79d77) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:53.910049 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ac0cf-8904-4bf2-b996-5328ad1f4df1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:53.911521 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ac0cf-8904-4bf2-b996-5328ad1f4df1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:53.917558 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 549/1098] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:45:53 2022] GET /identity/v3/role_assignments?user.id=8d17f1d0577a41ed8859706073f79d77&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=8c34d24ef14b407f81bb5fb31973ddb0 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:54.799648 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f9187-7216-47fd-ac5e-d51e556b06a8 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:54.800491 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f9187-7216-47fd-ac5e-d51e556b06a8 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:54.800491 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f9187-7216-47fd-ac5e-d51e556b06a8 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:54.802646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 550/1099] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:54.811045 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f2f44-0147-4941-b4eb-b4e52fa13475 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:54.811482 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f2f44-0147-4941-b4eb-b4e52fa13475 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:54.811622 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f2f44-0147-4941-b4eb-b4e52fa13475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:54.831255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f98f2f44-0147-4941-b4eb-b4e52fa13475 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:54.832478 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f98f2f44-0147-4941-b4eb-b4e52fa13475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:54.904371 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 550/1100] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:55.198197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f9187-7216-47fd-ac5e-d51e556b06a8 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:55.249284 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:55.314345 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f9187-7216-47fd-ac5e-d51e556b06a8 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:55.366769 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6878ffd-b3ad-420d-b773-99279beea396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:55.367331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6878ffd-b3ad-420d-b773-99279beea396 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:55.367644 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6878ffd-b3ad-420d-b773-99279beea396 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:55.367916 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6878ffd-b3ad-420d-b773-99279beea396 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:55.379008 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6878ffd-b3ad-420d-b773-99279beea396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:45:55.383825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-c6878ffd-b3ad-420d-b773-99279beea396 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:45:55.383825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:45:55.383825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:45:55.383825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:45:55.383825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:45:55.383825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:45:55.383825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:45:55.383825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:45:55.383825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:45:55.383825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:45:55.383825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:45:55.383825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:45:55.383825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:45:55.383825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:45:55.383825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:45:55.383825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:45:55.384823 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:45:55.384823 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:45:55.384823 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:45:55.384823 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:45:55.384823 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:45:55.384823 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:45:55.384823 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:45:55.384823 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:45:55.384823 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:45:55.384823 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:45:55.384823 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:45:55.384823 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:45:55.384823 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:45:55.384823 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:45:55.384823 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:45:55.384823 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:45:55.385830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:45:55.385830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:45:55.385830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:45:55.385830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:45:55.385830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:45:55.385830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:45:55.385830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:45:55.385830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:45:55.385830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:45:55.385830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:45:55.385830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:45:55.385830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:45:55.385830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 551/1101] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:45:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:45:55.392149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f2f44-0147-4941-b4eb-b4e52fa13475 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:55.450545 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:55.506711 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f2f44-0147-4941-b4eb-b4e52fa13475 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:55.542641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc47b6f-5011-42a9-9c87-53329f2096fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:55.543239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc47b6f-5011-42a9-9c87-53329f2096fc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:55.543547 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc47b6f-5011-42a9-9c87-53329f2096fc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:55.543818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc47b6f-5011-42a9-9c87-53329f2096fc None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:55.544599 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc47b6f-5011-42a9-9c87-53329f2096fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:55.544790 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc47b6f-5011-42a9-9c87-53329f2096fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:55.546194 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc47b6f-5011-42a9-9c87-53329f2096fc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:55.554310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 551/1102] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:45:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:45:55.562425 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6878ffd-b3ad-420d-b773-99279beea396 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:55.666096 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6878ffd-b3ad-420d-b773-99279beea396 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:55.667654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:55.707016 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49691677-6105-4a3f-883c-0309920148f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:55.707665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49691677-6105-4a3f-883c-0309920148f0 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:55.707942 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49691677-6105-4a3f-883c-0309920148f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:55.708203 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49691677-6105-4a3f-883c-0309920148f0 None admin] PATH_INFO: `/v3/users/cd1a6669cb1742f5b25d54cfb14050e3` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:55.709454 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49691677-6105-4a3f-883c-0309920148f0 None admin] RBAC: Authorizing `identity:get_user(user_id=cd1a6669cb1742f5b25d54cfb14050e3)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:55.710893 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49691677-6105-4a3f-883c-0309920148f0 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:55.712852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 552/1103] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:45:55 2022] GET /identity/v3/users/cd1a6669cb1742f5b25d54cfb14050e3 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:55.719824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc47b6f-5011-42a9-9c87-53329f2096fc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:55.847342 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc47b6f-5011-42a9-9c87-53329f2096fc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:55.856389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:55.885842 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd22cb-eea6-44d7-8a89-76f273505397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:55.886441 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd22cb-eea6-44d7-8a89-76f273505397 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:55.886716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd22cb-eea6-44d7-8a89-76f273505397 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:55.886980 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd22cb-eea6-44d7-8a89-76f273505397 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:55.955771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd22cb-eea6-44d7-8a89-76f273505397 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:55.957139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd22cb-eea6-44d7-8a89-76f273505397 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:56.060100 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 552/1104] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:45:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:45:56.069645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49691677-6105-4a3f-883c-0309920148f0 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:56.192583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49691677-6105-4a3f-883c-0309920148f0 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:56.230820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9b5fa-ff8e-442f-8273-57b57f0b2061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:56.231406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9b5fa-ff8e-442f-8273-57b57f0b2061 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:56.231743 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9b5fa-ff8e-442f-8273-57b57f0b2061 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:56.232077 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9b5fa-ff8e-442f-8273-57b57f0b2061 None admin] PATH_INFO: `/v3/projects/9ba1bc6062c246219442dca00cb06b68` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:56.233287 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9b5fa-ff8e-442f-8273-57b57f0b2061 None admin] RBAC: Authorizing `identity:get_project(project_id=9ba1bc6062c246219442dca00cb06b68)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:56.234735 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9b5fa-ff8e-442f-8273-57b57f0b2061 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:56.236410 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 553/1105] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:45:56 2022] GET /identity/v3/projects/9ba1bc6062c246219442dca00cb06b68 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:56.243576 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd22cb-eea6-44d7-8a89-76f273505397 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:56.259445 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:56.360043 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd22cb-eea6-44d7-8a89-76f273505397 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:56.397744 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be8b28-465b-478c-976b-4d1fac7b17d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:56.398350 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be8b28-465b-478c-976b-4d1fac7b17d7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:56.398628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be8b28-465b-478c-976b-4d1fac7b17d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:56.398896 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be8b28-465b-478c-976b-4d1fac7b17d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:56.399646 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be8b28-465b-478c-976b-4d1fac7b17d7 None admin] RBAC: Adding query filter params (role.id=4f4d8a6881ca496bb2d4845a6592fea8, scope.project.id=9ba1bc6062c246219442dca00cb06b68, user.id=cd1a6669cb1742f5b25d54cfb14050e3) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:45:56.399955 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be8b28-465b-478c-976b-4d1fac7b17d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:56.401390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be8b28-465b-478c-976b-4d1fac7b17d7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:56.407510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 553/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:45:56 2022] GET /identity/v3/role_assignments?user.id=cd1a6669cb1742f5b25d54cfb14050e3&scope.project.id=9ba1bc6062c246219442dca00cb06b68&role.id=4f4d8a6881ca496bb2d4845a6592fea8 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:58.306439 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817ad05-c596-4bc5-9fc9-9370725af10c None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:58.306993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817ad05-c596-4bc5-9fc9-9370725af10c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:58.306993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817ad05-c596-4bc5-9fc9-9370725af10c None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:58.308386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 554/1107] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:45:58.314723 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13743957-ab2c-4b21-bf08-19b10eb417f7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:58.315463 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13743957-ab2c-4b21-bf08-19b10eb417f7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:58.315609 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13743957-ab2c-4b21-bf08-19b10eb417f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:58.339323 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-13743957-ab2c-4b21-bf08-19b10eb417f7 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:45:58.340589 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-13743957-ab2c-4b21-bf08-19b10eb417f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:45:58.412972 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 554/1108] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:45:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:45:58.676134 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817ad05-c596-4bc5-9fc9-9370725af10c None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:58.723840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:58.789784 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817ad05-c596-4bc5-9fc9-9370725af10c None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:58.825490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d84df3-81a7-4207-8c7b-0151d6d328e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:58.826174 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d84df3-81a7-4207-8c7b-0151d6d328e7 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:58.826452 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d84df3-81a7-4207-8c7b-0151d6d328e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:58.826720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d84df3-81a7-4207-8c7b-0151d6d328e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:58.827976 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d84df3-81a7-4207-8c7b-0151d6d328e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:58.829427 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d84df3-81a7-4207-8c7b-0151d6d328e7 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:58.831009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 555/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:45:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:45:58.837903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13743957-ab2c-4b21-bf08-19b10eb417f7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:45:58.841723 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:45:58.956734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13743957-ab2c-4b21-bf08-19b10eb417f7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:45:59.001952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb755c-1b04-4184-b243-0b73da2ead22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:45:59.002545 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb755c-1b04-4184-b243-0b73da2ead22 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:45:59.002820 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb755c-1b04-4184-b243-0b73da2ead22 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:45:59.003082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb755c-1b04-4184-b243-0b73da2ead22 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:45:59.003760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb755c-1b04-4184-b243-0b73da2ead22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:45:59.005184 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb755c-1b04-4184-b243-0b73da2ead22 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:45:59.033227 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 555/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Aug 30 11:45:58 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:46:00.956236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ccefd-dbe2-49c6-b1b0-4048bf6f7341 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:00.957095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ccefd-dbe2-49c6-b1b0-4048bf6f7341 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:00.957095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ccefd-dbe2-49c6-b1b0-4048bf6f7341 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:00.959353 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 556/1111] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:46:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:46:00.966137 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6db45-3d11-4e19-9c9e-5f369af055f5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:00.966571 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6db45-3d11-4e19-9c9e-5f369af055f5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:00.966672 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6db45-3d11-4e19-9c9e-5f369af055f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:00.986918 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-62e6db45-3d11-4e19-9c9e-5f369af055f5 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:46:00.988142 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-62e6db45-3d11-4e19-9c9e-5f369af055f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:46:01.055073 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:01.071260 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 556/1112] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:46:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:46:01.333447 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ccefd-dbe2-49c6-b1b0-4048bf6f7341 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:01.448762 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ccefd-dbe2-49c6-b1b0-4048bf6f7341 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:01.456192 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:01.488396 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c13fa5-3ce2-4654-98b2-e647e2606a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:01.489128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c13fa5-3ce2-4654-98b2-e647e2606a3c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:01.489475 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c13fa5-3ce2-4654-98b2-e647e2606a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:01.489775 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c13fa5-3ce2-4654-98b2-e647e2606a3c None admin] PATH_INFO: `/v3/roles/30c5b9fbbb564c6dafe66f759683738b` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:01.491240 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c13fa5-3ce2-4654-98b2-e647e2606a3c None admin] RBAC: Authorizing `identity:get_role(role_id=30c5b9fbbb564c6dafe66f759683738b)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:01.492909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c13fa5-3ce2-4654-98b2-e647e2606a3c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:01.494249 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 557/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:46:01 2022] GET /identity/v3/roles/30c5b9fbbb564c6dafe66f759683738b => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:01.500236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6db45-3d11-4e19-9c9e-5f369af055f5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:01.606383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6db45-3d11-4e19-9c9e-5f369af055f5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:01.646007 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d55f9d-e231-403d-a051-539314de2205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:01.646440 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d55f9d-e231-403d-a051-539314de2205 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:01.646701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d55f9d-e231-403d-a051-539314de2205 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:01.647003 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d55f9d-e231-403d-a051-539314de2205 None admin] PATH_INFO: `/v3/users/99f6ed5fa6664fab8503e3541af6991e` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:01.661506 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d55f9d-e231-403d-a051-539314de2205 None admin] RBAC: Authorizing `identity:get_user(user_id=99f6ed5fa6664fab8503e3541af6991e)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:01.662957 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d55f9d-e231-403d-a051-539314de2205 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:01.664601 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 557/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:46:01 2022] GET /identity/v3/users/99f6ed5fa6664fab8503e3541af6991e => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:01.673886 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c13fa5-3ce2-4654-98b2-e647e2606a3c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:01.781530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c13fa5-3ce2-4654-98b2-e647e2606a3c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:01.817510 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ddfa5-fb22-4e0f-b57b-e6ea80b02697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:01.818083 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ddfa5-fb22-4e0f-b57b-e6ea80b02697 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:01.818358 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ddfa5-fb22-4e0f-b57b-e6ea80b02697 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:01.818627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ddfa5-fb22-4e0f-b57b-e6ea80b02697 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:01.864592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:01.891563 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ddfa5-fb22-4e0f-b57b-e6ea80b02697 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:01.893035 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ddfa5-fb22-4e0f-b57b-e6ea80b02697 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:01.994796 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 558/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:46:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:46:02.001013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d55f9d-e231-403d-a051-539314de2205 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:02.048971 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:02.101960 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d55f9d-e231-403d-a051-539314de2205 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:02.136828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e585953-f623-4ba3-b249-200641269b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:02.137415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e585953-f623-4ba3-b249-200641269b4c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:02.137728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e585953-f623-4ba3-b249-200641269b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:02.137998 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e585953-f623-4ba3-b249-200641269b4c None admin] PATH_INFO: `/v3/projects/9ba1bc6062c246219442dca00cb06b68` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:02.139108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e585953-f623-4ba3-b249-200641269b4c None admin] RBAC: Authorizing `identity:get_project(project_id=9ba1bc6062c246219442dca00cb06b68)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:02.140575 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e585953-f623-4ba3-b249-200641269b4c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:02.142229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 558/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:46:01 2022] GET /identity/v3/projects/9ba1bc6062c246219442dca00cb06b68 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:02.149240 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ddfa5-fb22-4e0f-b57b-e6ea80b02697 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:02.247155 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:02.276059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ddfa5-fb22-4e0f-b57b-e6ea80b02697 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:02.311878 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0111054-ded9-4cb5-8211-21f730a3b4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:02.312474 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0111054-ded9-4cb5-8211-21f730a3b4ba None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:02.312749 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0111054-ded9-4cb5-8211-21f730a3b4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:02.313017 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0111054-ded9-4cb5-8211-21f730a3b4ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:02.313729 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0111054-ded9-4cb5-8211-21f730a3b4ba None admin] RBAC: Adding query filter params (role.id=30c5b9fbbb564c6dafe66f759683738b, scope.project.id=9ba1bc6062c246219442dca00cb06b68, user.id=99f6ed5fa6664fab8503e3541af6991e) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:46:02.314036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0111054-ded9-4cb5-8211-21f730a3b4ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:02.315518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0111054-ded9-4cb5-8211-21f730a3b4ba None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:02.321061 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 559/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:46:02 2022] GET /identity/v3/role_assignments?user.id=99f6ed5fa6664fab8503e3541af6991e&scope.project.id=9ba1bc6062c246219442dca00cb06b68&role.id=30c5b9fbbb564c6dafe66f759683738b => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:04.178788 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b53cc8-baec-4412-ae47-81f39ef79385 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:04.179402 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b53cc8-baec-4412-ae47-81f39ef79385 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:04.179402 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b53cc8-baec-4412-ae47-81f39ef79385 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:04.180720 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 559/1118] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:46:04.187087 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b00e94-270d-4c46-9831-749b83655349 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:04.187862 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b00e94-270d-4c46-9831-749b83655349 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:04.187988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b00e94-270d-4c46-9831-749b83655349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:04.212572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-36b00e94-270d-4c46-9831-749b83655349 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:46:04.213763 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-36b00e94-270d-4c46-9831-749b83655349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:46:04.285834 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 560/1119] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:46:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:46:04.550094 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b53cc8-baec-4412-ae47-81f39ef79385 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:04.671320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b53cc8-baec-4412-ae47-81f39ef79385 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:04.686987 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:04.720926 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff84e6-5b18-4619-84f9-9edc0a0b7946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:04.721557 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff84e6-5b18-4619-84f9-9edc0a0b7946 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:04.721835 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff84e6-5b18-4619-84f9-9edc0a0b7946 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:04.722107 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff84e6-5b18-4619-84f9-9edc0a0b7946 None admin] PATH_INFO: `/v3/roles/30c5b9fbbb564c6dafe66f759683738b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:04.723577 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff84e6-5b18-4619-84f9-9edc0a0b7946 None admin] RBAC: Authorizing `identity:get_role(role_id=30c5b9fbbb564c6dafe66f759683738b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:04.724941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff84e6-5b18-4619-84f9-9edc0a0b7946 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:04.726276 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 560/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:46:04 2022] GET /identity/v3/roles/30c5b9fbbb564c6dafe66f759683738b => generated 223 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:04.733175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b00e94-270d-4c46-9831-749b83655349 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:04.802275 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:04.836769 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b00e94-270d-4c46-9831-749b83655349 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:04.876992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad549b0-bb48-4f23-ad56-03c5cd1852d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:04.877621 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad549b0-bb48-4f23-ad56-03c5cd1852d4 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:04.877899 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad549b0-bb48-4f23-ad56-03c5cd1852d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:04.878170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad549b0-bb48-4f23-ad56-03c5cd1852d4 None admin] PATH_INFO: `/v3/users/99f6ed5fa6664fab8503e3541af6991e` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:04.879382 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad549b0-bb48-4f23-ad56-03c5cd1852d4 None admin] RBAC: Authorizing `identity:get_user(user_id=99f6ed5fa6664fab8503e3541af6991e)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:04.880836 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad549b0-bb48-4f23-ad56-03c5cd1852d4 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:04.882487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 561/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:46:04 2022] GET /identity/v3/users/99f6ed5fa6664fab8503e3541af6991e => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:04.888568 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff84e6-5b18-4619-84f9-9edc0a0b7946 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:05.003626 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff84e6-5b18-4619-84f9-9edc0a0b7946 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:05.040191 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f00972-e124-4923-af41-20f0a21c9572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:05.040812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f00972-e124-4923-af41-20f0a21c9572 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:05.041089 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f00972-e124-4923-af41-20f0a21c9572 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:05.041403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f00972-e124-4923-af41-20f0a21c9572 None admin] PATH_INFO: `/v3/projects/9ba1bc6062c246219442dca00cb06b68` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:05.042514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f00972-e124-4923-af41-20f0a21c9572 None admin] RBAC: Authorizing `identity:get_project(project_id=9ba1bc6062c246219442dca00cb06b68)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:05.044239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f00972-e124-4923-af41-20f0a21c9572 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:05.045866 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 561/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:46:04 2022] GET /identity/v3/projects/9ba1bc6062c246219442dca00cb06b68 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:05.052048 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad549b0-bb48-4f23-ad56-03c5cd1852d4 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:05.158811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad549b0-bb48-4f23-ad56-03c5cd1852d4 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:05.195419 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75bbc6-072a-48a0-a2c1-fcc384da0478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:05.196076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75bbc6-072a-48a0-a2c1-fcc384da0478 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:05.196378 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75bbc6-072a-48a0-a2c1-fcc384da0478 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:05.196653 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75bbc6-072a-48a0-a2c1-fcc384da0478 None admin] PATH_INFO: `/v3/projects/9ba1bc6062c246219442dca00cb06b68/users/99f6ed5fa6664fab8503e3541af6991e/roles/30c5b9fbbb564c6dafe66f759683738b` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:05.199162 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75bbc6-072a-48a0-a2c1-fcc384da0478 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ba1bc6062c246219442dca00cb06b68, user_id=99f6ed5fa6664fab8503e3541af6991e, role_id=30c5b9fbbb564c6dafe66f759683738b)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:05.201255 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75bbc6-072a-48a0-a2c1-fcc384da0478 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:05.204358 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:05.222967 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 562/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:46:05 2022] PUT /identity/v3/projects/9ba1bc6062c246219442dca00cb06b68/users/99f6ed5fa6664fab8503e3541af6991e/roles/30c5b9fbbb564c6dafe66f759683738b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:46:07.067281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70f115-16ad-4682-ad31-35cb53890653 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:07.068176 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70f115-16ad-4682-ad31-35cb53890653 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:07.068357 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70f115-16ad-4682-ad31-35cb53890653 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:07.070390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 562/1124] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:46:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:46:07.076710 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e0f16-e03c-4fb7-81f3-46003967109d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:07.077463 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e0f16-e03c-4fb7-81f3-46003967109d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:07.077630 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e0f16-e03c-4fb7-81f3-46003967109d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:07.102138 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-341e0f16-e03c-4fb7-81f3-46003967109d None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:46:07.103304 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-341e0f16-e03c-4fb7-81f3-46003967109d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:46:07.184505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 563/1125] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:46:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:46:07.447631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70f115-16ad-4682-ad31-35cb53890653 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:07.526439 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:07.580550 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70f115-16ad-4682-ad31-35cb53890653 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:07.615947 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307face-af72-41d2-be88-24e98a468590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:07.616564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307face-af72-41d2-be88-24e98a468590 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:07.616840 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307face-af72-41d2-be88-24e98a468590 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:07.617105 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307face-af72-41d2-be88-24e98a468590 None admin] PATH_INFO: `/v3/roles/30c5b9fbbb564c6dafe66f759683738b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:07.618603 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307face-af72-41d2-be88-24e98a468590 None admin] RBAC: Authorizing `identity:get_role(role_id=30c5b9fbbb564c6dafe66f759683738b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:07.620000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307face-af72-41d2-be88-24e98a468590 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:07.621318 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 563/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:46:07 2022] GET /identity/v3/roles/30c5b9fbbb564c6dafe66f759683738b => generated 223 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:07.627663 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e0f16-e03c-4fb7-81f3-46003967109d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:07.727149 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e0f16-e03c-4fb7-81f3-46003967109d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:07.759586 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:07.771868 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d549b9-b71a-4e9e-a53b-6b28759c9655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:07.772497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d549b9-b71a-4e9e-a53b-6b28759c9655 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:07.772771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d549b9-b71a-4e9e-a53b-6b28759c9655 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:07.773038 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d549b9-b71a-4e9e-a53b-6b28759c9655 None admin] PATH_INFO: `/v3/users/99f6ed5fa6664fab8503e3541af6991e` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:07.774272 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d549b9-b71a-4e9e-a53b-6b28759c9655 None admin] RBAC: Authorizing `identity:get_user(user_id=99f6ed5fa6664fab8503e3541af6991e)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:07.775749 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d549b9-b71a-4e9e-a53b-6b28759c9655 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:07.777326 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 564/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:46:07 2022] GET /identity/v3/users/99f6ed5fa6664fab8503e3541af6991e => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:07.783712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307face-af72-41d2-be88-24e98a468590 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:07.889813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307face-af72-41d2-be88-24e98a468590 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:07.908619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:07.927757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7122b-814f-4693-8fd6-a645dd62895c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:07.928351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7122b-814f-4693-8fd6-a645dd62895c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:07.928626 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7122b-814f-4693-8fd6-a645dd62895c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:07.928888 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7122b-814f-4693-8fd6-a645dd62895c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:07.999392 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f7122b-814f-4693-8fd6-a645dd62895c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:08.000778 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f7122b-814f-4693-8fd6-a645dd62895c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:08.102441 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 564/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:46:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:46:08.108896 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d549b9-b71a-4e9e-a53b-6b28759c9655 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:08.224859 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d549b9-b71a-4e9e-a53b-6b28759c9655 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:08.261658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4be649-27d7-42fe-80c9-f481f8efbc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:08.262255 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4be649-27d7-42fe-80c9-f481f8efbc6b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:08.262520 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4be649-27d7-42fe-80c9-f481f8efbc6b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:08.262794 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4be649-27d7-42fe-80c9-f481f8efbc6b None admin] PATH_INFO: `/v3/projects/9ba1bc6062c246219442dca00cb06b68` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:08.264019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4be649-27d7-42fe-80c9-f481f8efbc6b None admin] RBAC: Authorizing `identity:get_project(project_id=9ba1bc6062c246219442dca00cb06b68)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:08.265460 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4be649-27d7-42fe-80c9-f481f8efbc6b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:08.267053 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 565/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:46:08 2022] GET /identity/v3/projects/9ba1bc6062c246219442dca00cb06b68 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:08.273543 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7122b-814f-4693-8fd6-a645dd62895c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:08.295010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:08.386361 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7122b-814f-4693-8fd6-a645dd62895c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:08.426726 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aab1ae-7215-418c-beda-6bd24eec5664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:08.427326 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aab1ae-7215-418c-beda-6bd24eec5664 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:08.427628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aab1ae-7215-418c-beda-6bd24eec5664 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:08.427898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aab1ae-7215-418c-beda-6bd24eec5664 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:08.428624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aab1ae-7215-418c-beda-6bd24eec5664 None admin] RBAC: Adding query filter params (role.id=30c5b9fbbb564c6dafe66f759683738b, scope.project.id=9ba1bc6062c246219442dca00cb06b68, user.id=99f6ed5fa6664fab8503e3541af6991e) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:46:08.428924 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aab1ae-7215-418c-beda-6bd24eec5664 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:08.430366 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aab1ae-7215-418c-beda-6bd24eec5664 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:08.436575 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 565/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:46:08 2022] GET /identity/v3/role_assignments?user.id=99f6ed5fa6664fab8503e3541af6991e&scope.project.id=9ba1bc6062c246219442dca00cb06b68&role.id=30c5b9fbbb564c6dafe66f759683738b => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:10.321364 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e6c82-e989-4f25-b23c-80714523abda None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:10.322022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e6c82-e989-4f25-b23c-80714523abda None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:10.322022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e6c82-e989-4f25-b23c-80714523abda None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:10.323248 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 566/1131] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:46:10.329746 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab5f75-e5ad-4e41-9c9c-f92c34e323b7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:10.330445 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab5f75-e5ad-4e41-9c9c-f92c34e323b7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:10.330606 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab5f75-e5ad-4e41-9c9c-f92c34e323b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:10.359686 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-69ab5f75-e5ad-4e41-9c9c-f92c34e323b7 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:46:10.360952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-69ab5f75-e5ad-4e41-9c9c-f92c34e323b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:46:10.431185 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 566/1132] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:46:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:46:10.700913 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e6c82-e989-4f25-b23c-80714523abda None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:10.772047 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:10.813699 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e6c82-e989-4f25-b23c-80714523abda None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:10.849386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b04b4-b6cf-4560-9515-5dd2bc309f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:10.850000 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b04b4-b6cf-4560-9515-5dd2bc309f27 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:10.850281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b04b4-b6cf-4560-9515-5dd2bc309f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:10.850552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b04b4-b6cf-4560-9515-5dd2bc309f27 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:10.851731 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b04b4-b6cf-4560-9515-5dd2bc309f27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:10.853191 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b04b4-b6cf-4560-9515-5dd2bc309f27 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:10.854767 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 567/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:46:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:10.861658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab5f75-e5ad-4e41-9c9c-f92c34e323b7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:10.880106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:10.974596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab5f75-e5ad-4e41-9c9c-f92c34e323b7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:11.012671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638949c-9bf6-4251-88d9-f010ef03e637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:11.013351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638949c-9bf6-4251-88d9-f010ef03e637 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:11.013620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638949c-9bf6-4251-88d9-f010ef03e637 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:11.013886 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638949c-9bf6-4251-88d9-f010ef03e637 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:11.014524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638949c-9bf6-4251-88d9-f010ef03e637 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:11.015999 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638949c-9bf6-4251-88d9-f010ef03e637 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:11.045604 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 567/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Aug 30 11:46:10 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:46:12.966694 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb47cc-b0e1-41a1-a3a0-7025cb90673c None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:12.967258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb47cc-b0e1-41a1-a3a0-7025cb90673c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:12.967258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb47cc-b0e1-41a1-a3a0-7025cb90673c None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:12.968716 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 568/1135] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:46:12.977576 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb36d48-42c6-454e-8b71-419a1db8db16 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:12.978341 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb36d48-42c6-454e-8b71-419a1db8db16 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:12.978493 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb36d48-42c6-454e-8b71-419a1db8db16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:13.005246 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-aeb36d48-42c6-454e-8b71-419a1db8db16 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:46:13.006422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-aeb36d48-42c6-454e-8b71-419a1db8db16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:46:13.067635 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:13.077385 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 568/1136] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:46:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:46:13.346448 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb47cc-b0e1-41a1-a3a0-7025cb90673c None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:13.467741 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb47cc-b0e1-41a1-a3a0-7025cb90673c None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:13.504457 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:13.511057 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5235f8e-7a87-4f85-a38c-09a4fb564169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:13.511713 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5235f8e-7a87-4f85-a38c-09a4fb564169 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:13.511999 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5235f8e-7a87-4f85-a38c-09a4fb564169 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:13.512268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5235f8e-7a87-4f85-a38c-09a4fb564169 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:13.513554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5235f8e-7a87-4f85-a38c-09a4fb564169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:13.514937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5235f8e-7a87-4f85-a38c-09a4fb564169 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:13.516543 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 569/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:46:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:13.525754 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb36d48-42c6-454e-8b71-419a1db8db16 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:13.630261 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb36d48-42c6-454e-8b71-419a1db8db16 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:13.668811 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0f6aa-b98b-467c-922b-a3c597c23e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:13.671478 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0f6aa-b98b-467c-922b-a3c597c23e6a None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:13.671478 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0f6aa-b98b-467c-922b-a3c597c23e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:13.671478 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0f6aa-b98b-467c-922b-a3c597c23e6a None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:13.671478 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0f6aa-b98b-467c-922b-a3c597c23e6a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:13.673519 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0f6aa-b98b-467c-922b-a3c597c23e6a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:13.695326 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 569/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Aug 30 11:46:13 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:46:15.619483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5518dc5-7d49-4797-837d-12cfb0d28392 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:15.620398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5518dc5-7d49-4797-837d-12cfb0d28392 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:15.620398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5518dc5-7d49-4797-837d-12cfb0d28392 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:15.622595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 570/1139] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:46:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:46:15.631641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb23786-6d40-4d77-ad27-4a160c3f5bff None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:15.632363 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb23786-6d40-4d77-ad27-4a160c3f5bff None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:15.632514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb23786-6d40-4d77-ad27-4a160c3f5bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:15.653714 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ddb23786-6d40-4d77-ad27-4a160c3f5bff None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:46:15.654886 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ddb23786-6d40-4d77-ad27-4a160c3f5bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:46:15.712944 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:15.738140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 570/1140] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:46:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:46:16.000529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5518dc5-7d49-4797-837d-12cfb0d28392 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:16.120852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5518dc5-7d49-4797-837d-12cfb0d28392 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:16.155436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc6195-cd04-438d-8107-368b387076e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:16.156061 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc6195-cd04-438d-8107-368b387076e7 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:16.156338 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc6195-cd04-438d-8107-368b387076e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:16.156606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc6195-cd04-438d-8107-368b387076e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:16.167234 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc6195-cd04-438d-8107-368b387076e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:46:16.172146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-4efc6195-cd04-438d-8107-368b387076e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:46:16.172146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:46:16.172146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:46:16.172146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:46:16.172146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:46:16.172146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:46:16.172146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:46:16.172146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:46:16.172146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:46:16.172146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:46:16.172146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:46:16.172146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:46:16.172146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:46:16.172146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:46:16.172146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:46:16.172146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:46:16.173273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:46:16.173273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:46:16.173273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:46:16.173273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:46:16.173273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:46:16.173273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:46:16.173273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:46:16.173273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:46:16.173273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:46:16.173273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:46:16.173273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:46:16.173273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:46:16.173273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:46:16.173273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:46:16.173273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:46:16.173273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:46:16.174545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:46:16.174545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:46:16.174545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:46:16.174545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:46:16.174545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:46:16.174545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:46:16.174545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:46:16.174545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:46:16.174545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:46:16.174545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:46:16.174545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:46:16.174545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:46:16.174545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 571/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:46:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:46:16.179514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb23786-6d40-4d77-ad27-4a160c3f5bff None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:16.282051 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb23786-6d40-4d77-ad27-4a160c3f5bff None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:16.317524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b06548-c069-4324-bd23-4fe6336db531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:16.318126 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b06548-c069-4324-bd23-4fe6336db531 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:16.318403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b06548-c069-4324-bd23-4fe6336db531 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:16.318674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b06548-c069-4324-bd23-4fe6336db531 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:16.319323 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b06548-c069-4324-bd23-4fe6336db531 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:46:16.319655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b06548-c069-4324-bd23-4fe6336db531 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:16.321024 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b06548-c069-4324-bd23-4fe6336db531 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:16.329394 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 571/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:46:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:16.335316 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc6195-cd04-438d-8107-368b387076e7 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:16.404127 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:16.456664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc6195-cd04-438d-8107-368b387076e7 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:16.493252 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d00ac2-7367-4bbd-90f7-43c67fb8de5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:16.493916 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d00ac2-7367-4bbd-90f7-43c67fb8de5b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:16.494207 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d00ac2-7367-4bbd-90f7-43c67fb8de5b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:16.494474 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d00ac2-7367-4bbd-90f7-43c67fb8de5b None admin] PATH_INFO: `/v3/users/8abe112f1c1c489daaf143f76277080c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:16.508007 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d00ac2-7367-4bbd-90f7-43c67fb8de5b None admin] RBAC: Authorizing `identity:get_user(user_id=8abe112f1c1c489daaf143f76277080c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:16.509488 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d00ac2-7367-4bbd-90f7-43c67fb8de5b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:16.511152 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 572/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:46:16 2022] GET /identity/v3/users/8abe112f1c1c489daaf143f76277080c => generated 286 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:16.517675 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b06548-c069-4324-bd23-4fe6336db531 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:16.561912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:16.625666 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b06548-c069-4324-bd23-4fe6336db531 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:16.660874 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdbcc6-5cfa-4a9b-8e8d-c4fe8574e152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:16.661491 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdbcc6-5cfa-4a9b-8e8d-c4fe8574e152 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:16.661735 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdbcc6-5cfa-4a9b-8e8d-c4fe8574e152 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:16.661997 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdbcc6-5cfa-4a9b-8e8d-c4fe8574e152 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:16.739344 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdbcc6-5cfa-4a9b-8e8d-c4fe8574e152 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:16.741712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdbcc6-5cfa-4a9b-8e8d-c4fe8574e152 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:16.786830 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:16.849214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 572/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:46:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:46:16.855441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d00ac2-7367-4bbd-90f7-43c67fb8de5b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:16.977398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d00ac2-7367-4bbd-90f7-43c67fb8de5b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:16.994318 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:17.013748 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e15686-746a-412f-a61c-8c90edf12c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:17.014370 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e15686-746a-412f-a61c-8c90edf12c34 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:17.014644 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e15686-746a-412f-a61c-8c90edf12c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:17.014912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e15686-746a-412f-a61c-8c90edf12c34 None admin] PATH_INFO: `/v3/projects/9780261cb3894d359e7f3b5d9d6e0d8b` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:17.016050 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e15686-746a-412f-a61c-8c90edf12c34 None admin] RBAC: Authorizing `identity:get_project(project_id=9780261cb3894d359e7f3b5d9d6e0d8b)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:17.017494 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e15686-746a-412f-a61c-8c90edf12c34 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:17.019124 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 573/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:46:16 2022] GET /identity/v3/projects/9780261cb3894d359e7f3b5d9d6e0d8b => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:17.026151 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdbcc6-5cfa-4a9b-8e8d-c4fe8574e152 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:17.138135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdbcc6-5cfa-4a9b-8e8d-c4fe8574e152 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:17.171537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1c5d5-0451-4b21-9b1c-b247482af3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:17.172141 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1c5d5-0451-4b21-9b1c-b247482af3e9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:17.172417 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1c5d5-0451-4b21-9b1c-b247482af3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:17.172686 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1c5d5-0451-4b21-9b1c-b247482af3e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:17.173404 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1c5d5-0451-4b21-9b1c-b247482af3e9 None admin] RBAC: Adding query filter params (role.id=4f4d8a6881ca496bb2d4845a6592fea8, scope.project.id=9780261cb3894d359e7f3b5d9d6e0d8b, user.id=8abe112f1c1c489daaf143f76277080c) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:46:17.173708 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1c5d5-0451-4b21-9b1c-b247482af3e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:17.175140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1c5d5-0451-4b21-9b1c-b247482af3e9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:17.180429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 573/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:46:17 2022] GET /identity/v3/role_assignments?user.id=8abe112f1c1c489daaf143f76277080c&scope.project.id=9780261cb3894d359e7f3b5d9d6e0d8b&role.id=4f4d8a6881ca496bb2d4845a6592fea8 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:19.135320 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8ebb2-1d8a-4818-b5ba-2256a1bb4c7f None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:19.135865 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8ebb2-1d8a-4818-b5ba-2256a1bb4c7f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:19.135961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8ebb2-1d8a-4818-b5ba-2256a1bb4c7f None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:19.138016 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 574/1147] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:46:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:46:19.143661 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0aa87-7274-4ac6-9e11-68ad71682cd5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:19.144066 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0aa87-7274-4ac6-9e11-68ad71682cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:19.144240 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0aa87-7274-4ac6-9e11-68ad71682cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:19.160833 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:19.167005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-49f0aa87-7274-4ac6-9e11-68ad71682cd5 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:46:19.168239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-49f0aa87-7274-4ac6-9e11-68ad71682cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:46:19.239827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 574/1148] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:46:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:46:19.507548 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8ebb2-1d8a-4818-b5ba-2256a1bb4c7f None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:19.627145 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8ebb2-1d8a-4818-b5ba-2256a1bb4c7f None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:19.667095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35748f-a786-4350-a350-d7900f54b500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:19.668174 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35748f-a786-4350-a350-d7900f54b500 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:19.668559 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35748f-a786-4350-a350-d7900f54b500 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:19.668912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35748f-a786-4350-a350-d7900f54b500 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:19.686164 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35748f-a786-4350-a350-d7900f54b500 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:46:19.690970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-3d35748f-a786-4350-a350-d7900f54b500 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:46:19.690970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:46:19.690970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:46:19.690970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:46:19.690970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:46:19.690970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:46:19.690970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:46:19.690970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:46:19.690970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:46:19.690970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:46:19.690970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:46:19.690970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:46:19.690970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:46:19.690970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:46:19.690970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:46:19.690970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:46:19.692180 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:46:19.692180 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:46:19.692180 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:46:19.692180 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:46:19.692180 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:46:19.692180 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:46:19.692180 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:46:19.692180 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:46:19.692180 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:46:19.692180 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:46:19.692180 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:46:19.692180 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:46:19.692180 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:46:19.692180 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:46:19.692180 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:46:19.692180 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:46:19.693393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:46:19.693393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:46:19.693393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:46:19.693393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:46:19.693393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:46:19.693393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:46:19.693393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:46:19.693393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:46:19.693393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:46:19.693393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:46:19.693393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:46:19.693393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:46:19.693393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 575/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:46:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:46:19.698349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0aa87-7274-4ac6-9e11-68ad71682cd5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:19.804050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0aa87-7274-4ac6-9e11-68ad71682cd5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:19.839442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0b1ca-4449-4741-9e70-555be78fd713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:19.840049 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0b1ca-4449-4741-9e70-555be78fd713 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:19.840326 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0b1ca-4449-4741-9e70-555be78fd713 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:19.840593 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0b1ca-4449-4741-9e70-555be78fd713 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:19.841244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0b1ca-4449-4741-9e70-555be78fd713 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:46:19.841586 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0b1ca-4449-4741-9e70-555be78fd713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:19.842948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0b1ca-4449-4741-9e70-555be78fd713 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:19.845259 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:19.852813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 575/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:46:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:19.861683 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35748f-a786-4350-a350-d7900f54b500 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:19.911933 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:19.968251 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35748f-a786-4350-a350-d7900f54b500 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:20.002963 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e95975-3551-48ab-8a39-5a129fca46f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:20.003604 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e95975-3551-48ab-8a39-5a129fca46f0 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:20.003877 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e95975-3551-48ab-8a39-5a129fca46f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:20.004145 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e95975-3551-48ab-8a39-5a129fca46f0 None admin] PATH_INFO: `/v3/users/8abe112f1c1c489daaf143f76277080c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:20.005292 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e95975-3551-48ab-8a39-5a129fca46f0 None admin] RBAC: Authorizing `identity:get_user(user_id=8abe112f1c1c489daaf143f76277080c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:20.006737 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e95975-3551-48ab-8a39-5a129fca46f0 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:20.008358 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 576/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:46:19 2022] GET /identity/v3/users/8abe112f1c1c489daaf143f76277080c => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:46:20.015298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0b1ca-4449-4741-9e70-555be78fd713 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:20.136155 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0b1ca-4449-4741-9e70-555be78fd713 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:20.172482 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baee24d-adba-4a06-811b-890ac0761592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:20.173270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baee24d-adba-4a06-811b-890ac0761592 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:20.173544 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baee24d-adba-4a06-811b-890ac0761592 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:20.173855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baee24d-adba-4a06-811b-890ac0761592 None admin] PATH_INFO: `/v3/projects/9780261cb3894d359e7f3b5d9d6e0d8b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:20.175109 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baee24d-adba-4a06-811b-890ac0761592 None admin] RBAC: Authorizing `identity:get_project(project_id=9780261cb3894d359e7f3b5d9d6e0d8b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:20.176578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baee24d-adba-4a06-811b-890ac0761592 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:20.178226 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 576/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:46:20 2022] GET /identity/v3/projects/9780261cb3894d359e7f3b5d9d6e0d8b => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:20.184704 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e95975-3551-48ab-8a39-5a129fca46f0 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:20.293543 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e95975-3551-48ab-8a39-5a129fca46f0 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:20.306914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:20.341235 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40981b-910a-462d-a875-24916836dee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:20.341947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40981b-910a-462d-a875-24916836dee8 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:20.342221 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40981b-910a-462d-a875-24916836dee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:20.342487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40981b-910a-462d-a875-24916836dee8 None admin] PATH_INFO: `/v3/projects/9780261cb3894d359e7f3b5d9d6e0d8b/users/8abe112f1c1c489daaf143f76277080c/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:20.344521 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40981b-910a-462d-a875-24916836dee8 None admin] RBAC: Authorizing `identity:create_grant(project_id=9780261cb3894d359e7f3b5d9d6e0d8b, user_id=8abe112f1c1c489daaf143f76277080c, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:20.345960 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40981b-910a-462d-a875-24916836dee8 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:20.362169 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 577/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:46:20 2022] PUT /identity/v3/projects/9780261cb3894d359e7f3b5d9d6e0d8b/users/8abe112f1c1c489daaf143f76277080c/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:46:22.206125 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de7df2-e4ff-4fe1-90af-006cbbc05490 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:22.206694 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de7df2-e4ff-4fe1-90af-006cbbc05490 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:22.206694 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de7df2-e4ff-4fe1-90af-006cbbc05490 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:22.208046 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 577/1154] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:46:22.214696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334d7da-4b0e-4606-a40e-b79e5db672b3 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:22.215442 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334d7da-4b0e-4606-a40e-b79e5db672b3 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:22.215641 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334d7da-4b0e-4606-a40e-b79e5db672b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:22.240771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-8334d7da-4b0e-4606-a40e-b79e5db672b3 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:46:22.241956 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8334d7da-4b0e-4606-a40e-b79e5db672b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:46:22.326538 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 578/1155] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:46:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:46:22.589000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de7df2-e4ff-4fe1-90af-006cbbc05490 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:22.663384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:22.702783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de7df2-e4ff-4fe1-90af-006cbbc05490 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:22.738193 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de55a6-833d-443a-b9ab-045ff4329f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:22.738817 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de55a6-833d-443a-b9ab-045ff4329f11 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:22.739096 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de55a6-833d-443a-b9ab-045ff4329f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:22.739396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de55a6-833d-443a-b9ab-045ff4329f11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:22.752202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de55a6-833d-443a-b9ab-045ff4329f11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:46:22.756961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-57de55a6-833d-443a-b9ab-045ff4329f11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:46:22.756961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:46:22.756961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:46:22.756961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:46:22.756961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:46:22.756961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:46:22.756961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:46:22.756961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:46:22.756961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:46:22.756961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:46:22.756961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:46:22.756961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:46:22.756961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:46:22.756961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:46:22.756961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:46:22.756961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:46:22.758072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:46:22.758072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:46:22.758072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:46:22.758072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:46:22.758072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:46:22.758072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:46:22.758072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:46:22.758072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:46:22.758072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:46:22.758072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:46:22.758072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:46:22.758072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:46:22.758072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:46:22.758072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:46:22.758072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:46:22.758072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:46:22.759564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:46:22.759564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:46:22.759564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:46:22.759564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:46:22.759564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:46:22.759564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:46:22.759564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:46:22.759564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:46:22.759564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:46:22.759564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:46:22.759564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:46:22.759564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:46:22.759564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 578/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:46:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:46:22.767131 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334d7da-4b0e-4606-a40e-b79e5db672b3 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:22.869521 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334d7da-4b0e-4606-a40e-b79e5db672b3 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:22.871045 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:22.906183 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16dee9-7a23-4188-a084-1d784a30a428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:22.906793 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16dee9-7a23-4188-a084-1d784a30a428 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:22.907066 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16dee9-7a23-4188-a084-1d784a30a428 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:22.907332 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16dee9-7a23-4188-a084-1d784a30a428 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:22.908015 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16dee9-7a23-4188-a084-1d784a30a428 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:46:22.908316 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16dee9-7a23-4188-a084-1d784a30a428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:22.909727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16dee9-7a23-4188-a084-1d784a30a428 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:22.918503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 579/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:46:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:22.925239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de55a6-833d-443a-b9ab-045ff4329f11 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:23.042019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de55a6-833d-443a-b9ab-045ff4329f11 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:23.069537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:23.080302 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479e6dc-76fe-45dc-b03a-9134b260e19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:23.080927 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479e6dc-76fe-45dc-b03a-9134b260e19e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:23.081201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479e6dc-76fe-45dc-b03a-9134b260e19e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:23.081470 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479e6dc-76fe-45dc-b03a-9134b260e19e None admin] PATH_INFO: `/v3/users/8abe112f1c1c489daaf143f76277080c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:23.082630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479e6dc-76fe-45dc-b03a-9134b260e19e None admin] RBAC: Authorizing `identity:get_user(user_id=8abe112f1c1c489daaf143f76277080c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:23.084102 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479e6dc-76fe-45dc-b03a-9134b260e19e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:23.086024 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 579/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:46:22 2022] GET /identity/v3/users/8abe112f1c1c489daaf143f76277080c => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:23.092162 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16dee9-7a23-4188-a084-1d784a30a428 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:23.213190 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16dee9-7a23-4188-a084-1d784a30a428 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:23.256401 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de774ff4-5dfc-48f9-99f3-bae5de141cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:23.256980 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de774ff4-5dfc-48f9-99f3-bae5de141cbd None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:23.257262 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de774ff4-5dfc-48f9-99f3-bae5de141cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:23.257530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de774ff4-5dfc-48f9-99f3-bae5de141cbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:23.297058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:23.336546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de774ff4-5dfc-48f9-99f3-bae5de141cbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:23.338019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de774ff4-5dfc-48f9-99f3-bae5de141cbd None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:23.442414 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 580/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:46:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:46:23.449323 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479e6dc-76fe-45dc-b03a-9134b260e19e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:23.564175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479e6dc-76fe-45dc-b03a-9134b260e19e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:23.605965 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d44cd-9447-438b-baae-84bd8e1c45c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:23.606579 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d44cd-9447-438b-baae-84bd8e1c45c3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:23.607002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d44cd-9447-438b-baae-84bd8e1c45c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:23.607521 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d44cd-9447-438b-baae-84bd8e1c45c3 None admin] PATH_INFO: `/v3/projects/9780261cb3894d359e7f3b5d9d6e0d8b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:23.608685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d44cd-9447-438b-baae-84bd8e1c45c3 None admin] RBAC: Authorizing `identity:get_project(project_id=9780261cb3894d359e7f3b5d9d6e0d8b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:23.610116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d44cd-9447-438b-baae-84bd8e1c45c3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:23.611765 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 580/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:46:23 2022] GET /identity/v3/projects/9780261cb3894d359e7f3b5d9d6e0d8b => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:23.618174 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de774ff4-5dfc-48f9-99f3-bae5de141cbd None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:23.683850 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:23.730161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de774ff4-5dfc-48f9-99f3-bae5de141cbd None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:23.765594 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76300617-6e22-45fd-ab30-55cb4c7718e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:23.766179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76300617-6e22-45fd-ab30-55cb4c7718e7 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:23.766451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76300617-6e22-45fd-ab30-55cb4c7718e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:23.766714 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76300617-6e22-45fd-ab30-55cb4c7718e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:23.767414 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76300617-6e22-45fd-ab30-55cb4c7718e7 None admin] RBAC: Adding query filter params (role.id=4f4d8a6881ca496bb2d4845a6592fea8, scope.project.id=9780261cb3894d359e7f3b5d9d6e0d8b, user.id=8abe112f1c1c489daaf143f76277080c) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:46:23.767749 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76300617-6e22-45fd-ab30-55cb4c7718e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:23.769193 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76300617-6e22-45fd-ab30-55cb4c7718e7 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:23.775046 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 581/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:46:23 2022] GET /identity/v3/role_assignments?user.id=8abe112f1c1c489daaf143f76277080c&scope.project.id=9780261cb3894d359e7f3b5d9d6e0d8b&role.id=4f4d8a6881ca496bb2d4845a6592fea8 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:25.698277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274c190-daad-4104-83c1-7c0c3995954d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:25.699205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274c190-daad-4104-83c1-7c0c3995954d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:25.699205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274c190-daad-4104-83c1-7c0c3995954d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:25.701325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 581/1162] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:46:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:46:25.706665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117cd61-15ae-4b28-97fd-e17aa9c74d9d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:25.707104 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117cd61-15ae-4b28-97fd-e17aa9c74d9d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:25.707207 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117cd61-15ae-4b28-97fd-e17aa9c74d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:25.726849 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-b117cd61-15ae-4b28-97fd-e17aa9c74d9d None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:46:25.728049 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b117cd61-15ae-4b28-97fd-e17aa9c74d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:46:25.796612 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 582/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:46:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:46:26.056730 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274c190-daad-4104-83c1-7c0c3995954d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:26.134055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:26.175812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274c190-daad-4104-83c1-7c0c3995954d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:26.210881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4378dc7-2cac-4775-afd8-9e27f19858bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:26.211514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4378dc7-2cac-4775-afd8-9e27f19858bf None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:26.211795 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4378dc7-2cac-4775-afd8-9e27f19858bf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:26.212065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4378dc7-2cac-4775-afd8-9e27f19858bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:26.282217 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4378dc7-2cac-4775-afd8-9e27f19858bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:26.283706 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4378dc7-2cac-4775-afd8-9e27f19858bf None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:26.345424 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:26.387177 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 582/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:46:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:46:26.394112 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117cd61-15ae-4b28-97fd-e17aa9c74d9d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:26.464999 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:26.511554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117cd61-15ae-4b28-97fd-e17aa9c74d9d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:26.547322 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738854f9-d3a6-4cac-93f1-e8e771d5d16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:26.547968 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738854f9-d3a6-4cac-93f1-e8e771d5d16b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:26.548235 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738854f9-d3a6-4cac-93f1-e8e771d5d16b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:26.548502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738854f9-d3a6-4cac-93f1-e8e771d5d16b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:26.555388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738854f9-d3a6-4cac-93f1-e8e771d5d16b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:26.556854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738854f9-d3a6-4cac-93f1-e8e771d5d16b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:26.568654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-738854f9-d3a6-4cac-93f1-e8e771d5d16b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 11:46:26.568654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:46:26.568654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 11:46:26.568654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 11:46:26.568654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:46:26.568654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:46:26.568654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:46:26.568654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:46:26.568654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 30 11:46:26.568654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:46:26.568654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:46:26.568654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:46:26.568654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:46:26.568654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:46:26.568654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:46:26.568654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:46:26.568654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:46:26.569810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:46:26.569810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:46:26.569810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:46:26.569810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:46:26.569810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:46:26.569810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:46:26.569810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:46:26.569810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:46:26.569810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:46:26.569810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:46:26.569810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:46:26.569810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:46:26.569810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:46:26.569810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:46:26.569810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:46:26.569810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:46:26.571059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:46:26.571059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:46:26.571059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:46:26.571059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:46:26.571059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:46:26.571059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:46:26.571059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:46:26.571059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:46:26.571059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:46:26.571059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:46:26.571059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 11:46:26.571059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:46:26.571059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 11:46:26.571059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:46:26.571059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 583/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Aug 30 11:46:26 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:46:26.575891 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4378dc7-2cac-4775-afd8-9e27f19858bf None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:26.679966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4378dc7-2cac-4775-afd8-9e27f19858bf None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:26.717205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85eb794-69bb-4e68-adcf-b2c2fb87725b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:26.717825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85eb794-69bb-4e68-adcf-b2c2fb87725b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:26.718051 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85eb794-69bb-4e68-adcf-b2c2fb87725b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:26.718315 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85eb794-69bb-4e68-adcf-b2c2fb87725b None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:26.718941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85eb794-69bb-4e68-adcf-b2c2fb87725b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:46:26.719232 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85eb794-69bb-4e68-adcf-b2c2fb87725b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:26.720606 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85eb794-69bb-4e68-adcf-b2c2fb87725b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:26.727787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 583/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Aug 30 11:46:26 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:46:28.592674 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd8f3b-73f9-4c82-a103-8abdb3b6a140 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:28.593564 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd8f3b-73f9-4c82-a103-8abdb3b6a140 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:28.593564 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd8f3b-73f9-4c82-a103-8abdb3b6a140 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:28.595813 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 584/1167] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:46:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:46:28.603886 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07336c85-7712-4301-97ce-6c435faa0f08 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:28.604347 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07336c85-7712-4301-97ce-6c435faa0f08 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:28.604439 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07336c85-7712-4301-97ce-6c435faa0f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:28.624611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-07336c85-7712-4301-97ce-6c435faa0f08 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:46:28.625775 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-07336c85-7712-4301-97ce-6c435faa0f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:46:28.646590 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:28.696003 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 584/1168] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:46:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:46:28.961800 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd8f3b-73f9-4c82-a103-8abdb3b6a140 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:29.078821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd8f3b-73f9-4c82-a103-8abdb3b6a140 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:29.096747 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:29.115928 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60b30d-9d31-4b4d-a818-66c0578229f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:29.116541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60b30d-9d31-4b4d-a818-66c0578229f5 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:29.116819 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60b30d-9d31-4b4d-a818-66c0578229f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:29.117088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60b30d-9d31-4b4d-a818-66c0578229f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:29.117753 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60b30d-9d31-4b4d-a818-66c0578229f5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:29.119148 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60b30d-9d31-4b4d-a818-66c0578229f5 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:29.138419 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 585/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Tue Aug 30 11:46:28 2022] POST /identity/v3/domains => generated 267 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:46:31.120249 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0baadc-4e2a-4b83-ad92-c9b47907473c None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:31.120732 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0baadc-4e2a-4b83-ad92-c9b47907473c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:31.120834 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0baadc-4e2a-4b83-ad92-c9b47907473c None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:31.122655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 585/1170] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:46:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:46:31.128258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39594614-862b-4afb-abe1-c4fc8e44ca86 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:31.128664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39594614-862b-4afb-abe1-c4fc8e44ca86 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:31.128798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39594614-862b-4afb-abe1-c4fc8e44ca86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:31.147883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-39594614-862b-4afb-abe1-c4fc8e44ca86 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:46:31.149057 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-39594614-862b-4afb-abe1-c4fc8e44ca86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:46:31.218275 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 586/1171] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:46:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:46:31.488980 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0baadc-4e2a-4b83-ad92-c9b47907473c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:31.600965 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0baadc-4e2a-4b83-ad92-c9b47907473c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:31.636338 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9a440-70c1-474d-9b05-dbeaafd28f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:31.636967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9a440-70c1-474d-9b05-dbeaafd28f06 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:31.637246 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9a440-70c1-474d-9b05-dbeaafd28f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:31.637513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9a440-70c1-474d-9b05-dbeaafd28f06 None admin] PATH_INFO: `/v3/domains/0bdbb76f1361451e85c9941407608982` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:31.648454 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9a440-70c1-474d-9b05-dbeaafd28f06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0bdbb76f1361451e85c9941407608982)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:31.649903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9a440-70c1-474d-9b05-dbeaafd28f06 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:31.651589 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 586/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Tue Aug 30 11:46:31 2022] GET /identity/v3/domains/0bdbb76f1361451e85c9941407608982 => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:31.657693 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39594614-862b-4afb-abe1-c4fc8e44ca86 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:31.776321 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39594614-862b-4afb-abe1-c4fc8e44ca86 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:31.785981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:31.815227 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b5cb9-ff8c-403b-a9a7-f249bc4618a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:31.815860 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b5cb9-ff8c-403b-a9a7-f249bc4618a3 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:31.816136 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b5cb9-ff8c-403b-a9a7-f249bc4618a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:31.816401 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b5cb9-ff8c-403b-a9a7-f249bc4618a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:31.817037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b5cb9-ff8c-403b-a9a7-f249bc4618a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:31.818492 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b5cb9-ff8c-403b-a9a7-f249bc4618a3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:31.846988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 587/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Aug 30 11:46:31 2022] POST /identity/v3/projects => generated 361 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:46:33.759204 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1fc32-ac38-43f4-88b0-fd636b44fd6d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:33.759826 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1fc32-ac38-43f4-88b0-fd636b44fd6d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:33.759826 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1fc32-ac38-43f4-88b0-fd636b44fd6d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:33.761123 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 587/1174] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:46:33.767599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2c409-8ce8-4ef4-83d3-cd9340fa1988 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:33.768254 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2c409-8ce8-4ef4-83d3-cd9340fa1988 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:33.768444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2c409-8ce8-4ef4-83d3-cd9340fa1988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:33.791988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-60c2c409-8ce8-4ef4-83d3-cd9340fa1988 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:46:33.793196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-60c2c409-8ce8-4ef4-83d3-cd9340fa1988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:46:33.865220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 588/1175] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:46:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:46:34.139565 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1fc32-ac38-43f4-88b0-fd636b44fd6d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:34.160684 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:34.248119 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1fc32-ac38-43f4-88b0-fd636b44fd6d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:34.282532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58a64b-1e4b-4bde-a4c7-b607490c78fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:34.283147 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58a64b-1e4b-4bde-a4c7-b607490c78fc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:34.283464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58a64b-1e4b-4bde-a4c7-b607490c78fc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:34.283727 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58a64b-1e4b-4bde-a4c7-b607490c78fc None admin] PATH_INFO: `/v3/domains/0bdbb76f1361451e85c9941407608982` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:34.284924 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58a64b-1e4b-4bde-a4c7-b607490c78fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=0bdbb76f1361451e85c9941407608982)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:34.286357 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58a64b-1e4b-4bde-a4c7-b607490c78fc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:34.287984 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 588/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Tue Aug 30 11:46:34 2022] GET /identity/v3/domains/0bdbb76f1361451e85c9941407608982 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:34.294578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2c409-8ce8-4ef4-83d3-cd9340fa1988 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:34.407916 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:34.419276 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2c409-8ce8-4ef4-83d3-cd9340fa1988 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:34.453997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbc0b0-124e-4efd-9311-ce2c394894e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:34.454588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbc0b0-124e-4efd-9311-ce2c394894e4 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:34.454861 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbc0b0-124e-4efd-9311-ce2c394894e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:34.455126 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbc0b0-124e-4efd-9311-ce2c394894e4 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:34.455801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbc0b0-124e-4efd-9311-ce2c394894e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:34.457250 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbc0b0-124e-4efd-9311-ce2c394894e4 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:34.482209 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 589/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Aug 30 11:46:34 2022] POST /identity/v3/users => generated 311 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:46:36.418096 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23813522-bada-4e63-861e-56a3561f3c48 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:36.418733 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23813522-bada-4e63-861e-56a3561f3c48 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:36.418733 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23813522-bada-4e63-861e-56a3561f3c48 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:36.420014 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 589/1178] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:46:36.426887 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c264b1-8a57-4356-aebb-caeb8810cfee None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:36.427631 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c264b1-8a57-4356-aebb-caeb8810cfee None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:36.427806 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c264b1-8a57-4356-aebb-caeb8810cfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:36.455612 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-23c264b1-8a57-4356-aebb-caeb8810cfee None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:46:36.456804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-23c264b1-8a57-4356-aebb-caeb8810cfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:46:36.527724 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 590/1179] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:46:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:46:36.794480 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23813522-bada-4e63-861e-56a3561f3c48 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:36.888081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:36.911637 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23813522-bada-4e63-861e-56a3561f3c48 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:36.944829 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64564b-8f2b-4d3a-8cf7-1fc40b229506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:36.945452 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64564b-8f2b-4d3a-8cf7-1fc40b229506 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:36.945728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64564b-8f2b-4d3a-8cf7-1fc40b229506 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:36.945999 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64564b-8f2b-4d3a-8cf7-1fc40b229506 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:36.959866 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64564b-8f2b-4d3a-8cf7-1fc40b229506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:46:36.964715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ed64564b-8f2b-4d3a-8cf7-1fc40b229506 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:46:36.964715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:46:36.964715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:46:36.964715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:46:36.964715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:46:36.964715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:46:36.964715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:46:36.964715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:46:36.964715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:46:36.964715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:46:36.964715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:46:36.964715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:46:36.964715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:46:36.964715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:46:36.964715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:46:36.964715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:46:36.965828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:46:36.965828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:46:36.965828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:46:36.965828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:46:36.965828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:46:36.965828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:46:36.965828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:46:36.965828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:46:36.965828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:46:36.965828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:46:36.965828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:46:36.965828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:46:36.965828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:46:36.965828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:46:36.965828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:46:36.965828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:46:36.967110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:46:36.967110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:46:36.967110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:46:36.967110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:46:36.967110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:46:36.967110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:46:36.967110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:46:36.967110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:46:36.967110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:46:36.967110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:46:36.967110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:46:36.967110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:46:36.967110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 590/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:46:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:46:36.972150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c264b1-8a57-4356-aebb-caeb8810cfee None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:37.053921 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:37.090190 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c264b1-8a57-4356-aebb-caeb8810cfee None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:37.125165 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc238c-9c61-42d7-b812-89c4b357b14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:37.125772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc238c-9c61-42d7-b812-89c4b357b14a None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:37.126043 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc238c-9c61-42d7-b812-89c4b357b14a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:37.126308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc238c-9c61-42d7-b812-89c4b357b14a None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:37.126961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc238c-9c61-42d7-b812-89c4b357b14a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:46:37.127259 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc238c-9c61-42d7-b812-89c4b357b14a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:37.128674 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc238c-9c61-42d7-b812-89c4b357b14a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:37.136855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 591/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:46:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:46:37.143720 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64564b-8f2b-4d3a-8cf7-1fc40b229506 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:37.260197 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64564b-8f2b-4d3a-8cf7-1fc40b229506 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:37.295213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157f07f-2596-4843-8879-7ed524d12b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:37.295867 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157f07f-2596-4843-8879-7ed524d12b28 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:37.296147 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157f07f-2596-4843-8879-7ed524d12b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:37.296424 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157f07f-2596-4843-8879-7ed524d12b28 None admin] PATH_INFO: `/v3/users/2dffbbbe972040f99bd8661d563e30b4` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:37.314126 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157f07f-2596-4843-8879-7ed524d12b28 None admin] RBAC: Authorizing `identity:get_user(user_id=2dffbbbe972040f99bd8661d563e30b4)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:37.315570 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157f07f-2596-4843-8879-7ed524d12b28 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:37.317182 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 591/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:46:37 2022] GET /identity/v3/users/2dffbbbe972040f99bd8661d563e30b4 => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:37.326678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc238c-9c61-42d7-b812-89c4b357b14a None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:37.442486 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc238c-9c61-42d7-b812-89c4b357b14a None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:37.489634 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de7378-083e-4a2d-abf7-c7ddce394355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:37.490264 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de7378-083e-4a2d-abf7-c7ddce394355 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:37.490539 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de7378-083e-4a2d-abf7-c7ddce394355 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:37.490805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de7378-083e-4a2d-abf7-c7ddce394355 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:37.500611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:37.572078 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de7378-083e-4a2d-abf7-c7ddce394355 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:37.573460 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de7378-083e-4a2d-abf7-c7ddce394355 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:37.673301 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 592/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:46:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:46:37.683085 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157f07f-2596-4843-8879-7ed524d12b28 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:37.687588 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:37.806039 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157f07f-2596-4843-8879-7ed524d12b28 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:37.843113 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695e038-c0d3-484f-999d-3128d4c90245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:37.843691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695e038-c0d3-484f-999d-3128d4c90245 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:37.843969 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695e038-c0d3-484f-999d-3128d4c90245 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:37.844236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695e038-c0d3-484f-999d-3128d4c90245 None admin] PATH_INFO: `/v3/projects/a35ab63fa2e94cf19fe9440c6539493a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:37.845480 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695e038-c0d3-484f-999d-3128d4c90245 None admin] RBAC: Authorizing `identity:get_project(project_id=a35ab63fa2e94cf19fe9440c6539493a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:37.846922 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695e038-c0d3-484f-999d-3128d4c90245 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:37.848580 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 592/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:46:37 2022] GET /identity/v3/projects/a35ab63fa2e94cf19fe9440c6539493a => generated 361 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:37.858086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de7378-083e-4a2d-abf7-c7ddce394355 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:37.900789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:37.964963 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de7378-083e-4a2d-abf7-c7ddce394355 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:38.000373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef0856-68e9-49b0-86eb-420f05940977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:38.000971 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef0856-68e9-49b0-86eb-420f05940977 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:38.001243 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef0856-68e9-49b0-86eb-420f05940977 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:38.001506 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef0856-68e9-49b0-86eb-420f05940977 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:38.002218 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef0856-68e9-49b0-86eb-420f05940977 None admin] RBAC: Adding query filter params (role.id=4f4d8a6881ca496bb2d4845a6592fea8, scope.project.id=a35ab63fa2e94cf19fe9440c6539493a, user.id=2dffbbbe972040f99bd8661d563e30b4) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:46:38.002523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef0856-68e9-49b0-86eb-420f05940977 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:38.004011 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef0856-68e9-49b0-86eb-420f05940977 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:38.010058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 593/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:46:37 2022] GET /identity/v3/role_assignments?user.id=2dffbbbe972040f99bd8661d563e30b4&scope.project.id=a35ab63fa2e94cf19fe9440c6539493a&role.id=4f4d8a6881ca496bb2d4845a6592fea8 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:46:39.843738 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abef9c8-0933-4244-b12b-c19460d46405 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:39.844605 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abef9c8-0933-4244-b12b-c19460d46405 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:39.844755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abef9c8-0933-4244-b12b-c19460d46405 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:39.846967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 593/1186] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:46:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:46:39.856030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc6fd3-99ca-42bc-91a7-696da12005be None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:39.856743 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc6fd3-99ca-42bc-91a7-696da12005be None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:39.856929 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc6fd3-99ca-42bc-91a7-696da12005be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:39.882402 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d7cc6fd3-99ca-42bc-91a7-696da12005be None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:46:39.883630 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d7cc6fd3-99ca-42bc-91a7-696da12005be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:46:39.955249 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 594/1187] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:46:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:46:40.219617 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abef9c8-0933-4244-b12b-c19460d46405 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:40.297140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:40.335500 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abef9c8-0933-4244-b12b-c19460d46405 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:40.383174 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68cce7-7ab9-4be1-908b-5d34772a8e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:40.383759 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68cce7-7ab9-4be1-908b-5d34772a8e97 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:40.384036 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68cce7-7ab9-4be1-908b-5d34772a8e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:40.384311 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68cce7-7ab9-4be1-908b-5d34772a8e97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:40.399052 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68cce7-7ab9-4be1-908b-5d34772a8e97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:46:40.407306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3e68cce7-7ab9-4be1-908b-5d34772a8e97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:46:40.407306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:46:40.407306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:46:40.407306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:46:40.407306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:46:40.407306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:46:40.407306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:46:40.407306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:46:40.407306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:46:40.407306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:46:40.407306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:46:40.407306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:46:40.407306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:46:40.407306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:46:40.407306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:46:40.407306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:46:40.408391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:46:40.408391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:46:40.408391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:46:40.408391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:46:40.408391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:46:40.408391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:46:40.408391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:46:40.408391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:46:40.408391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:46:40.408391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:46:40.408391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:46:40.408391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:46:40.408391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:46:40.408391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:46:40.408391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:46:40.408391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:46:40.409267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:46:40.409267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:46:40.409267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:46:40.409267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:46:40.409267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:46:40.409267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:46:40.409267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:46:40.409267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:46:40.409267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:46:40.409267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:46:40.409267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:46:40.409267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:46:40.409267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 594/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:46:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:46:40.417115 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc6fd3-99ca-42bc-91a7-696da12005be None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:40.452249 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:40.526852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc6fd3-99ca-42bc-91a7-696da12005be None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:40.561276 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4c495-28df-4e4d-b2b4-710c030751f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:40.561878 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4c495-28df-4e4d-b2b4-710c030751f3 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:40.562156 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4c495-28df-4e4d-b2b4-710c030751f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:40.562425 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4c495-28df-4e4d-b2b4-710c030751f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:40.563079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4c495-28df-4e4d-b2b4-710c030751f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:46:40.563394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4c495-28df-4e4d-b2b4-710c030751f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:40.564809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4c495-28df-4e4d-b2b4-710c030751f3 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:40.572554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 595/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:46:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:40.582029 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68cce7-7ab9-4be1-908b-5d34772a8e97 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:40.694816 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68cce7-7ab9-4be1-908b-5d34772a8e97 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:40.728427 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:40.735601 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f352e1d-b640-4fc8-ac4b-4ed85c03b092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:40.736231 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f352e1d-b640-4fc8-ac4b-4ed85c03b092 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:40.736501 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f352e1d-b640-4fc8-ac4b-4ed85c03b092 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:40.736746 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f352e1d-b640-4fc8-ac4b-4ed85c03b092 None admin] PATH_INFO: `/v3/users/2dffbbbe972040f99bd8661d563e30b4` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:40.737881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f352e1d-b640-4fc8-ac4b-4ed85c03b092 None admin] RBAC: Authorizing `identity:get_user(user_id=2dffbbbe972040f99bd8661d563e30b4)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:40.739308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f352e1d-b640-4fc8-ac4b-4ed85c03b092 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:40.740911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 595/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:46:40 2022] GET /identity/v3/users/2dffbbbe972040f99bd8661d563e30b4 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:40.747512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4c495-28df-4e4d-b2b4-710c030751f3 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:40.852548 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:40.861866 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4c495-28df-4e4d-b2b4-710c030751f3 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:40.898268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d26598-ac6d-490a-b743-9cf6eda2e2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:40.898903 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d26598-ac6d-490a-b743-9cf6eda2e2ed None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:40.899180 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d26598-ac6d-490a-b743-9cf6eda2e2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:40.899503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d26598-ac6d-490a-b743-9cf6eda2e2ed None admin] PATH_INFO: `/v3/projects/a35ab63fa2e94cf19fe9440c6539493a` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:40.900725 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d26598-ac6d-490a-b743-9cf6eda2e2ed None admin] RBAC: Authorizing `identity:get_project(project_id=a35ab63fa2e94cf19fe9440c6539493a)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:40.902166 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d26598-ac6d-490a-b743-9cf6eda2e2ed None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:40.903852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 596/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:46:40 2022] GET /identity/v3/projects/a35ab63fa2e94cf19fe9440c6539493a => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:40.912836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f352e1d-b640-4fc8-ac4b-4ed85c03b092 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:41.022815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f352e1d-b640-4fc8-ac4b-4ed85c03b092 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:41.057855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb452a-76aa-450f-87f2-c46ae107c4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:41.058513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb452a-76aa-450f-87f2-c46ae107c4ca None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:41.058789 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb452a-76aa-450f-87f2-c46ae107c4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:41.059061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb452a-76aa-450f-87f2-c46ae107c4ca None admin] PATH_INFO: `/v3/projects/a35ab63fa2e94cf19fe9440c6539493a/users/2dffbbbe972040f99bd8661d563e30b4/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:41.061142 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb452a-76aa-450f-87f2-c46ae107c4ca None admin] RBAC: Authorizing `identity:create_grant(project_id=a35ab63fa2e94cf19fe9440c6539493a, user_id=2dffbbbe972040f99bd8661d563e30b4, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:41.062560 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb452a-76aa-450f-87f2-c46ae107c4ca None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:41.078191 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 596/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:46:40 2022] PUT /identity/v3/projects/a35ab63fa2e94cf19fe9440c6539493a/users/2dffbbbe972040f99bd8661d563e30b4/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:46:42.942783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbea069-e85d-4e65-97df-01bd7e5f0ed9 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:42.943399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbea069-e85d-4e65-97df-01bd7e5f0ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:42.943399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbea069-e85d-4e65-97df-01bd7e5f0ed9 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:42.944707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 597/1193] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:46:42.951108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35becbf-aedf-469a-b686-e913d49d000c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:42.952051 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35becbf-aedf-469a-b686-e913d49d000c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:42.952051 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35becbf-aedf-469a-b686-e913d49d000c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:42.977329 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d35becbf-aedf-469a-b686-e913d49d000c None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:46:42.978551 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d35becbf-aedf-469a-b686-e913d49d000c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:46:43.035835 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:43.052357 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 597/1194] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:46:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:46:43.325057 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbea069-e85d-4e65-97df-01bd7e5f0ed9 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:43.439582 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbea069-e85d-4e65-97df-01bd7e5f0ed9 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:43.475378 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cffbf8-9f07-4d4d-9517-1dd47ca33428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:43.476011 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cffbf8-9f07-4d4d-9517-1dd47ca33428 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:43.476291 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cffbf8-9f07-4d4d-9517-1dd47ca33428 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:43.476562 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cffbf8-9f07-4d4d-9517-1dd47ca33428 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:43.488614 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cffbf8-9f07-4d4d-9517-1dd47ca33428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:46:43.493487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-57cffbf8-9f07-4d4d-9517-1dd47ca33428 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:46:43.493487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:46:43.493487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:46:43.493487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:46:43.493487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:46:43.493487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:46:43.493487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:46:43.493487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:46:43.493487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:46:43.493487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:46:43.493487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:46:43.493487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:46:43.493487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:46:43.493487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:46:43.493487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:46:43.493487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:46:43.494606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:46:43.494606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:46:43.494606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:46:43.494606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:46:43.494606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:46:43.494606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:46:43.494606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:46:43.494606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:46:43.494606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:46:43.494606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:46:43.494606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:46:43.494606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:46:43.494606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:46:43.494606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:46:43.494606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:46:43.494606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:46:43.495734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:46:43.495734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:46:43.495734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:46:43.495734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:46:43.495734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:46:43.495734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:46:43.495734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:46:43.495734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:46:43.495734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:46:43.495734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:46:43.495734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:46:43.495734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:46:43.500012 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 598/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:46:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:46:43.500905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35becbf-aedf-469a-b686-e913d49d000c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:43.613927 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35becbf-aedf-469a-b686-e913d49d000c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:43.652605 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7cc40-9986-4d78-9b77-de34fa053841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:43.653201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7cc40-9986-4d78-9b77-de34fa053841 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:43.653471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7cc40-9986-4d78-9b77-de34fa053841 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:43.653823 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7cc40-9986-4d78-9b77-de34fa053841 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:43.654589 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7cc40-9986-4d78-9b77-de34fa053841 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:46:43.654885 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7cc40-9986-4d78-9b77-de34fa053841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:43.656283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7cc40-9986-4d78-9b77-de34fa053841 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:43.664443 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 598/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:46:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:46:43.670669 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cffbf8-9f07-4d4d-9517-1dd47ca33428 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:43.697665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:43.772090 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cffbf8-9f07-4d4d-9517-1dd47ca33428 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:43.806768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03352cdc-10b9-4e9d-a247-afb94749949b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:43.807407 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03352cdc-10b9-4e9d-a247-afb94749949b None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:43.807678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03352cdc-10b9-4e9d-a247-afb94749949b None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:43.807944 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03352cdc-10b9-4e9d-a247-afb94749949b None admin] PATH_INFO: `/v3/users/2dffbbbe972040f99bd8661d563e30b4` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:43.809174 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03352cdc-10b9-4e9d-a247-afb94749949b None admin] RBAC: Authorizing `identity:get_user(user_id=2dffbbbe972040f99bd8661d563e30b4)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:43.810678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03352cdc-10b9-4e9d-a247-afb94749949b None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:43.812281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 599/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Aug 30 11:46:43 2022] GET /identity/v3/users/2dffbbbe972040f99bd8661d563e30b4 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:43.818491 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7cc40-9986-4d78-9b77-de34fa053841 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:43.869898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:43.921349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7cc40-9986-4d78-9b77-de34fa053841 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:43.956097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167ace9-f472-49bf-9027-c7a0bb5f6d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:43.956684 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167ace9-f472-49bf-9027-c7a0bb5f6d25 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:43.956940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167ace9-f472-49bf-9027-c7a0bb5f6d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:43.957200 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167ace9-f472-49bf-9027-c7a0bb5f6d25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:44.027969 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167ace9-f472-49bf-9027-c7a0bb5f6d25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:44.029437 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167ace9-f472-49bf-9027-c7a0bb5f6d25 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:44.078098 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:44.132828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 599/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:46:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:46:44.139388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03352cdc-10b9-4e9d-a247-afb94749949b None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:44.235694 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:44.246455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03352cdc-10b9-4e9d-a247-afb94749949b None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:44.281725 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436c54a-7c24-4d74-a836-58f43196a8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:44.282346 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436c54a-7c24-4d74-a836-58f43196a8ef None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:44.282622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436c54a-7c24-4d74-a836-58f43196a8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:44.282894 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436c54a-7c24-4d74-a836-58f43196a8ef None admin] PATH_INFO: `/v3/projects/a35ab63fa2e94cf19fe9440c6539493a` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:44.284177 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436c54a-7c24-4d74-a836-58f43196a8ef None admin] RBAC: Authorizing `identity:get_project(project_id=a35ab63fa2e94cf19fe9440c6539493a)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:44.285621 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436c54a-7c24-4d74-a836-58f43196a8ef None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:44.287274 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 600/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Aug 30 11:46:44 2022] GET /identity/v3/projects/a35ab63fa2e94cf19fe9440c6539493a => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:46:44.294166 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167ace9-f472-49bf-9027-c7a0bb5f6d25 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:46:44.401761 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167ace9-f472-49bf-9027-c7a0bb5f6d25 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:46:44.441981 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32d345-ed77-4645-95f0-b6a92ad79519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:46:44.442580 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32d345-ed77-4645-95f0-b6a92ad79519 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:46:44.442854 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32d345-ed77-4645-95f0-b6a92ad79519 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:46:44.443116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32d345-ed77-4645-95f0-b6a92ad79519 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:46:44.443857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32d345-ed77-4645-95f0-b6a92ad79519 None admin] RBAC: Adding query filter params (role.id=4f4d8a6881ca496bb2d4845a6592fea8, scope.project.id=a35ab63fa2e94cf19fe9440c6539493a, user.id=2dffbbbe972040f99bd8661d563e30b4) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:46:44.444164 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32d345-ed77-4645-95f0-b6a92ad79519 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:46:44.445580 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32d345-ed77-4645-95f0-b6a92ad79519 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:46:44.451476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 600/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:46:44 2022] GET /identity/v3/role_assignments?user.id=2dffbbbe972040f99bd8661d563e30b4&scope.project.id=a35ab63fa2e94cf19fe9440c6539493a&role.id=4f4d8a6881ca496bb2d4845a6592fea8 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:46:54.276202 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=21 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:46:54.448860 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=93 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:39.855165 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22e1f8-1549-4a28-a41b-6d6bed6070f4 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:39.855831 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22e1f8-1549-4a28-a41b-6d6bed6070f4 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:39.855831 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22e1f8-1549-4a28-a41b-6d6bed6070f4 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:39.857411 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 601/1201] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:47:39.863062 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b4f58-0091-4e4b-a86f-c6fdc61326a9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:39.863656 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b4f58-0091-4e4b-a86f-c6fdc61326a9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:39.863656 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b4f58-0091-4e4b-a86f-c6fdc61326a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:39.882615 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-123b4f58-0091-4e4b-a86f-c6fdc61326a9 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:47:39.883898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-123b4f58-0091-4e4b-a86f-c6fdc61326a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:47:39.968033 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 601/1202] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:47:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:47:40.257508 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22e1f8-1549-4a28-a41b-6d6bed6070f4 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:40.392696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22e1f8-1549-4a28-a41b-6d6bed6070f4 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:40.429994 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a60c2-f616-45de-96eb-bc7453ed2235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:40.430959 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a60c2-f616-45de-96eb-bc7453ed2235 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:40.431450 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a60c2-f616-45de-96eb-bc7453ed2235 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:40.431881 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a60c2-f616-45de-96eb-bc7453ed2235 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:40.444835 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a60c2-f616-45de-96eb-bc7453ed2235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:40.446343 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a60c2-f616-45de-96eb-bc7453ed2235 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:40.463179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-b08a60c2-f616-45de-96eb-bc7453ed2235 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:47:40.463179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:47:40.463179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:47:40.463179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:47:40.463179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:47:40.463179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:47:40.463179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:47:40.463179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:47:40.463179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:47:40.463179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:47:40.463179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:47:40.463179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:47:40.463179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:47:40.463179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:47:40.463179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:47:40.463179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:47:40.467600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:47:40.467600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:47:40.467600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:47:40.467600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:47:40.467600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:47:40.467600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:47:40.467600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:47:40.467600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:47:40.467600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:47:40.467600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:47:40.467600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:47:40.467600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:47:40.467600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:47:40.467600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:47:40.467600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:47:40.467600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:47:40.467600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:47:40.468721 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:47:40.468721 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:47:40.468721 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:47:40.468721 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 602/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:47:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:47:40.470978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b4f58-0091-4e4b-a86f-c6fdc61326a9 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:40.592889 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b4f58-0091-4e4b-a86f-c6fdc61326a9 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:40.632127 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:40.639311 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b705a30-7dda-4739-93f0-b9cbfa903d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:40.640423 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b705a30-7dda-4739-93f0-b9cbfa903d63 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:40.640885 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b705a30-7dda-4739-93f0-b9cbfa903d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:40.641310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b705a30-7dda-4739-93f0-b9cbfa903d63 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:40.642142 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b705a30-7dda-4739-93f0-b9cbfa903d63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:40.642669 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b705a30-7dda-4739-93f0-b9cbfa903d63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:40.644349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b705a30-7dda-4739-93f0-b9cbfa903d63 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:40.663326 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 602/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:47:40.664212 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a60c2-f616-45de-96eb-bc7453ed2235 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:40.730248 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:40.791736 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a60c2-f616-45de-96eb-bc7453ed2235 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:40.831014 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb618b6-c2e7-4323-b037-075bc014799a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:40.832052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb618b6-c2e7-4323-b037-075bc014799a None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:40.832332 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb618b6-c2e7-4323-b037-075bc014799a None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:40.832601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb618b6-c2e7-4323-b037-075bc014799a None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:40.833243 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb618b6-c2e7-4323-b037-075bc014799a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:40.834691 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb618b6-c2e7-4323-b037-075bc014799a None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:40.864660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 603/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Aug 30 11:47:40 2022] POST /identity/v3/users => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:47:42.959084 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5a612-8d69-475b-8649-2dfa119533c3 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:42.959711 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5a612-8d69-475b-8649-2dfa119533c3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:42.959711 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5a612-8d69-475b-8649-2dfa119533c3 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:42.961348 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 603/1206] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:47:42.967032 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27b4f5-5181-4772-8cea-965481f608c9 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:42.967604 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27b4f5-5181-4772-8cea-965481f608c9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:42.967604 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27b4f5-5181-4772-8cea-965481f608c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:42.988960 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-bd27b4f5-5181-4772-8cea-965481f608c9 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:47:42.990182 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bd27b4f5-5181-4772-8cea-965481f608c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:47:43.060666 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 604/1207] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:47:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:47:43.332742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5a612-8d69-475b-8649-2dfa119533c3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:43.452469 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5a612-8d69-475b-8649-2dfa119533c3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:43.491074 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72a7c2-7f7f-478f-9e07-78ba28301ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:43.492167 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72a7c2-7f7f-478f-9e07-78ba28301ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:43.492167 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72a7c2-7f7f-478f-9e07-78ba28301ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:43.492362 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72a7c2-7f7f-478f-9e07-78ba28301ef1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:43.505179 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72a7c2-7f7f-478f-9e07-78ba28301ef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:47:43.509975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9a72a7c2-7f7f-478f-9e07-78ba28301ef1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:47:43.509975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:47:43.509975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:47:43.509975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:47:43.509975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:47:43.509975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:47:43.509975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:47:43.509975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:47:43.509975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:47:43.509975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:47:43.509975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:47:43.509975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:47:43.509975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:47:43.509975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:47:43.509975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:47:43.509975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:47:43.510970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:47:43.510970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:47:43.510970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:47:43.510970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:47:43.510970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:47:43.510970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:47:43.510970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:47:43.510970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:47:43.510970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:47:43.510970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:47:43.510970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:47:43.510970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:47:43.510970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:47:43.510970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:47:43.510970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:47:43.510970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:47:43.516507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:47:43.516507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:47:43.516507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:47:43.516507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:47:43.516507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:47:43.516507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:47:43.516507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:47:43.516507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:47:43.516507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:47:43.516507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:47:43.516507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:47:43.516507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:47:43.516507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 604/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:47:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:47:43.517474 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27b4f5-5181-4772-8cea-965481f608c9 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:43.560279 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:43.625786 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27b4f5-5181-4772-8cea-965481f608c9 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:43.666130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d08ef9-4fb5-48c7-b12f-319a93899ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:43.666755 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d08ef9-4fb5-48c7-b12f-319a93899ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:43.667073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d08ef9-4fb5-48c7-b12f-319a93899ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:43.667410 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d08ef9-4fb5-48c7-b12f-319a93899ec9 None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:43.668094 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d08ef9-4fb5-48c7-b12f-319a93899ec9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:43.668438 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d08ef9-4fb5-48c7-b12f-319a93899ec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:43.670219 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d08ef9-4fb5-48c7-b12f-319a93899ec9 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:43.681232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 605/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Aug 30 11:47:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:47:43.686887 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72a7c2-7f7f-478f-9e07-78ba28301ef1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:43.753948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:43.813759 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72a7c2-7f7f-478f-9e07-78ba28301ef1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:43.856292 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aabf91-2b7b-49e0-8ba5-e610f33cc6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:43.857945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aabf91-2b7b-49e0-8ba5-e610f33cc6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:43.857945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aabf91-2b7b-49e0-8ba5-e610f33cc6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:43.857945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aabf91-2b7b-49e0-8ba5-e610f33cc6f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:43.870112 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aabf91-2b7b-49e0-8ba5-e610f33cc6f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:43.871668 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aabf91-2b7b-49e0-8ba5-e610f33cc6f4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:43.890069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-73aabf91-2b7b-49e0-8ba5-e610f33cc6f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:47:43.890069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:47:43.890069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:47:43.890069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:47:43.890069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:47:43.890069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:47:43.890069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:47:43.890069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:47:43.890069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:47:43.890069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:47:43.890069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:47:43.890069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:47:43.890069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:47:43.890069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:47:43.890069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:47:43.890069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:47:43.891082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:47:43.891082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:47:43.891082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:47:43.891082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:47:43.891082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:47:43.891082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:47:43.891082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:47:43.891082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:47:43.891082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:47:43.891082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:47:43.891082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:47:43.891082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:47:43.891082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:47:43.891082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:47:43.891082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:47:43.891082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:47:43.891082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:47:43.892024 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:47:43.892024 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:47:43.892024 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:47:43.892024 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 605/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:47:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:47:43.896478 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d08ef9-4fb5-48c7-b12f-319a93899ec9 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:44.000648 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:44.003837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d08ef9-4fb5-48c7-b12f-319a93899ec9 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:44.045525 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2b622-d766-4d92-9391-fcb48e4e91b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:44.046193 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2b622-d766-4d92-9391-fcb48e4e91b2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:44.047665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2b622-d766-4d92-9391-fcb48e4e91b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:44.047665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2b622-d766-4d92-9391-fcb48e4e91b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:44.047665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2b622-d766-4d92-9391-fcb48e4e91b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:44.047966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2b622-d766-4d92-9391-fcb48e4e91b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:44.049133 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2b622-d766-4d92-9391-fcb48e4e91b2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:44.061859 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 606/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:47:44.067802 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aabf91-2b7b-49e0-8ba5-e610f33cc6f4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:44.183303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aabf91-2b7b-49e0-8ba5-e610f33cc6f4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:44.185366 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:44.221695 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ca742-830f-4a3e-ba14-2378bc11efbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:44.222561 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ca742-830f-4a3e-ba14-2378bc11efbb None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:44.222929 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ca742-830f-4a3e-ba14-2378bc11efbb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:44.223292 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ca742-830f-4a3e-ba14-2378bc11efbb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:44.231911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ca742-830f-4a3e-ba14-2378bc11efbb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:44.233551 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ca742-830f-4a3e-ba14-2378bc11efbb None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:44.246659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-fa6ca742-830f-4a3e-ba14-2378bc11efbb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:47:44.246659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:47:44.246659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:47:44.246659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:47:44.246659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:47:44.246659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:47:44.246659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:47:44.246659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:47:44.246659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:47:44.246659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:47:44.246659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:47:44.246659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:47:44.246659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:47:44.246659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:47:44.246659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:47:44.246659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:47:44.247959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:47:44.247959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:47:44.247959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:47:44.247959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:47:44.247959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:47:44.247959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:47:44.247959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:47:44.247959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:47:44.247959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:47:44.247959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:47:44.247959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:47:44.247959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:47:44.247959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:47:44.247959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:47:44.247959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:47:44.247959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:47:44.247959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:47:44.247959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:47:44.249203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:47:44.249203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:47:44.249203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:47:44.249203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:47:44.249203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:47:44.249203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:47:44.249203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:47:44.249203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:47:44.249203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:47:44.249203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:47:44.250670 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 606/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:47:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:47:44.257295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2b622-d766-4d92-9391-fcb48e4e91b2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:44.369297 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2b622-d766-4d92-9391-fcb48e4e91b2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:44.407768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc0b69-9879-4a08-a8f6-0d18e6823e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:44.408467 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc0b69-9879-4a08-a8f6-0d18e6823e40 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:44.408748 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc0b69-9879-4a08-a8f6-0d18e6823e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:44.409057 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc0b69-9879-4a08-a8f6-0d18e6823e40 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:44.409790 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc0b69-9879-4a08-a8f6-0d18e6823e40 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:44.410101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc0b69-9879-4a08-a8f6-0d18e6823e40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:44.411618 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc0b69-9879-4a08-a8f6-0d18e6823e40 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:44.430473 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 607/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Aug 30 11:47:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:47:44.437145 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ca742-830f-4a3e-ba14-2378bc11efbb None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:44.560311 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ca742-830f-4a3e-ba14-2378bc11efbb None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:44.601039 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2262d-d7f9-44ee-bab8-3c53e8081668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:44.601747 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2262d-d7f9-44ee-bab8-3c53e8081668 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:44.602025 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2262d-d7f9-44ee-bab8-3c53e8081668 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:44.602325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2262d-d7f9-44ee-bab8-3c53e8081668 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:44.638607 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:44.689581 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2262d-d7f9-44ee-bab8-3c53e8081668 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:44.691273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2262d-d7f9-44ee-bab8-3c53e8081668 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:44.813548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 607/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:47:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:47:44.819279 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc0b69-9879-4a08-a8f6-0d18e6823e40 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:44.840162 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:44.931636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc0b69-9879-4a08-a8f6-0d18e6823e40 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:44.973672 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d38af-847b-4472-b34b-d3e6692f3841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:44.974236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d38af-847b-4472-b34b-d3e6692f3841 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:44.974499 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d38af-847b-4472-b34b-d3e6692f3841 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:44.974765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d38af-847b-4472-b34b-d3e6692f3841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:44.985860 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d38af-847b-4472-b34b-d3e6692f3841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:44.987330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d38af-847b-4472-b34b-d3e6692f3841 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:45.002399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-491d38af-847b-4472-b34b-d3e6692f3841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:47:45.002399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:47:45.002399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:47:45.002399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:47:45.002399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:47:45.002399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:47:45.002399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:47:45.002399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:47:45.002399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:47:45.002399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:47:45.002399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:47:45.002399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:47:45.002399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:47:45.002399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:47:45.002399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:47:45.002399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:47:45.003911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:47:45.003911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:47:45.003911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:47:45.003911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:47:45.003911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:47:45.003911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:47:45.003911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:47:45.003911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:47:45.003911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:47:45.003911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:47:45.003911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:47:45.003911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:47:45.003911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:47:45.003911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:47:45.003911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:47:45.003911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:47:45.003911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:47:45.004818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:47:45.004818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:47:45.004818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:47:45.004818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 608/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:47:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:47:45.011275 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2262d-d7f9-44ee-bab8-3c53e8081668 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:45.082446 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:45.125703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2262d-d7f9-44ee-bab8-3c53e8081668 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:45.162942 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c883e4e-5d16-4cfe-aaa5-b90257fe4edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:45.163598 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c883e4e-5d16-4cfe-aaa5-b90257fe4edf None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:45.163895 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c883e4e-5d16-4cfe-aaa5-b90257fe4edf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:45.164163 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c883e4e-5d16-4cfe-aaa5-b90257fe4edf None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:45.164830 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c883e4e-5d16-4cfe-aaa5-b90257fe4edf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:45.165104 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c883e4e-5d16-4cfe-aaa5-b90257fe4edf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:45.166702 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c883e4e-5d16-4cfe-aaa5-b90257fe4edf None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:45.184103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 608/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:47:45.185298 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d38af-847b-4472-b34b-d3e6692f3841 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:45.266286 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:45.299959 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d38af-847b-4472-b34b-d3e6692f3841 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:45.339967 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051efad-b3e8-45c5-9960-0c75b573c87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:45.340677 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051efad-b3e8-45c5-9960-0c75b573c87e None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:45.341551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051efad-b3e8-45c5-9960-0c75b573c87e None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:45.341840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051efad-b3e8-45c5-9960-0c75b573c87e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:45.350176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051efad-b3e8-45c5-9960-0c75b573c87e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:45.352013 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051efad-b3e8-45c5-9960-0c75b573c87e None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:45.368441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-c051efad-b3e8-45c5-9960-0c75b573c87e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:47:45.368441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:47:45.368441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:47:45.368441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:47:45.368441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:47:45.368441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:47:45.368441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:47:45.368441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:47:45.368441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:47:45.368441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:47:45.368441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:47:45.368441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:47:45.368441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:47:45.368441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:47:45.368441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:47:45.369464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:47:45.369464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:47:45.369464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:47:45.369464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:47:45.369464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:47:45.369464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:47:45.369464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:47:45.369464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:47:45.369464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:47:45.369464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:47:45.369464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:47:45.369464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:47:45.369464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:47:45.369464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:47:45.369464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:47:45.369464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:47:45.369464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:47:45.375497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:47:45.375497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:47:45.375497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:47:45.375497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:47:45.375497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:47:45.375497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:47:45.375497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:47:45.375497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:47:45.375497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 609/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:47:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:47:45.378946 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c883e4e-5d16-4cfe-aaa5-b90257fe4edf None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:45.496566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c883e4e-5d16-4cfe-aaa5-b90257fe4edf None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:45.522630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:45.536546 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe02bbd-0e54-4956-b80f-f938386969e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:45.537481 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe02bbd-0e54-4956-b80f-f938386969e4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:45.537940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe02bbd-0e54-4956-b80f-f938386969e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:45.538355 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe02bbd-0e54-4956-b80f-f938386969e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:45.539190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe02bbd-0e54-4956-b80f-f938386969e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:45.539655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe02bbd-0e54-4956-b80f-f938386969e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:45.541237 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe02bbd-0e54-4956-b80f-f938386969e4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:45.560199 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 609/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:47:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:47:45.562527 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051efad-b3e8-45c5-9960-0c75b573c87e None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:45.680618 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051efad-b3e8-45c5-9960-0c75b573c87e None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:45.712997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:45.719329 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f4ddf-73f6-4bcd-89aa-0df727b79dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:45.720684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f4ddf-73f6-4bcd-89aa-0df727b79dce None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:45.721026 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f4ddf-73f6-4bcd-89aa-0df727b79dce None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:45.721363 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f4ddf-73f6-4bcd-89aa-0df727b79dce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:45.722314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f4ddf-73f6-4bcd-89aa-0df727b79dce None admin] RBAC: Adding query filter params (role.id=eec5decc24ab4673a246120350336b1e, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=9efd2ac7fc4a42558e8dc48c408ce525) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:45.722747 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f4ddf-73f6-4bcd-89aa-0df727b79dce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:45.725311 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f4ddf-73f6-4bcd-89aa-0df727b79dce None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:45.732043 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 610/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:47:45 2022] GET /identity/v3/role_assignments?user.id=9efd2ac7fc4a42558e8dc48c408ce525&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=eec5decc24ab4673a246120350336b1e => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:47:47.626651 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f3aa5-1815-437f-bbd2-2d2ad716f37c None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:47.627196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f3aa5-1815-437f-bbd2-2d2ad716f37c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:47.627196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f3aa5-1815-437f-bbd2-2d2ad716f37c None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:47.628866 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 610/1220] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:47:47.634663 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7204dc-29b9-4e05-bb4c-a779eba0f050 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:47.635095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7204dc-29b9-4e05-bb4c-a779eba0f050 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:47.635269 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7204dc-29b9-4e05-bb4c-a779eba0f050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:47.655270 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-bf7204dc-29b9-4e05-bb4c-a779eba0f050 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:47:47.656568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bf7204dc-29b9-4e05-bb4c-a779eba0f050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:47:47.737961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 611/1221] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:47:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:47:48.014754 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f3aa5-1815-437f-bbd2-2d2ad716f37c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:48.147095 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f3aa5-1815-437f-bbd2-2d2ad716f37c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:48.190062 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb57376-b5f7-41f5-ab9a-879ffd67bee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:48.190710 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb57376-b5f7-41f5-ab9a-879ffd67bee4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:48.190985 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb57376-b5f7-41f5-ab9a-879ffd67bee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:48.191253 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb57376-b5f7-41f5-ab9a-879ffd67bee4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:48.201393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb57376-b5f7-41f5-ab9a-879ffd67bee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:47:48.206527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4eb57376-b5f7-41f5-ab9a-879ffd67bee4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:47:48.206527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:47:48.206527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:47:48.206527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:47:48.206527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:47:48.206527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:47:48.206527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:47:48.206527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:47:48.206527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:47:48.206527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:47:48.206527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:47:48.206527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:47:48.206527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:47:48.206527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:47:48.206527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:47:48.206527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:47:48.207685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:47:48.207685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:47:48.207685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:47:48.207685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:47:48.207685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:47:48.207685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:47:48.207685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:47:48.207685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:47:48.207685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:47:48.207685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:47:48.207685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:47:48.207685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:47:48.207685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:47:48.207685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:47:48.207685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:47:48.207685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:47:48.208742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:47:48.208742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:47:48.208742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:47:48.208742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:47:48.208742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:47:48.208742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:47:48.208742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:47:48.208742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:47:48.208742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:47:48.208742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:47:48.208742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:47:48.208742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:47:48.212759 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 611/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:47:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:47:48.214026 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7204dc-29b9-4e05-bb4c-a779eba0f050 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:48.325163 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7204dc-29b9-4e05-bb4c-a779eba0f050 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:48.352830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:48.365276 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712e1b3-0db6-45d8-b8f5-4834baf27ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:48.365895 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712e1b3-0db6-45d8-b8f5-4834baf27ffd None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:48.366168 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712e1b3-0db6-45d8-b8f5-4834baf27ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:48.366434 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712e1b3-0db6-45d8-b8f5-4834baf27ffd None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:48.367094 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712e1b3-0db6-45d8-b8f5-4834baf27ffd None admin] RBAC: Adding query filter params (name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:48.367413 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712e1b3-0db6-45d8-b8f5-4834baf27ffd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:48.368796 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712e1b3-0db6-45d8-b8f5-4834baf27ffd None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:48.377601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 612/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Aug 30 11:47:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:47:48.384407 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb57376-b5f7-41f5-ab9a-879ffd67bee4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:48.431715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:48.509815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb57376-b5f7-41f5-ab9a-879ffd67bee4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:48.550063 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba993f-fe1d-4849-a5c7-d6a6532bfa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:48.550701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba993f-fe1d-4849-a5c7-d6a6532bfa17 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:48.551006 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba993f-fe1d-4849-a5c7-d6a6532bfa17 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:48.551289 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba993f-fe1d-4849-a5c7-d6a6532bfa17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:48.561930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba993f-fe1d-4849-a5c7-d6a6532bfa17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:48.563408 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba993f-fe1d-4849-a5c7-d6a6532bfa17 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:48.585076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ebba993f-fe1d-4849-a5c7-d6a6532bfa17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:47:48.585076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:47:48.585076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:47:48.585076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:47:48.585076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:47:48.585076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:47:48.585076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:47:48.585076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:47:48.585076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:47:48.585076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:47:48.585076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:47:48.585076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:47:48.585076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:47:48.585076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:47:48.585076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:47:48.585076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:47:48.586250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:47:48.586250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:47:48.586250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:47:48.586250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:47:48.586250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:47:48.586250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:47:48.586250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:47:48.586250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:47:48.586250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:47:48.586250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:47:48.586250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:47:48.586250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:47:48.586250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:47:48.586250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:47:48.586250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:47:48.586250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:47:48.586250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:47:48.587156 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:47:48.587156 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:47:48.587156 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:47:48.587156 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 612/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:47:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:47:48.592586 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712e1b3-0db6-45d8-b8f5-4834baf27ffd None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:48.703418 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712e1b3-0db6-45d8-b8f5-4834baf27ffd None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:48.737880 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5de99d-1289-47e4-85ff-f66b7906b270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:48.738487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de99d-1289-47e4-85ff-f66b7906b270 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:48.738763 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de99d-1289-47e4-85ff-f66b7906b270 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:48.739018 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de99d-1289-47e4-85ff-f66b7906b270 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:48.739696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5de99d-1289-47e4-85ff-f66b7906b270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:48.739995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5de99d-1289-47e4-85ff-f66b7906b270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:48.741379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5de99d-1289-47e4-85ff-f66b7906b270 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:48.753325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 613/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:47:48.760294 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba993f-fe1d-4849-a5c7-d6a6532bfa17 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:48.871546 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:48.879310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba993f-fe1d-4849-a5c7-d6a6532bfa17 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:48.923516 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab596dae-336f-469e-a1ce-dc3787ae184d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:48.924350 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab596dae-336f-469e-a1ce-dc3787ae184d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:48.924828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab596dae-336f-469e-a1ce-dc3787ae184d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:48.925119 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab596dae-336f-469e-a1ce-dc3787ae184d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:48.934306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab596dae-336f-469e-a1ce-dc3787ae184d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:48.935933 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab596dae-336f-469e-a1ce-dc3787ae184d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:48.949255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ab596dae-336f-469e-a1ce-dc3787ae184d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:47:48.949255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:47:48.949255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:47:48.949255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:47:48.949255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:47:48.949255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:47:48.949255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:47:48.949255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:47:48.949255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:47:48.949255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:47:48.949255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:47:48.949255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:47:48.949255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:47:48.949255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:47:48.949255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:47:48.949255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:47:48.950467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:47:48.950467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:47:48.950467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:47:48.950467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:47:48.950467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:47:48.950467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:47:48.950467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:47:48.950467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:47:48.950467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:47:48.950467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:47:48.950467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:47:48.950467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:47:48.950467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:47:48.950467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:47:48.950467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:47:48.950467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:47:48.950467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:47:48.950467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:47:48.951590 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:47:48.951590 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:47:48.951590 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:47:48.951590 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:47:48.951590 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:47:48.951590 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:47:48.951590 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:47:48.951590 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:47:48.951590 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:47:48.951590 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:47:48.951590 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 613/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:47:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:47:48.959655 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5de99d-1289-47e4-85ff-f66b7906b270 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:49.017738 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:49.092135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5de99d-1289-47e4-85ff-f66b7906b270 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:49.142701 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18dd76-ab83-43dc-ac01-415f1b01dc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:49.143690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18dd76-ab83-43dc-ac01-415f1b01dc84 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:49.143931 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18dd76-ab83-43dc-ac01-415f1b01dc84 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:49.144263 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18dd76-ab83-43dc-ac01-415f1b01dc84 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:49.145099 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18dd76-ab83-43dc-ac01-415f1b01dc84 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:49.145542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18dd76-ab83-43dc-ac01-415f1b01dc84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:49.147190 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18dd76-ab83-43dc-ac01-415f1b01dc84 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:49.170056 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 614/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Aug 30 11:47:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:47:49.177346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab596dae-336f-469e-a1ce-dc3787ae184d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:49.307409 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab596dae-336f-469e-a1ce-dc3787ae184d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:49.349990 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d300a-6fa3-43b0-985f-24bb564464ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:49.350628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d300a-6fa3-43b0-985f-24bb564464ac None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:49.350901 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d300a-6fa3-43b0-985f-24bb564464ac None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:49.351164 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d300a-6fa3-43b0-985f-24bb564464ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:49.363902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d300a-6fa3-43b0-985f-24bb564464ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:49.365345 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d300a-6fa3-43b0-985f-24bb564464ac None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:49.382513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-2a5d300a-6fa3-43b0-985f-24bb564464ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:47:49.382513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:47:49.382513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:47:49.382513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:47:49.382513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:47:49.382513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:47:49.382513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:47:49.382513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:47:49.382513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:47:49.382513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:47:49.382513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:47:49.382513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:47:49.382513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:47:49.382513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:47:49.382513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:47:49.382513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:47:49.383749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:47:49.383749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:47:49.383749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:47:49.383749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:47:49.383749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:47:49.383749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:47:49.383749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:47:49.383749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:47:49.383749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:47:49.383749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:47:49.383749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:47:49.383749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:47:49.383749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:47:49.383749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:47:49.383749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:47:49.383749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:47:49.383749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:47:49.385025 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:47:49.385025 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:47:49.385025 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:47:49.386832 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 614/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:47:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:47:49.393904 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18dd76-ab83-43dc-ac01-415f1b01dc84 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:49.522409 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18dd76-ab83-43dc-ac01-415f1b01dc84 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:49.525402 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:49.563672 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d89a5c-7e8a-4447-b289-f756d5ae02c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:49.564354 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d89a5c-7e8a-4447-b289-f756d5ae02c2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:49.564600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d89a5c-7e8a-4447-b289-f756d5ae02c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:49.564867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d89a5c-7e8a-4447-b289-f756d5ae02c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:49.565502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d89a5c-7e8a-4447-b289-f756d5ae02c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:49.565799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d89a5c-7e8a-4447-b289-f756d5ae02c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:49.567194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d89a5c-7e8a-4447-b289-f756d5ae02c2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:49.578913 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 615/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:47:49.585161 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d300a-6fa3-43b0-985f-24bb564464ac None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:49.595002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:49.692633 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d300a-6fa3-43b0-985f-24bb564464ac None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:49.732736 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87640cf6-ff15-43f5-af1b-5bd9f741f434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:49.733395 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87640cf6-ff15-43f5-af1b-5bd9f741f434 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:49.733671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87640cf6-ff15-43f5-af1b-5bd9f741f434 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:49.733937 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87640cf6-ff15-43f5-af1b-5bd9f741f434 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:49.741088 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87640cf6-ff15-43f5-af1b-5bd9f741f434 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:49.742709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87640cf6-ff15-43f5-af1b-5bd9f741f434 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:49.755190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-87640cf6-ff15-43f5-af1b-5bd9f741f434 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:47:49.755190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:47:49.755190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:47:49.755190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:47:49.755190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:47:49.755190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:47:49.755190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:47:49.755190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:47:49.755190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:47:49.755190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:47:49.755190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:47:49.755190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:47:49.755190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:47:49.755190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:47:49.755190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:47:49.756270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:47:49.756270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:47:49.756270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:47:49.756270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:47:49.756270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:47:49.756270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:47:49.756270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:47:49.756270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:47:49.756270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:47:49.756270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:47:49.756270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:47:49.756270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:47:49.756270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:47:49.756270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:47:49.756270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:47:49.756270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:47:49.756270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:47:49.757477 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:47:49.757477 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:47:49.757477 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:47:49.757477 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:47:49.757477 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:47:49.757477 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:47:49.757477 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:47:49.757477 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:47:49.757477 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 615/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:47:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:47:49.763132 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d89a5c-7e8a-4447-b289-f756d5ae02c2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:49.871894 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d89a5c-7e8a-4447-b289-f756d5ae02c2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:49.910948 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6eeb6-bd6a-49dc-a982-526e84f031fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:49.911715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6eeb6-bd6a-49dc-a982-526e84f031fa None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:49.911946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6eeb6-bd6a-49dc-a982-526e84f031fa None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:49.912252 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6eeb6-bd6a-49dc-a982-526e84f031fa None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:49.913026 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6eeb6-bd6a-49dc-a982-526e84f031fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:49.913370 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6eeb6-bd6a-49dc-a982-526e84f031fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:49.914895 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6eeb6-bd6a-49dc-a982-526e84f031fa None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:49.928255 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 616/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:47:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:47:49.935012 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87640cf6-ff15-43f5-af1b-5bd9f741f434 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:50.009727 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:50.051303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87640cf6-ff15-43f5-af1b-5bd9f741f434 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:50.088122 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3aa742-dfa5-42e9-b346-205068ca8829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:50.088854 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3aa742-dfa5-42e9-b346-205068ca8829 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:50.089157 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3aa742-dfa5-42e9-b346-205068ca8829 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:50.089405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3aa742-dfa5-42e9-b346-205068ca8829 None admin] PATH_INFO: `/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/9efd2ac7fc4a42558e8dc48c408ce525/roles/eec5decc24ab4673a246120350336b1e` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:50.105629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3aa742-dfa5-42e9-b346-205068ca8829 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba4dff9d637c4afcadfd3cd92b065a41, user_id=9efd2ac7fc4a42558e8dc48c408ce525, role_id=eec5decc24ab4673a246120350336b1e)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:50.107421 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3aa742-dfa5-42e9-b346-205068ca8829 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:50.122146 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 616/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:47:49 2022] PUT /identity/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/9efd2ac7fc4a42558e8dc48c408ce525/roles/eec5decc24ab4673a246120350336b1e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:47:52.038167 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b1ea6-dfc4-4912-ad25-52fd49ee7246 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:52.038751 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b1ea6-dfc4-4912-ad25-52fd49ee7246 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:52.038751 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b1ea6-dfc4-4912-ad25-52fd49ee7246 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:52.040091 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 617/1233] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:47:52.045432 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced81c6-72e3-49e8-ace8-ba6b78624abf None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:52.045885 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced81c6-72e3-49e8-ace8-ba6b78624abf None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:52.045986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced81c6-72e3-49e8-ace8-ba6b78624abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:52.065771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-aced81c6-72e3-49e8-ace8-ba6b78624abf None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:47:52.067198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-aced81c6-72e3-49e8-ace8-ba6b78624abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:47:52.148961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 617/1234] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:47:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:47:52.417074 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b1ea6-dfc4-4912-ad25-52fd49ee7246 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:52.442914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:52.535785 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b1ea6-dfc4-4912-ad25-52fd49ee7246 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:52.574639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145d826-61c4-4f0b-9e76-0f1df791c035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:52.575387 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145d826-61c4-4f0b-9e76-0f1df791c035 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:52.575680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145d826-61c4-4f0b-9e76-0f1df791c035 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:52.575949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145d826-61c4-4f0b-9e76-0f1df791c035 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:52.589254 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145d826-61c4-4f0b-9e76-0f1df791c035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:47:52.594355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-6145d826-61c4-4f0b-9e76-0f1df791c035 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:47:52.594355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:47:52.594355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:47:52.594355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:47:52.594355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:47:52.594355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:47:52.594355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:47:52.594355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:47:52.594355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:47:52.594355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:47:52.594355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:47:52.594355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:47:52.594355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:47:52.594355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:47:52.594355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:47:52.594355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:47:52.595555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:47:52.595555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:47:52.595555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:47:52.595555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:47:52.595555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:47:52.595555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:47:52.595555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:47:52.595555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:47:52.595555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:47:52.595555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:47:52.595555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:47:52.595555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:47:52.595555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:47:52.595555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:47:52.595555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:47:52.595555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:47:52.596398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:47:52.596398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:47:52.596398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:47:52.596398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:47:52.596398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:47:52.596398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:47:52.596398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:47:52.596398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:47:52.596398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:47:52.596398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:47:52.596398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 11:47:52.596398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:47:52.596398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 618/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Aug 30 11:47:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:47:52.601894 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced81c6-72e3-49e8-ace8-ba6b78624abf None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:52.651430 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:52.708094 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced81c6-72e3-49e8-ace8-ba6b78624abf None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:52.743122 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15432a93-16e6-4f60-addf-ee90d9ca2bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:52.743775 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15432a93-16e6-4f60-addf-ee90d9ca2bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:52.744039 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15432a93-16e6-4f60-addf-ee90d9ca2bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:52.744309 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15432a93-16e6-4f60-addf-ee90d9ca2bc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:52.744965 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15432a93-16e6-4f60-addf-ee90d9ca2bc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:52.745264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15432a93-16e6-4f60-addf-ee90d9ca2bc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:52.746793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15432a93-16e6-4f60-addf-ee90d9ca2bc6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:52.755123 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 618/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Aug 30 11:47:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:47:52.761069 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145d826-61c4-4f0b-9e76-0f1df791c035 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:52.856035 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:52.873185 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145d826-61c4-4f0b-9e76-0f1df791c035 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:52.910714 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ca26f-e956-47a6-bee1-9b80ed884302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:52.911374 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ca26f-e956-47a6-bee1-9b80ed884302 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:52.911653 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ca26f-e956-47a6-bee1-9b80ed884302 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:52.911923 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ca26f-e956-47a6-bee1-9b80ed884302 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:52.922734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ca26f-e956-47a6-bee1-9b80ed884302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:52.924265 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ca26f-e956-47a6-bee1-9b80ed884302 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:52.939319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-776ca26f-e956-47a6-bee1-9b80ed884302 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:47:52.939319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:47:52.939319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:47:52.939319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:47:52.939319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:47:52.939319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:47:52.939319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:47:52.939319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:47:52.939319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:47:52.939319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:47:52.939319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:47:52.939319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:47:52.939319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:47:52.939319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:47:52.939319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:47:52.939319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:47:52.940529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:47:52.940529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:47:52.940529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:47:52.940529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:47:52.940529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:47:52.940529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:47:52.940529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:47:52.940529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:47:52.940529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:47:52.940529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:47:52.940529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:47:52.940529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:47:52.940529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:47:52.940529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:47:52.940529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:47:52.940529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:47:52.940529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:47:52.941439 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:47:52.941439 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:47:52.941439 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:47:52.941439 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 619/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:47:52.946552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15432a93-16e6-4f60-addf-ee90d9ca2bc6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:53.057203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15432a93-16e6-4f60-addf-ee90d9ca2bc6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:53.071809 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:53.098015 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a183e-5b5a-4bc9-aca2-65dcc05f612f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:53.098640 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a183e-5b5a-4bc9-aca2-65dcc05f612f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:53.098922 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a183e-5b5a-4bc9-aca2-65dcc05f612f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:53.099196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a183e-5b5a-4bc9-aca2-65dcc05f612f None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:53.099869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a183e-5b5a-4bc9-aca2-65dcc05f612f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:53.100203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a183e-5b5a-4bc9-aca2-65dcc05f612f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:53.101556 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a183e-5b5a-4bc9-aca2-65dcc05f612f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:53.115619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 619/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:47:53.121890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ca26f-e956-47a6-bee1-9b80ed884302 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:53.229770 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ca26f-e956-47a6-bee1-9b80ed884302 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:53.264632 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66a092-0592-4261-a72f-cd21ea6b6cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:53.265406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66a092-0592-4261-a72f-cd21ea6b6cba None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:53.265723 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66a092-0592-4261-a72f-cd21ea6b6cba None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:53.266000 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66a092-0592-4261-a72f-cd21ea6b6cba None admin] PATH_INFO: `/v3/users/placement` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:53.269539 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:53.276035 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66a092-0592-4261-a72f-cd21ea6b6cba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:53.278121 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66a092-0592-4261-a72f-cd21ea6b6cba None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:53.290095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-dd66a092-0592-4261-a72f-cd21ea6b6cba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:47:53.290095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:47:53.290095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:47:53.290095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:47:53.290095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:47:53.290095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:47:53.290095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:47:53.290095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:47:53.290095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:47:53.290095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:47:53.290095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:47:53.290095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:47:53.290095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:47:53.290095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:47:53.290095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:47:53.290095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:47:53.291331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:47:53.291331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:47:53.291331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:47:53.291331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:47:53.291331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:47:53.291331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:47:53.291331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:47:53.291331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:47:53.291331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:47:53.291331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:47:53.291331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:47:53.291331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:47:53.291331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:47:53.291331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:47:53.291331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:47:53.291331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:47:53.291331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:47:53.291331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:47:53.295889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:47:53.295889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:47:53.295889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:47:53.295889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:47:53.295889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:47:53.295889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:47:53.295889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:47:53.295889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:47:53.295889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:47:53.295889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:47:53.295889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 620/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:47:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:47:53.299132 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a183e-5b5a-4bc9-aca2-65dcc05f612f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:53.413755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a183e-5b5a-4bc9-aca2-65dcc05f612f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:53.451567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1df617-e8c6-4075-8c71-9e74a4674f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:53.452288 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1df617-e8c6-4075-8c71-9e74a4674f94 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:53.452594 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1df617-e8c6-4075-8c71-9e74a4674f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:53.452866 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1df617-e8c6-4075-8c71-9e74a4674f94 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:53.454066 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1df617-e8c6-4075-8c71-9e74a4674f94 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:53.454414 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1df617-e8c6-4075-8c71-9e74a4674f94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:53.456079 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1df617-e8c6-4075-8c71-9e74a4674f94 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:53.475238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 620/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Aug 30 11:47:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:47:53.481573 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66a092-0592-4261-a72f-cd21ea6b6cba None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:53.614842 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66a092-0592-4261-a72f-cd21ea6b6cba None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:53.653175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b689d2c-d797-46a3-bbcf-ef76beb31c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:53.653798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b689d2c-d797-46a3-bbcf-ef76beb31c28 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:53.654095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b689d2c-d797-46a3-bbcf-ef76beb31c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:53.654335 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b689d2c-d797-46a3-bbcf-ef76beb31c28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:53.718153 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:53.725060 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b689d2c-d797-46a3-bbcf-ef76beb31c28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:53.726549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b689d2c-d797-46a3-bbcf-ef76beb31c28 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:53.836211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 621/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:47:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:47:53.843220 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1df617-e8c6-4075-8c71-9e74a4674f94 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:53.871826 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:53.957367 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1df617-e8c6-4075-8c71-9e74a4674f94 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:53.995008 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf5d26-d01b-4ca1-9303-df982d0a898c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:53.995646 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf5d26-d01b-4ca1-9303-df982d0a898c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:53.995950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf5d26-d01b-4ca1-9303-df982d0a898c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:53.996368 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf5d26-d01b-4ca1-9303-df982d0a898c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:54.009396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf5d26-d01b-4ca1-9303-df982d0a898c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:54.011093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf5d26-d01b-4ca1-9303-df982d0a898c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:54.029229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-e4cf5d26-d01b-4ca1-9303-df982d0a898c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:47:54.029229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:47:54.029229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:47:54.029229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:47:54.029229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:47:54.029229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:47:54.029229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:47:54.029229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:47:54.029229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:47:54.029229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:47:54.029229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:47:54.029229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:47:54.029229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:47:54.029229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:47:54.029229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:47:54.029229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:47:54.030456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:47:54.030456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:47:54.030456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:47:54.030456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:47:54.030456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:47:54.030456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:47:54.030456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:47:54.030456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:47:54.030456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:47:54.030456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:47:54.030456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:47:54.030456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:47:54.030456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:47:54.030456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:47:54.030456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:47:54.030456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:47:54.030456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:47:54.031647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:47:54.031647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:47:54.031647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:47:54.031647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 621/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:47:54.037070 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b689d2c-d797-46a3-bbcf-ef76beb31c28 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:54.149123 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:54.156192 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b689d2c-d797-46a3-bbcf-ef76beb31c28 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:54.193214 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1069c-f88f-430e-a3e0-56115f5f8767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:54.193824 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1069c-f88f-430e-a3e0-56115f5f8767 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:54.194105 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1069c-f88f-430e-a3e0-56115f5f8767 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:54.194372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1069c-f88f-430e-a3e0-56115f5f8767 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:54.195293 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1069c-f88f-430e-a3e0-56115f5f8767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:54.195653 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1069c-f88f-430e-a3e0-56115f5f8767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:54.197803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1069c-f88f-430e-a3e0-56115f5f8767 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:54.217364 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 622/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:47:54.218727 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf5d26-d01b-4ca1-9303-df982d0a898c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:54.306467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:54.331410 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf5d26-d01b-4ca1-9303-df982d0a898c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:54.375219 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3914c-32a7-4c4a-97c6-b9a3d7e931c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:54.375897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3914c-32a7-4c4a-97c6-b9a3d7e931c5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:54.376161 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3914c-32a7-4c4a-97c6-b9a3d7e931c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:54.376436 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3914c-32a7-4c4a-97c6-b9a3d7e931c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:54.383649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3914c-32a7-4c4a-97c6-b9a3d7e931c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:54.385116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3914c-32a7-4c4a-97c6-b9a3d7e931c5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:54.397863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-a5f3914c-32a7-4c4a-97c6-b9a3d7e931c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:47:54.397863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:47:54.397863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:47:54.397863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:47:54.397863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:47:54.397863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:47:54.397863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:47:54.397863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:47:54.397863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:47:54.397863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:47:54.397863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:47:54.397863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:47:54.397863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:47:54.397863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:47:54.397863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:47:54.398954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:47:54.398954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:47:54.398954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:47:54.398954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:47:54.398954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:47:54.398954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:47:54.398954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:47:54.398954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:47:54.398954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:47:54.398954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:47:54.398954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:47:54.398954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:47:54.398954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:47:54.398954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:47:54.398954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:47:54.398954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:47:54.398954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:47:54.399952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:47:54.399952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:47:54.399952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:47:54.399952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:47:54.399952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:47:54.399952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:47:54.399952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:47:54.399952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:47:54.399952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 622/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:47:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:47:54.405093 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1069c-f88f-430e-a3e0-56115f5f8767 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:54.529991 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1069c-f88f-430e-a3e0-56115f5f8767 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:54.574900 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a3c43-0e8d-4644-a63b-b38b41eeeccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:54.575624 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a3c43-0e8d-4644-a63b-b38b41eeeccb None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:54.575907 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a3c43-0e8d-4644-a63b-b38b41eeeccb None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:54.576201 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a3c43-0e8d-4644-a63b-b38b41eeeccb None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:54.577151 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a3c43-0e8d-4644-a63b-b38b41eeeccb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:54.577395 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a3c43-0e8d-4644-a63b-b38b41eeeccb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:54.579625 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a3c43-0e8d-4644-a63b-b38b41eeeccb None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:54.594666 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 623/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:47:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:47:54.602873 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3914c-32a7-4c4a-97c6-b9a3d7e931c5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:54.720364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3914c-32a7-4c4a-97c6-b9a3d7e931c5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:54.756798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bfd0c-16b7-474b-b55b-9a8cde1c4381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:54.757557 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bfd0c-16b7-474b-b55b-9a8cde1c4381 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:54.757941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bfd0c-16b7-474b-b55b-9a8cde1c4381 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:54.758284 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bfd0c-16b7-474b-b55b-9a8cde1c4381 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:54.759187 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bfd0c-16b7-474b-b55b-9a8cde1c4381 None admin] RBAC: Adding query filter params (role.id=eec5decc24ab4673a246120350336b1e, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=9efd2ac7fc4a42558e8dc48c408ce525) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:54.759693 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bfd0c-16b7-474b-b55b-9a8cde1c4381 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:54.761951 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bfd0c-16b7-474b-b55b-9a8cde1c4381 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:54.769400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 623/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:47:54 2022] GET /identity/v3/role_assignments?user.id=9efd2ac7fc4a42558e8dc48c408ce525&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=eec5decc24ab4673a246120350336b1e => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:47:56.882538 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac057d4a-92c4-4689-8c56-273e6a4ddd13 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:56.883154 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac057d4a-92c4-4689-8c56-273e6a4ddd13 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:56.883154 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac057d4a-92c4-4689-8c56-273e6a4ddd13 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:56.885005 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 624/1247] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:47:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:47:56.890573 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04edad-38d8-4d00-85dd-c5f1b83aa96a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:56.891031 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04edad-38d8-4d00-85dd-c5f1b83aa96a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:56.891174 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04edad-38d8-4d00-85dd-c5f1b83aa96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:56.898601 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:56.913156 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8e04edad-38d8-4d00-85dd-c5f1b83aa96a None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:47:56.914609 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8e04edad-38d8-4d00-85dd-c5f1b83aa96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:47:56.988631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 624/1248] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:47:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:47:57.257142 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac057d4a-92c4-4689-8c56-273e6a4ddd13 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:57.278078 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:57.368324 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac057d4a-92c4-4689-8c56-273e6a4ddd13 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:57.408701 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb90ed-b6cc-4fa0-a0f3-9a045351d911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:57.409780 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb90ed-b6cc-4fa0-a0f3-9a045351d911 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:57.410067 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb90ed-b6cc-4fa0-a0f3-9a045351d911 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:57.410335 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb90ed-b6cc-4fa0-a0f3-9a045351d911 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:57.424726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb90ed-b6cc-4fa0-a0f3-9a045351d911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:47:57.430756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-1acb90ed-b6cc-4fa0-a0f3-9a045351d911 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:47:57.430756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:47:57.430756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:47:57.430756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:47:57.430756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:47:57.430756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:47:57.430756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:47:57.430756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:47:57.430756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:47:57.430756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:47:57.430756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:47:57.430756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:47:57.430756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:47:57.430756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:47:57.430756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:47:57.430756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:47:57.431995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:47:57.431995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:47:57.431995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:47:57.431995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:47:57.431995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:47:57.431995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:47:57.431995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:47:57.431995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:47:57.431995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:47:57.431995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:47:57.431995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:47:57.431995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:47:57.431995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:47:57.431995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:47:57.431995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:47:57.431995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:47:57.433170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:47:57.433170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:47:57.433170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:47:57.433170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:47:57.433170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:47:57.433170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:47:57.433170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:47:57.433170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:47:57.433170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:47:57.433170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:47:57.433170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:47:57.433170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:47:57.433170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 625/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:47:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:47:57.438620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04edad-38d8-4d00-85dd-c5f1b83aa96a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:57.564855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04edad-38d8-4d00-85dd-c5f1b83aa96a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:57.599715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:57.605851 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5e35f-bef2-4936-b5c0-a8b260e451dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:57.606475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5e35f-bef2-4936-b5c0-a8b260e451dc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:57.606755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5e35f-bef2-4936-b5c0-a8b260e451dc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:57.607032 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5e35f-bef2-4936-b5c0-a8b260e451dc None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:57.607808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5e35f-bef2-4936-b5c0-a8b260e451dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:57.608112 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5e35f-bef2-4936-b5c0-a8b260e451dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:57.609495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5e35f-bef2-4936-b5c0-a8b260e451dc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:57.624553 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 625/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:47:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:47:57.625806 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb90ed-b6cc-4fa0-a0f3-9a045351d911 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:57.720209 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:57.745479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb90ed-b6cc-4fa0-a0f3-9a045351d911 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:57.782297 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46372b6-a546-4fc9-a684-51f5bbd3f533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:57.782959 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46372b6-a546-4fc9-a684-51f5bbd3f533 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:57.783235 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46372b6-a546-4fc9-a684-51f5bbd3f533 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:57.783537 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46372b6-a546-4fc9-a684-51f5bbd3f533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:57.794076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46372b6-a546-4fc9-a684-51f5bbd3f533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:57.795570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46372b6-a546-4fc9-a684-51f5bbd3f533 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:57.810444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-d46372b6-a546-4fc9-a684-51f5bbd3f533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:47:57.810444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:47:57.810444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:47:57.810444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:47:57.810444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:47:57.810444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:47:57.810444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:47:57.810444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:47:57.810444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:47:57.810444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:47:57.810444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:47:57.810444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:47:57.810444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:47:57.810444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:47:57.810444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:47:57.810444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:47:57.811761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:47:57.811761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:47:57.811761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:47:57.811761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:47:57.811761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:47:57.811761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:47:57.811761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:47:57.811761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:47:57.811761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:47:57.811761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:47:57.811761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:47:57.811761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:47:57.811761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:47:57.811761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:47:57.811761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:47:57.811761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:47:57.811761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:47:57.812846 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:47:57.812846 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:47:57.812846 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:47:57.812846 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 626/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:47:57.817799 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5e35f-bef2-4936-b5c0-a8b260e451dc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:57.938207 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5e35f-bef2-4936-b5c0-a8b260e451dc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:57.972174 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065255e-4fdb-4e55-8cf6-807201df6961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:57.972787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065255e-4fdb-4e55-8cf6-807201df6961 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:57.973064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065255e-4fdb-4e55-8cf6-807201df6961 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:57.973358 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065255e-4fdb-4e55-8cf6-807201df6961 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:57.973993 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065255e-4fdb-4e55-8cf6-807201df6961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:57.974291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065255e-4fdb-4e55-8cf6-807201df6961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:57.975649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065255e-4fdb-4e55-8cf6-807201df6961 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:57.988346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 626/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:47:57.994319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46372b6-a546-4fc9-a684-51f5bbd3f533 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:58.106975 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46372b6-a546-4fc9-a684-51f5bbd3f533 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:58.135966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:58.147067 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38d9ee-6396-405a-a758-4f1f52049862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:58.147829 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38d9ee-6396-405a-a758-4f1f52049862 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:58.148139 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38d9ee-6396-405a-a758-4f1f52049862 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:58.148372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38d9ee-6396-405a-a758-4f1f52049862 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:58.156301 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38d9ee-6396-405a-a758-4f1f52049862 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:58.157769 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38d9ee-6396-405a-a758-4f1f52049862 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:58.169432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-7d38d9ee-6396-405a-a758-4f1f52049862 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:47:58.169432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:47:58.169432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:47:58.169432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:47:58.169432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:47:58.169432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:47:58.169432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:47:58.169432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:47:58.169432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:47:58.169432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:47:58.169432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:47:58.169432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:47:58.169432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:47:58.169432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:47:58.169432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:47:58.169432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:47:58.171196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:47:58.171196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:47:58.171196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:47:58.171196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:47:58.171196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:47:58.171196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:47:58.171196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:47:58.171196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:47:58.171196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:47:58.171196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:47:58.171196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:47:58.171196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:47:58.171196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:47:58.171196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:47:58.171196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:47:58.171196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:47:58.171196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:47:58.171196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:47:58.172489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:47:58.172489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:47:58.172489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:47:58.172489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:47:58.172489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:47:58.172489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:47:58.172489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:47:58.172489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:47:58.172489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:47:58.172489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:47:58.172489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 627/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:47:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:47:58.176870 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065255e-4fdb-4e55-8cf6-807201df6961 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:58.234170 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:58.284001 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065255e-4fdb-4e55-8cf6-807201df6961 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:58.324511 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300cb0e-a5bf-4df8-b42d-98823ff8ac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:58.325178 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300cb0e-a5bf-4df8-b42d-98823ff8ac21 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:58.325467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300cb0e-a5bf-4df8-b42d-98823ff8ac21 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:58.325742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300cb0e-a5bf-4df8-b42d-98823ff8ac21 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:58.326471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300cb0e-a5bf-4df8-b42d-98823ff8ac21 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:58.326745 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300cb0e-a5bf-4df8-b42d-98823ff8ac21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:58.328203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300cb0e-a5bf-4df8-b42d-98823ff8ac21 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:58.347951 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 627/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Aug 30 11:47:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:47:58.354366 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38d9ee-6396-405a-a758-4f1f52049862 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:58.479262 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38d9ee-6396-405a-a758-4f1f52049862 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:58.526547 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781d09b-202d-4ae9-b3b0-3ad84e5bddf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:58.527249 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781d09b-202d-4ae9-b3b0-3ad84e5bddf4 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:58.527562 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781d09b-202d-4ae9-b3b0-3ad84e5bddf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:58.527883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781d09b-202d-4ae9-b3b0-3ad84e5bddf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:58.595312 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:58.612091 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781d09b-202d-4ae9-b3b0-3ad84e5bddf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:58.613892 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781d09b-202d-4ae9-b3b0-3ad84e5bddf4 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:58.718875 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 628/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:47:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:47:58.724853 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300cb0e-a5bf-4df8-b42d-98823ff8ac21 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:58.825942 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300cb0e-a5bf-4df8-b42d-98823ff8ac21 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:58.842849 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:58.866754 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d70b4-fa4b-41dc-9ec8-7481f06acdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:58.867424 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d70b4-fa4b-41dc-9ec8-7481f06acdd5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:58.867701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d70b4-fa4b-41dc-9ec8-7481f06acdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:58.868056 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d70b4-fa4b-41dc-9ec8-7481f06acdd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:58.879072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d70b4-fa4b-41dc-9ec8-7481f06acdd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:58.880740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d70b4-fa4b-41dc-9ec8-7481f06acdd5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:58.897296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-c42d70b4-fa4b-41dc-9ec8-7481f06acdd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:47:58.897296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:47:58.897296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:47:58.897296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:47:58.897296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:47:58.897296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:47:58.897296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:47:58.897296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:47:58.897296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:47:58.897296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:47:58.897296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:47:58.897296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:47:58.897296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:47:58.897296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:47:58.897296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:47:58.897296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:47:58.900017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:47:58.900017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:47:58.900017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:47:58.900017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:47:58.900017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:47:58.900017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:47:58.900017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:47:58.900017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:47:58.900017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:47:58.900017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:47:58.900017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:47:58.900017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:47:58.900017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:47:58.900017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:47:58.900017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:47:58.900017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:47:58.900017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:47:58.900913 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:47:58.900913 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:47:58.900913 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:47:58.900913 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 628/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:47:58.904377 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781d09b-202d-4ae9-b3b0-3ad84e5bddf4 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:59.007986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:59.022047 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781d09b-202d-4ae9-b3b0-3ad84e5bddf4 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:59.059782 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fe9ce-7d9f-4e68-9d7a-cb7b9c7439c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:59.060409 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fe9ce-7d9f-4e68-9d7a-cb7b9c7439c5 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:59.060735 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fe9ce-7d9f-4e68-9d7a-cb7b9c7439c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:59.061034 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fe9ce-7d9f-4e68-9d7a-cb7b9c7439c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:59.061748 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fe9ce-7d9f-4e68-9d7a-cb7b9c7439c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:59.062069 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fe9ce-7d9f-4e68-9d7a-cb7b9c7439c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:59.063677 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fe9ce-7d9f-4e68-9d7a-cb7b9c7439c5 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:59.076595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 629/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:47:59.082507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d70b4-fa4b-41dc-9ec8-7481f06acdd5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:59.210547 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d70b4-fa4b-41dc-9ec8-7481f06acdd5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:59.247160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d41a9-512b-40b9-a25c-092d94c430d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:59.247767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d41a9-512b-40b9-a25c-092d94c430d7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:59.248069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d41a9-512b-40b9-a25c-092d94c430d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:59.248324 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d41a9-512b-40b9-a25c-092d94c430d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:59.257743 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d41a9-512b-40b9-a25c-092d94c430d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:59.259586 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d41a9-512b-40b9-a25c-092d94c430d7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:59.275319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-024d41a9-512b-40b9-a25c-092d94c430d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:47:59.275319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:47:59.275319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:47:59.275319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:47:59.275319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:47:59.275319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:47:59.275319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:47:59.275319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:47:59.275319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:47:59.275319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:47:59.275319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:47:59.275319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:47:59.275319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:47:59.275319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:47:59.275319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:47:59.276461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:47:59.276461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:47:59.276461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:47:59.276461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:47:59.276461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:47:59.276461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:47:59.276461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:47:59.276461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:47:59.276461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:47:59.276461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:47:59.276461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:47:59.276461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:47:59.276461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:47:59.276461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:47:59.276461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:47:59.276461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:47:59.276461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:47:59.277824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:47:59.277824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:47:59.277824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:47:59.277824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:47:59.277824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:47:59.277824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:47:59.277824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:47:59.277824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:47:59.277824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 629/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:47:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:47:59.283164 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fe9ce-7d9f-4e68-9d7a-cb7b9c7439c5 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:59.397027 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fe9ce-7d9f-4e68-9d7a-cb7b9c7439c5 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:59.434793 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54963982-4702-428f-935f-85eeed566c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:59.435436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54963982-4702-428f-935f-85eeed566c9d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:59.435714 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54963982-4702-428f-935f-85eeed566c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:59.436064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54963982-4702-428f-935f-85eeed566c9d None admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:59.436679 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54963982-4702-428f-935f-85eeed566c9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:59.437057 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54963982-4702-428f-935f-85eeed566c9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:59.438593 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54963982-4702-428f-935f-85eeed566c9d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:59.457378 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 630/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:47:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:47:59.458553 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d41a9-512b-40b9-a25c-092d94c430d7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:47:59.492700 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:47:59.585090 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d41a9-512b-40b9-a25c-092d94c430d7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:47:59.621120 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf965a34-8223-4769-9d30-fce02600ecb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:47:59.621678 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf965a34-8223-4769-9d30-fce02600ecb0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:47:59.621954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf965a34-8223-4769-9d30-fce02600ecb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:47:59.622223 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf965a34-8223-4769-9d30-fce02600ecb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:47:59.622946 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf965a34-8223-4769-9d30-fce02600ecb0 None admin] RBAC: Adding query filter params (role.id=4f4d8a6881ca496bb2d4845a6592fea8, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=9efd2ac7fc4a42558e8dc48c408ce525) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:47:59.623251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf965a34-8223-4769-9d30-fce02600ecb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:47:59.624730 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf965a34-8223-4769-9d30-fce02600ecb0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:47:59.630671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 630/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:47:59 2022] GET /identity/v3/role_assignments?user.id=9efd2ac7fc4a42558e8dc48c408ce525&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=4f4d8a6881ca496bb2d4845a6592fea8 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:48:01.495078 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa53f6-caf1-42c0-9ce8-6fc3d3e3cdc1 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:01.496129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa53f6-caf1-42c0-9ce8-6fc3d3e3cdc1 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:01.496129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa53f6-caf1-42c0-9ce8-6fc3d3e3cdc1 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:01.497302 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 631/1261] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:48:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:48:01.503123 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014edae9-5573-4507-bd11-3b25556836db None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:01.503705 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014edae9-5573-4507-bd11-3b25556836db None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:01.503705 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014edae9-5573-4507-bd11-3b25556836db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:01.523890 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-014edae9-5573-4507-bd11-3b25556836db None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:48:01.525218 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-014edae9-5573-4507-bd11-3b25556836db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:48:01.594001 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 631/1262] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:48:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 11:48:01.853907 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa53f6-caf1-42c0-9ce8-6fc3d3e3cdc1 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:01.866574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:01.965950 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa53f6-caf1-42c0-9ce8-6fc3d3e3cdc1 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:02.005647 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abb9ad-b65d-4154-92ed-2897086e38b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:02.006261 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abb9ad-b65d-4154-92ed-2897086e38b8 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:02.006535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abb9ad-b65d-4154-92ed-2897086e38b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:02.006804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abb9ad-b65d-4154-92ed-2897086e38b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:02.017934 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2abb9ad-b65d-4154-92ed-2897086e38b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:48:02.022649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-e2abb9ad-b65d-4154-92ed-2897086e38b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:48:02.022649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:48:02.022649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:48:02.022649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:48:02.022649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:48:02.022649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:48:02.022649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:48:02.022649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:48:02.022649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:48:02.022649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:48:02.022649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:48:02.022649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:48:02.022649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:48:02.022649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:48:02.022649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:48:02.022649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:48:02.023821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:48:02.023821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:48:02.023821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:48:02.023821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:48:02.023821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:48:02.023821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:48:02.023821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:48:02.023821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:48:02.023821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:48:02.023821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:48:02.023821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:48:02.023821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:48:02.023821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:48:02.023821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:48:02.023821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:48:02.023821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:48:02.024855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:48:02.024855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:48:02.024855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:48:02.024855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:48:02.024855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:48:02.024855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:48:02.024855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:48:02.024855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:48:02.024855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:48:02.024855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:48:02.024855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:48:02.024855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:48:02.024855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 632/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:48:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:48:02.030055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014edae9-5573-4507-bd11-3b25556836db None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:02.050755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:02.155550 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014edae9-5573-4507-bd11-3b25556836db None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:02.197570 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975e416-5447-47b8-bef1-3fd5b70a1106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:02.198176 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975e416-5447-47b8-bef1-3fd5b70a1106 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:02.198453 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975e416-5447-47b8-bef1-3fd5b70a1106 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:02.198851 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975e416-5447-47b8-bef1-3fd5b70a1106 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:02.199391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975e416-5447-47b8-bef1-3fd5b70a1106 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:48:02.199706 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975e416-5447-47b8-bef1-3fd5b70a1106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:02.201078 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975e416-5447-47b8-bef1-3fd5b70a1106 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:02.210524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 632/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:48:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:48:02.218092 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abb9ad-b65d-4154-92ed-2897086e38b8 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:02.290792 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:02.325019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abb9ad-b65d-4154-92ed-2897086e38b8 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:02.359399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8648254-29d5-4de6-8886-d47e2e78bc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:02.359966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8648254-29d5-4de6-8886-d47e2e78bc04 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:02.360243 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8648254-29d5-4de6-8886-d47e2e78bc04 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:02.360512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8648254-29d5-4de6-8886-d47e2e78bc04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:02.371501 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8648254-29d5-4de6-8886-d47e2e78bc04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:02.372958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8648254-29d5-4de6-8886-d47e2e78bc04 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:02.387393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-a8648254-29d5-4de6-8886-d47e2e78bc04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:48:02.387393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:48:02.387393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:48:02.387393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:48:02.387393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:48:02.387393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:48:02.387393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:48:02.387393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:48:02.387393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:48:02.387393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:48:02.387393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:48:02.387393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:48:02.387393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:48:02.387393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:48:02.387393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:48:02.387393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:48:02.388406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:48:02.388406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:48:02.388406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:48:02.388406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:48:02.388406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:48:02.388406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:48:02.388406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:48:02.388406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:48:02.388406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:48:02.388406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:48:02.388406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:48:02.388406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:48:02.388406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:48:02.388406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:48:02.388406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:48:02.388406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:48:02.388406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:48:02.389330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:48:02.389330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:48:02.389330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:48:02.389330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 633/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:48:02.394661 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975e416-5447-47b8-bef1-3fd5b70a1106 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:02.480234 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:02.503583 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975e416-5447-47b8-bef1-3fd5b70a1106 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:02.539789 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4a55a-8933-4181-8d0a-64c3c839eea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:02.540398 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4a55a-8933-4181-8d0a-64c3c839eea6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:02.540672 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4a55a-8933-4181-8d0a-64c3c839eea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:02.540938 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4a55a-8933-4181-8d0a-64c3c839eea6 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:02.541571 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4a55a-8933-4181-8d0a-64c3c839eea6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:48:02.541869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4a55a-8933-4181-8d0a-64c3c839eea6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:02.543334 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4a55a-8933-4181-8d0a-64c3c839eea6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:02.554721 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 633/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:48:02.561065 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8648254-29d5-4de6-8886-d47e2e78bc04 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:02.667043 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8648254-29d5-4de6-8886-d47e2e78bc04 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:02.687085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:02.703676 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14054e1b-b7bb-41d3-9bbb-e53f9c84d149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:02.704297 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14054e1b-b7bb-41d3-9bbb-e53f9c84d149 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:02.704571 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14054e1b-b7bb-41d3-9bbb-e53f9c84d149 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:02.704841 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14054e1b-b7bb-41d3-9bbb-e53f9c84d149 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:02.712644 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14054e1b-b7bb-41d3-9bbb-e53f9c84d149 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:02.714098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14054e1b-b7bb-41d3-9bbb-e53f9c84d149 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:02.725362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-14054e1b-b7bb-41d3-9bbb-e53f9c84d149 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:48:02.725362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:48:02.725362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:48:02.725362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:48:02.725362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:48:02.725362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:48:02.725362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:48:02.725362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:48:02.725362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:48:02.725362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:48:02.725362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:48:02.725362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:48:02.725362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:48:02.725362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:48:02.725362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:48:02.725362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:48:02.726445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:48:02.726445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:48:02.726445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:48:02.726445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:48:02.726445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:48:02.726445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:48:02.726445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:48:02.726445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:48:02.726445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:48:02.726445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:48:02.726445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:48:02.726445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:48:02.726445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:48:02.726445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:48:02.726445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:48:02.726445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:48:02.726445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:48:02.726445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:48:02.727651 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:48:02.727651 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:48:02.727651 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:48:02.727651 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:48:02.727651 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:48:02.727651 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:48:02.727651 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:48:02.727651 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:48:02.727651 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:48:02.727651 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:48:02.727651 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 634/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:48:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:48:02.732604 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4a55a-8933-4181-8d0a-64c3c839eea6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:02.837071 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4a55a-8933-4181-8d0a-64c3c839eea6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:02.870686 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846028af-d3ad-47b4-ae89-7e0775f5df90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:02.871285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846028af-d3ad-47b4-ae89-7e0775f5df90 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:02.871590 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846028af-d3ad-47b4-ae89-7e0775f5df90 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:02.871860 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846028af-d3ad-47b4-ae89-7e0775f5df90 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:02.872573 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846028af-d3ad-47b4-ae89-7e0775f5df90 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:48:02.872874 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846028af-d3ad-47b4-ae89-7e0775f5df90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:02.874286 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846028af-d3ad-47b4-ae89-7e0775f5df90 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:02.882934 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:02.892346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 634/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Aug 30 11:48:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:48:02.898981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14054e1b-b7bb-41d3-9bbb-e53f9c84d149 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:03.005680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14054e1b-b7bb-41d3-9bbb-e53f9c84d149 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:03.040554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173f0b7-873c-4a7d-87d1-670f0db892a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:03.041165 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173f0b7-873c-4a7d-87d1-670f0db892a2 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:03.041442 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173f0b7-873c-4a7d-87d1-670f0db892a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:03.041709 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173f0b7-873c-4a7d-87d1-670f0db892a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:03.052633 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173f0b7-873c-4a7d-87d1-670f0db892a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:03.054095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173f0b7-873c-4a7d-87d1-670f0db892a2 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:03.068495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-5173f0b7-873c-4a7d-87d1-670f0db892a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:48:03.068495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:48:03.068495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:48:03.068495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:48:03.068495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:48:03.068495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:48:03.068495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:48:03.068495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:48:03.068495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:48:03.068495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:48:03.068495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:48:03.068495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:48:03.068495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:48:03.068495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:48:03.068495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:48:03.068495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:48:03.069584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:48:03.069584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:48:03.069584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:48:03.069584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:48:03.069584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:48:03.069584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:48:03.069584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:48:03.069584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:48:03.069584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:48:03.069584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:48:03.069584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:48:03.069584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:48:03.069584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:48:03.069584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:48:03.069584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:48:03.069584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:48:03.069584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:48:03.070742 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:48:03.070742 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:48:03.070742 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:48:03.070742 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 635/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:48:03.075875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846028af-d3ad-47b4-ae89-7e0775f5df90 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:03.181700 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846028af-d3ad-47b4-ae89-7e0775f5df90 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:03.218448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d1508-2264-46ea-acc0-1b0b757a6ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:03.219049 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d1508-2264-46ea-acc0-1b0b757a6ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:03.219324 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d1508-2264-46ea-acc0-1b0b757a6ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:03.219625 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d1508-2264-46ea-acc0-1b0b757a6ca5 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:03.220258 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d1508-2264-46ea-acc0-1b0b757a6ca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:48:03.220555 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d1508-2264-46ea-acc0-1b0b757a6ca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:03.221920 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d1508-2264-46ea-acc0-1b0b757a6ca5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:03.233938 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 635/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:48:03.240861 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173f0b7-873c-4a7d-87d1-670f0db892a2 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:03.281760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:03.354138 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173f0b7-873c-4a7d-87d1-670f0db892a2 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:03.389559 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0e52d-ce4c-4756-8c3f-0f0477485ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:03.390175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0e52d-ce4c-4756-8c3f-0f0477485ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:03.390452 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0e52d-ce4c-4756-8c3f-0f0477485ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:03.390719 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0e52d-ce4c-4756-8c3f-0f0477485ec5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:03.397861 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0e52d-ce4c-4756-8c3f-0f0477485ec5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:03.399320 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0e52d-ce4c-4756-8c3f-0f0477485ec5 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:03.411129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-eda0e52d-ce4c-4756-8c3f-0f0477485ec5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:48:03.411129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:48:03.411129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:48:03.411129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:48:03.411129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:48:03.411129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:48:03.411129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:48:03.411129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:48:03.411129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:48:03.411129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:48:03.411129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:48:03.411129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:48:03.411129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:48:03.411129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:48:03.411129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:48:03.412283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:48:03.412283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:48:03.412283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:48:03.412283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:48:03.412283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:48:03.412283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:48:03.412283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:48:03.412283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:48:03.412283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:48:03.412283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:48:03.412283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:48:03.412283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:48:03.412283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:48:03.412283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:48:03.412283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:48:03.412283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:48:03.412283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:48:03.413423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:48:03.413423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:48:03.413423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:48:03.413423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:48:03.413423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:48:03.413423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:48:03.413423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:48:03.413423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:48:03.413423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 636/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:48:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:48:03.419257 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d1508-2264-46ea-acc0-1b0b757a6ca5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:03.494634 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:03.544182 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d1508-2264-46ea-acc0-1b0b757a6ca5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:03.579376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16af4d2-d11c-4ff6-82ab-3efec6d87df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:03.579989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16af4d2-d11c-4ff6-82ab-3efec6d87df4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:03.580262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16af4d2-d11c-4ff6-82ab-3efec6d87df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:03.580532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16af4d2-d11c-4ff6-82ab-3efec6d87df4 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:03.581225 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16af4d2-d11c-4ff6-82ab-3efec6d87df4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:48:03.581526 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16af4d2-d11c-4ff6-82ab-3efec6d87df4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:03.582958 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16af4d2-d11c-4ff6-82ab-3efec6d87df4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:03.595034 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 636/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:48:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:48:03.604715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0e52d-ce4c-4756-8c3f-0f0477485ec5 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:03.710295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:03.721122 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0e52d-ce4c-4756-8c3f-0f0477485ec5 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:03.758656 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e66b8-fb61-49d6-bfb8-eeacae92e548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:03.759298 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e66b8-fb61-49d6-bfb8-eeacae92e548 None admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:03.759598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e66b8-fb61-49d6-bfb8-eeacae92e548 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:03.759866 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e66b8-fb61-49d6-bfb8-eeacae92e548 None admin] PATH_INFO: `/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/9efd2ac7fc4a42558e8dc48c408ce525/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:03.762103 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e66b8-fb61-49d6-bfb8-eeacae92e548 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba4dff9d637c4afcadfd3cd92b065a41, user_id=9efd2ac7fc4a42558e8dc48c408ce525, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:03.763584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e66b8-fb61-49d6-bfb8-eeacae92e548 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:03.778110 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 637/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Aug 30 11:48:03 2022] PUT /identity/v3/projects/ba4dff9d637c4afcadfd3cd92b065a41/users/9efd2ac7fc4a42558e8dc48c408ce525/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:48:05.652216 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f6878-40f3-46ad-9d1f-d95e4446939c None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:05.653099 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f6878-40f3-46ad-9d1f-d95e4446939c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:05.653238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f6878-40f3-46ad-9d1f-d95e4446939c None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:05.655415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 637/1274] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:48:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:48:05.664131 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1b0b8-2668-49f9-afaa-22c59ed20a8a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:05.664855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1b0b8-2668-49f9-afaa-22c59ed20a8a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:05.665001 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1b0b8-2668-49f9-afaa-22c59ed20a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:05.686591 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e7c1b0b8-2668-49f9-afaa-22c59ed20a8a None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:48:05.687836 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e7c1b0b8-2668-49f9-afaa-22c59ed20a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:48:05.757671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 638/1275] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:48:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:48:06.022001 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f6878-40f3-46ad-9d1f-d95e4446939c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:06.144461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f6878-40f3-46ad-9d1f-d95e4446939c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:06.162875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:06.182697 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab091d2-6ffb-4bb9-a815-3bcb422b5aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:06.183403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab091d2-6ffb-4bb9-a815-3bcb422b5aaa None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:06.183697 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab091d2-6ffb-4bb9-a815-3bcb422b5aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:06.183963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab091d2-6ffb-4bb9-a815-3bcb422b5aaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:06.196104 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab091d2-6ffb-4bb9-a815-3bcb422b5aaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 11:48:06.200916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-2ab091d2-6ffb-4bb9-a815-3bcb422b5aaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:48:06.200916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:48:06.200916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:48:06.200916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:48:06.200916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:48:06.200916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:48:06.200916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:48:06.200916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:48:06.200916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:48:06.200916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:48:06.200916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:48:06.200916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:48:06.200916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 11:48:06.200916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 11:48:06.200916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 11:48:06.200916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 11:48:06.201983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 11:48:06.201983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 11:48:06.201983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 11:48:06.201983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 11:48:06.201983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:48:06.201983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:48:06.201983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:48:06.201983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:48:06.201983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:48:06.201983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:48:06.201983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:48:06.201983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:48:06.201983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:48:06.201983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:48:06.201983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:48:06.201983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:48:06.203282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:48:06.203282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:48:06.203282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:48:06.203282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:48:06.203282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 11:48:06.203282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 11:48:06.203282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 11:48:06.203282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 11:48:06.203282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 11:48:06.203282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 11:48:06.203282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 11:48:06.203282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:48:06.203282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 638/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Aug 30 11:48:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:48:06.208668 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1b0b8-2668-49f9-afaa-22c59ed20a8a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:06.297565 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:06.321010 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1b0b8-2668-49f9-afaa-22c59ed20a8a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:06.357863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262401cc-c88b-487d-ae0f-a02e62be4eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:06.358451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262401cc-c88b-487d-ae0f-a02e62be4eea None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:06.358722 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262401cc-c88b-487d-ae0f-a02e62be4eea None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:06.358989 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262401cc-c88b-487d-ae0f-a02e62be4eea None admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:06.359666 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262401cc-c88b-487d-ae0f-a02e62be4eea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:48:06.359959 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262401cc-c88b-487d-ae0f-a02e62be4eea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:06.361383 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262401cc-c88b-487d-ae0f-a02e62be4eea None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:06.369351 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 639/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Aug 30 11:48:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:48:06.378857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab091d2-6ffb-4bb9-a815-3bcb422b5aaa None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:06.495835 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab091d2-6ffb-4bb9-a815-3bcb422b5aaa None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:06.546113 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65b384-f5b4-41f5-932f-63898782bf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:06.546755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65b384-f5b4-41f5-932f-63898782bf79 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:06.547087 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65b384-f5b4-41f5-932f-63898782bf79 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:06.547311 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65b384-f5b4-41f5-932f-63898782bf79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:06.559187 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65b384-f5b4-41f5-932f-63898782bf79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:06.561584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65b384-f5b4-41f5-932f-63898782bf79 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:06.577986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-fd65b384-f5b4-41f5-932f-63898782bf79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:48:06.577986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:48:06.577986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:48:06.577986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:48:06.577986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:48:06.577986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:48:06.577986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:48:06.577986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:48:06.577986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:48:06.577986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:48:06.577986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:48:06.577986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:48:06.577986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:48:06.577986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:48:06.577986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:48:06.577986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:48:06.579111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:48:06.579111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:48:06.579111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:48:06.579111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:48:06.579111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:48:06.579111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:48:06.579111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:48:06.579111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:48:06.579111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:48:06.579111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:48:06.579111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:48:06.579111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:48:06.579111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:48:06.579111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:48:06.579111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:48:06.579111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:48:06.579111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:48:06.580348 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:48:06.580348 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:48:06.580348 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:48:06.580348 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 639/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:48:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:48:06.585391 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262401cc-c88b-487d-ae0f-a02e62be4eea None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:06.712669 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262401cc-c88b-487d-ae0f-a02e62be4eea None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:06.748258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f6056-3aa2-438c-a63c-d29c31a4f1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:06.748845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f6056-3aa2-438c-a63c-d29c31a4f1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:06.749118 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f6056-3aa2-438c-a63c-d29c31a4f1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:06.749382 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f6056-3aa2-438c-a63c-d29c31a4f1e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:06.750001 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f6056-3aa2-438c-a63c-d29c31a4f1e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:48:06.750304 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f6056-3aa2-438c-a63c-d29c31a4f1e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:06.751700 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f6056-3aa2-438c-a63c-d29c31a4f1e8 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:06.763394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 640/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:48:06.772837 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65b384-f5b4-41f5-932f-63898782bf79 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:06.804902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:06.877788 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65b384-f5b4-41f5-932f-63898782bf79 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:06.914832 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b2a4c-e2bc-4189-b93f-808bf32d3b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:06.915468 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b2a4c-e2bc-4189-b93f-808bf32d3b87 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:06.915744 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b2a4c-e2bc-4189-b93f-808bf32d3b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:06.916011 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b2a4c-e2bc-4189-b93f-808bf32d3b87 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:06.923995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b2a4c-e2bc-4189-b93f-808bf32d3b87 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:06.925431 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b2a4c-e2bc-4189-b93f-808bf32d3b87 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:06.937228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-f39b2a4c-e2bc-4189-b93f-808bf32d3b87 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:48:06.937228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:48:06.937228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:48:06.937228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:48:06.937228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:48:06.937228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:48:06.937228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:48:06.937228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:48:06.937228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:48:06.937228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:48:06.937228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:48:06.937228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:48:06.937228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 11:48:06.937228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 11:48:06.937228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 11:48:06.937228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 11:48:06.938303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:48:06.938303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:48:06.938303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 11:48:06.938303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:48:06.938303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 11:48:06.938303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 11:48:06.938303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:48:06.938303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:48:06.938303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:48:06.938303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:48:06.938303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:48:06.938303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:48:06.938303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:48:06.938303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:48:06.938303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:48:06.938303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:48:06.938303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:48:06.938303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:48:06.939512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:48:06.939512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:48:06.939512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 11:48:06.939512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 11:48:06.939512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 11:48:06.939512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 11:48:06.939512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 11:48:06.939512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 11:48:06.939512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 11:48:06.939512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:48:06.939512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 640/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:48:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:48:06.944311 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f6056-3aa2-438c-a63c-d29c31a4f1e8 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:06.948286 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:07.046620 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f6056-3aa2-438c-a63c-d29c31a4f1e8 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:07.082012 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fc35b-3052-4c87-8997-e055803391a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:07.082602 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fc35b-3052-4c87-8997-e055803391a6 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:07.082872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fc35b-3052-4c87-8997-e055803391a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:07.083137 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fc35b-3052-4c87-8997-e055803391a6 None admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:07.083879 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6fc35b-3052-4c87-8997-e055803391a6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:48:07.084181 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6fc35b-3052-4c87-8997-e055803391a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:07.085597 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6fc35b-3052-4c87-8997-e055803391a6 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:07.102629 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 641/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Aug 30 11:48:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:48:07.109493 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b2a4c-e2bc-4189-b93f-808bf32d3b87 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:07.201794 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:07.212983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b2a4c-e2bc-4189-b93f-808bf32d3b87 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:07.248634 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9321b78-28cd-4b88-90c6-aef061ce868b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:07.249239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9321b78-28cd-4b88-90c6-aef061ce868b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:07.249502 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9321b78-28cd-4b88-90c6-aef061ce868b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:07.249768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9321b78-28cd-4b88-90c6-aef061ce868b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:07.319259 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9321b78-28cd-4b88-90c6-aef061ce868b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:07.320715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9321b78-28cd-4b88-90c6-aef061ce868b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:07.410331 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:07.427637 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 641/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Aug 30 11:48:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 11:48:07.435661 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fc35b-3052-4c87-8997-e055803391a6 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:07.507019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:07.550115 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fc35b-3052-4c87-8997-e055803391a6 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:07.589100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac14b0-23d4-44bc-84f0-a8cce4a7a735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:07.589720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac14b0-23d4-44bc-84f0-a8cce4a7a735 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:07.589994 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac14b0-23d4-44bc-84f0-a8cce4a7a735 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:07.590263 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac14b0-23d4-44bc-84f0-a8cce4a7a735 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:07.601948 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac14b0-23d4-44bc-84f0-a8cce4a7a735 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:07.603395 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac14b0-23d4-44bc-84f0-a8cce4a7a735 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:07.619280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-3dac14b0-23d4-44bc-84f0-a8cce4a7a735 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:48:07.619280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:48:07.619280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:48:07.619280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:48:07.619280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:48:07.619280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:48:07.619280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:48:07.619280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:48:07.619280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:48:07.619280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:48:07.619280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:48:07.619280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:48:07.619280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 11:48:07.619280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 11:48:07.619280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 11:48:07.619280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 11:48:07.620455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:48:07.620455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:48:07.620455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:48:07.620455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:48:07.620455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:48:07.620455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:48:07.620455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:48:07.620455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:48:07.620455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:48:07.620455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:48:07.620455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:48:07.620455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:48:07.620455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:48:07.620455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:48:07.620455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:48:07.620455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:48:07.620455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 11:48:07.621380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 11:48:07.621380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 11:48:07.621380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:48:07.621380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 642/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:48:07.627443 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9321b78-28cd-4b88-90c6-aef061ce868b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:07.747867 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9321b78-28cd-4b88-90c6-aef061ce868b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:07.795040 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25887d-1c60-40d3-b26a-a3e1c9c307f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:07.795655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25887d-1c60-40d3-b26a-a3e1c9c307f2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:07.795849 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25887d-1c60-40d3-b26a-a3e1c9c307f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:07.796114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25887d-1c60-40d3-b26a-a3e1c9c307f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:07.796742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25887d-1c60-40d3-b26a-a3e1c9c307f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:48:07.797045 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25887d-1c60-40d3-b26a-a3e1c9c307f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:07.798405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25887d-1c60-40d3-b26a-a3e1c9c307f2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:07.809874 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 642/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Aug 30 11:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:48:07.818359 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac14b0-23d4-44bc-84f0-a8cce4a7a735 None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:07.934838 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac14b0-23d4-44bc-84f0-a8cce4a7a735 None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:07.948326 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:07.978209 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af0076-1c30-42ed-ae21-490aaee35a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:07.979143 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af0076-1c30-42ed-ae21-490aaee35a7c None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:07.979746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af0076-1c30-42ed-ae21-490aaee35a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:07.980221 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af0076-1c30-42ed-ae21-490aaee35a7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:07.987822 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af0076-1c30-42ed-ae21-490aaee35a7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:07.989285 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af0076-1c30-42ed-ae21-490aaee35a7c None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:08.001141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application [None req-65af0076-1c30-42ed-ae21-490aaee35a7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:48:08.001141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:48:08.001141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:48:08.001141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:48:08.001141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:48:08.001141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:48:08.001141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:48:08.001141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:48:08.001141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:48:08.001141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:48:08.001141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:48:08.001141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:48:08.001141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 11:48:08.001141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 11:48:08.001141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 11:48:08.002213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 11:48:08.002213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:48:08.002213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:48:08.002213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:48:08.002213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:48:08.002213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:48:08.002213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:48:08.002213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:48:08.002213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application with Lock( Aug 30 11:48:08.002213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:48:08.002213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:48:08.002213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:48:08.002213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:48:08.002213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:48:08.002213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:48:08.002213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:48:08.002213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:48:08.003106 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 11:48:08.003106 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 11:48:08.003106 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 11:48:08.003106 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 11:48:08.003106 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 11:48:08.003106 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 11:48:08.003106 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 11:48:08.003106 dv-cinder-839768-2-smb devstack@keystone.service[81553]: ERROR keystone.server.flask.application Aug 30 11:48:08.003106 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 643/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Aug 30 11:48:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 11:48:08.008361 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25887d-1c60-40d3-b26a-a3e1c9c307f2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:08.068547 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:08.125237 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25887d-1c60-40d3-b26a-a3e1c9c307f2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:08.160389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247a3a3-f71d-4595-8f38-2bf243974587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:08.160954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247a3a3-f71d-4595-8f38-2bf243974587 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:08.161258 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247a3a3-f71d-4595-8f38-2bf243974587 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:08.161525 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247a3a3-f71d-4595-8f38-2bf243974587 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:08.162209 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247a3a3-f71d-4595-8f38-2bf243974587 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:48:08.162505 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247a3a3-f71d-4595-8f38-2bf243974587 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:08.163957 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247a3a3-f71d-4595-8f38-2bf243974587 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:08.175890 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 643/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Aug 30 11:48:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:48:08.182445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af0076-1c30-42ed-ae21-490aaee35a7c None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:08.306276 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af0076-1c30-42ed-ae21-490aaee35a7c None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:08.342941 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a93b0-c7bd-4d59-8ceb-19452a427245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:08.343498 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a93b0-c7bd-4d59-8ceb-19452a427245 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:08.343780 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a93b0-c7bd-4d59-8ceb-19452a427245 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:08.344054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a93b0-c7bd-4d59-8ceb-19452a427245 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:08.344771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a93b0-c7bd-4d59-8ceb-19452a427245 None admin] RBAC: Adding query filter params (role.id=4f4d8a6881ca496bb2d4845a6592fea8, scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41, user.id=9efd2ac7fc4a42558e8dc48c408ce525) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:48:08.345080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a93b0-c7bd-4d59-8ceb-19452a427245 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:08.346532 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a93b0-c7bd-4d59-8ceb-19452a427245 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:08.352523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 644/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Aug 30 11:48:08 2022] GET /identity/v3/role_assignments?user.id=9efd2ac7fc4a42558e8dc48c408ce525&scope.project.id=ba4dff9d637c4afcadfd3cd92b065a41&role.id=4f4d8a6881ca496bb2d4845a6592fea8 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:48:10.268967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7185424-1c13-4509-9c76-52feeb357228 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:10.269856 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7185424-1c13-4509-9c76-52feeb357228 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:10.269856 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7185424-1c13-4509-9c76-52feeb357228 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:10.272016 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 644/1288] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:48:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:48:10.280809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349559f-1635-4e0b-b46d-eff8f302bd46 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:10.281234 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349559f-1635-4e0b-b46d-eff8f302bd46 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:10.281376 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349559f-1635-4e0b-b46d-eff8f302bd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:10.303938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-9349559f-1635-4e0b-b46d-eff8f302bd46 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:48:10.305110 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9349559f-1635-4e0b-b46d-eff8f302bd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:48:10.336517 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:10.377513 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 645/1289] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:48:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:48:10.644191 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7185424-1c13-4509-9c76-52feeb357228 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:10.755675 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7185424-1c13-4509-9c76-52feeb357228 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:10.767062 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:10.796395 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974f5e5-cd36-41cf-bbdf-6a4b4502e8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:10.797022 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974f5e5-cd36-41cf-bbdf-6a4b4502e8ae None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:10.797294 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974f5e5-cd36-41cf-bbdf-6a4b4502e8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:10.797567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974f5e5-cd36-41cf-bbdf-6a4b4502e8ae None admin] PATH_INFO: `/v3/services/placement` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:10.798143 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974f5e5-cd36-41cf-bbdf-6a4b4502e8ae None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:10.799547 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974f5e5-cd36-41cf-bbdf-6a4b4502e8ae None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:10.808464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4974f5e5-cd36-41cf-bbdf-6a4b4502e8ae None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 11:48:10.808464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:48:10.808464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:48:10.808464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:48:10.808464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:48:10.808464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:48:10.808464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:48:10.808464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:48:10.808464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 11:48:10.808464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:48:10.808464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:48:10.808464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:48:10.808464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:48:10.808464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:48:10.808464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:48:10.808464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:48:10.808464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:48:10.809642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:48:10.809642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:48:10.809642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:48:10.809642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:48:10.809642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:48:10.809642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:48:10.809642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:48:10.809642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:48:10.809642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:48:10.809642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:48:10.809642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:48:10.809642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:48:10.809642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:48:10.809642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:48:10.809642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:48:10.809642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:48:10.810876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:48:10.810876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:48:10.810876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:48:10.810876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:48:10.810876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:48:10.810876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:48:10.810876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:48:10.810876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:48:10.810876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:48:10.810876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:48:10.810876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:48:10.810876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:48:10.810876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 11:48:10.810876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:48:10.810876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 645/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Aug 30 11:48:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:48:10.815741 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349559f-1635-4e0b-b46d-eff8f302bd46 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:10.919818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349559f-1635-4e0b-b46d-eff8f302bd46 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:10.955483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2898a-e2a9-461e-ab08-525bf965fb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:10.956070 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2898a-e2a9-461e-ab08-525bf965fb50 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:10.956325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2898a-e2a9-461e-ab08-525bf965fb50 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:10.956618 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2898a-e2a9-461e-ab08-525bf965fb50 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:10.957227 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2898a-e2a9-461e-ab08-525bf965fb50 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:48:10.957523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2898a-e2a9-461e-ab08-525bf965fb50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:10.958894 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2898a-e2a9-461e-ab08-525bf965fb50 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:10.963832 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 646/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Aug 30 11:48:10 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:48:10.970105 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974f5e5-cd36-41cf-bbdf-6a4b4502e8ae None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:11.081714 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974f5e5-cd36-41cf-bbdf-6a4b4502e8ae None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:11.120961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2392d97-2af2-4549-afb9-46c3469f1db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:11.121581 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2392d97-2af2-4549-afb9-46c3469f1db3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:11.121878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2392d97-2af2-4549-afb9-46c3469f1db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:11.122145 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2392d97-2af2-4549-afb9-46c3469f1db3 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:11.122771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2392d97-2af2-4549-afb9-46c3469f1db3 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:48:11.123067 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2392d97-2af2-4549-afb9-46c3469f1db3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:11.124468 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2392d97-2af2-4549-afb9-46c3469f1db3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:11.129226 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 646/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Aug 30 11:48:10 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:48:12.978252 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4184421-2c05-468d-b81b-eaec79467612 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:12.979115 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4184421-2c05-468d-b81b-eaec79467612 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:12.979115 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4184421-2c05-468d-b81b-eaec79467612 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:12.981290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 647/1293] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:48:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:48:12.990574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de669be-e0ce-47cf-aa90-f26a97b14c7b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:12.991263 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de669be-e0ce-47cf-aa90-f26a97b14c7b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:12.991430 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de669be-e0ce-47cf-aa90-f26a97b14c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:13.018793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7de669be-e0ce-47cf-aa90-f26a97b14c7b None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:48:13.020022 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7de669be-e0ce-47cf-aa90-f26a97b14c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:48:13.056985 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:13.097124 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 647/1294] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:48:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:48:13.372656 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4184421-2c05-468d-b81b-eaec79467612 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:13.417208 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:13.505575 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4184421-2c05-468d-b81b-eaec79467612 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:13.552759 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83103f-2b3b-425d-9f03-4f54126aafa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:13.553411 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83103f-2b3b-425d-9f03-4f54126aafa7 None admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:13.553732 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83103f-2b3b-425d-9f03-4f54126aafa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:13.554015 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83103f-2b3b-425d-9f03-4f54126aafa7 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:13.554762 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83103f-2b3b-425d-9f03-4f54126aafa7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:13.556324 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83103f-2b3b-425d-9f03-4f54126aafa7 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:13.575911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 648/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Aug 30 11:48:13 2022] POST /identity/v3/services => generated 246 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:48:15.472376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e392db7-4511-403d-9244-4fe5b731932f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:15.473199 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e392db7-4511-403d-9244-4fe5b731932f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:15.473199 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e392db7-4511-403d-9244-4fe5b731932f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:15.475159 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 648/1296] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:48:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:48:15.481483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe02a7-849e-4d4b-9d94-56179ee4f20a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:15.481984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe02a7-849e-4d4b-9d94-56179ee4f20a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:15.482118 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe02a7-849e-4d4b-9d94-56179ee4f20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:15.511091 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-78fe02a7-849e-4d4b-9d94-56179ee4f20a None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:48:15.512304 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-78fe02a7-849e-4d4b-9d94-56179ee4f20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:48:15.588204 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 649/1297] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:48:15 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:48:15.864301 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e392db7-4511-403d-9244-4fe5b731932f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:15.974590 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e392db7-4511-403d-9244-4fe5b731932f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:16.010102 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26179b3-7d0b-4649-bff5-15929336cd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:16.010726 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26179b3-7d0b-4649-bff5-15929336cd32 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:16.011005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26179b3-7d0b-4649-bff5-15929336cd32 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:16.011275 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26179b3-7d0b-4649-bff5-15929336cd32 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:16.011886 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26179b3-7d0b-4649-bff5-15929336cd32 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:16.013257 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26179b3-7d0b-4649-bff5-15929336cd32 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:16.022534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-f26179b3-7d0b-4649-bff5-15929336cd32 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 11:48:16.022534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:48:16.022534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:48:16.022534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:48:16.022534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:48:16.022534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:48:16.022534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:48:16.022534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:48:16.022534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 11:48:16.022534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:48:16.022534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:48:16.022534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:48:16.022534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:48:16.022534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:48:16.022534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:48:16.022534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:48:16.022534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:48:16.023719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:48:16.023719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:48:16.023719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:48:16.023719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:48:16.023719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:48:16.023719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:48:16.023719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:48:16.023719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:48:16.023719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:48:16.023719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:48:16.023719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:48:16.023719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:48:16.023719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:48:16.023719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:48:16.023719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:48:16.023719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:48:16.024584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:48:16.024584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:48:16.024584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:48:16.024584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:48:16.024584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:48:16.024584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:48:16.024584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:48:16.024584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:48:16.024584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:48:16.024584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:48:16.024584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:48:16.024584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:48:16.024584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 11:48:16.024584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:48:16.024584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 649/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Aug 30 11:48:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:48:16.031650 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe02a7-849e-4d4b-9d94-56179ee4f20a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:16.050554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:16.140616 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe02a7-849e-4d4b-9d94-56179ee4f20a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:16.179019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab192d83-3811-4259-933d-d8c103bbb06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:16.179659 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab192d83-3811-4259-933d-d8c103bbb06d None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:16.179938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab192d83-3811-4259-933d-d8c103bbb06d None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:16.180209 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab192d83-3811-4259-933d-d8c103bbb06d None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:16.180834 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab192d83-3811-4259-933d-d8c103bbb06d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:48:16.181136 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab192d83-3811-4259-933d-d8c103bbb06d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:16.182528 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab192d83-3811-4259-933d-d8c103bbb06d None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:16.188478 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 650/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Aug 30 11:48:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:48:16.198114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26179b3-7d0b-4649-bff5-15929336cd32 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:16.232900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:16.306161 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26179b3-7d0b-4649-bff5-15929336cd32 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:16.341594 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44691072-9fb8-4292-bf2e-3fd6fd33f210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:16.342201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44691072-9fb8-4292-bf2e-3fd6fd33f210 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:16.342476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44691072-9fb8-4292-bf2e-3fd6fd33f210 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:16.342718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44691072-9fb8-4292-bf2e-3fd6fd33f210 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:16.343457 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44691072-9fb8-4292-bf2e-3fd6fd33f210 None admin] RBAC: Adding query filter params (interface=public, service_id=8e9179f10a764a15b1f4aac5c873fcd2, region_id=RegionOne) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:48:16.343768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44691072-9fb8-4292-bf2e-3fd6fd33f210 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:16.345135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44691072-9fb8-4292-bf2e-3fd6fd33f210 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:16.350724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 650/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Aug 30 11:48:16 2022] GET /identity/v3/endpoints?service_id=8e9179f10a764a15b1f4aac5c873fcd2&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:48:16.356879 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab192d83-3811-4259-933d-d8c103bbb06d None admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:16.443019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:16.466141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab192d83-3811-4259-933d-d8c103bbb06d None admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:16.504576 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0cb595-b2a1-4532-a023-137ea7c0cea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:16.505200 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cb595-b2a1-4532-a023-137ea7c0cea6 None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:16.505448 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cb595-b2a1-4532-a023-137ea7c0cea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:16.505719 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cb595-b2a1-4532-a023-137ea7c0cea6 None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:16.506359 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0cb595-b2a1-4532-a023-137ea7c0cea6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:16.507782 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0cb595-b2a1-4532-a023-137ea7c0cea6 None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:16.515204 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 651/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Aug 30 11:48:16 2022] GET /identity/v3/services => generated 2191 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:48:18.390479 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ab86a-aaaa-4b0d-834d-ec1d4a6868db None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:18.391002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ab86a-aaaa-4b0d-834d-ec1d4a6868db None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:18.391002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ab86a-aaaa-4b0d-834d-ec1d4a6868db None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:18.392327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 651/1302] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:48:18.398604 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c706d9-b13c-468e-834e-bbca2f4a15b1 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:18.399351 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c706d9-b13c-468e-834e-bbca2f4a15b1 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:18.399551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c706d9-b13c-468e-834e-bbca2f4a15b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:18.424423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f7c706d9-b13c-468e-834e-bbca2f4a15b1 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:48:18.425621 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f7c706d9-b13c-468e-834e-bbca2f4a15b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:48:18.504133 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 652/1303] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:48:18 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 11:48:18.768138 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ab86a-aaaa-4b0d-834d-ec1d4a6868db None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:18.871834 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:18.882442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ab86a-aaaa-4b0d-834d-ec1d4a6868db None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:18.925739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c468da4-e589-44aa-ba99-b627be8ca268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:18.926368 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c468da4-e589-44aa-ba99-b627be8ca268 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:18.926639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c468da4-e589-44aa-ba99-b627be8ca268 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:18.926883 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c468da4-e589-44aa-ba99-b627be8ca268 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:18.927505 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c468da4-e589-44aa-ba99-b627be8ca268 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:18.928876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c468da4-e589-44aa-ba99-b627be8ca268 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:18.942567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9c468da4-e589-44aa-ba99-b627be8ca268 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 11:48:18.942567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:48:18.942567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 11:48:18.942567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 11:48:18.942567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 11:48:18.942567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 11:48:18.942567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 11:48:18.942567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:48:18.942567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 11:48:18.942567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:48:18.942567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 11:48:18.942567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:48:18.942567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 11:48:18.942567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 11:48:18.942567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 11:48:18.942567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 11:48:18.942567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 11:48:18.943713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 11:48:18.943713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 11:48:18.943713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 11:48:18.943713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 11:48:18.943713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 11:48:18.943713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 11:48:18.943713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 11:48:18.943713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 11:48:18.943713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 11:48:18.943713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 11:48:18.943713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 11:48:18.943713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 11:48:18.943713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 11:48:18.943713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 11:48:18.943713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 11:48:18.943713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 11:48:18.944674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 11:48:18.944674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 30 11:48:18.944674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 11:48:18.944674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 30 11:48:18.944674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 11:48:18.944674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 11:48:18.944674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 11:48:18.944674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 30 11:48:18.944674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 11:48:18.944674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 30 11:48:18.944674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 11:48:18.944674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 11:48:18.944674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 11:48:18.944674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 30 11:48:18.944674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 652/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Aug 30 11:48:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 11:48:18.953050 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c706d9-b13c-468e-834e-bbca2f4a15b1 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:19.037535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:19.062155 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c706d9-b13c-468e-834e-bbca2f4a15b1 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:19.098049 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a27ec-17f3-4d66-ae43-019c176f06fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:19.098645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a27ec-17f3-4d66-ae43-019c176f06fb None admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:19.098922 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a27ec-17f3-4d66-ae43-019c176f06fb None admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:19.099190 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a27ec-17f3-4d66-ae43-019c176f06fb None admin] PATH_INFO: `/v3/services` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:19.099843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a27ec-17f3-4d66-ae43-019c176f06fb None admin] RBAC: Adding query filter params (name=placement) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:48:19.100140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a27ec-17f3-4d66-ae43-019c176f06fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:19.101527 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a27ec-17f3-4d66-ae43-019c176f06fb None admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:19.107227 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 653/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Aug 30 11:48:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:48:19.113578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c468da4-e589-44aa-ba99-b627be8ca268 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:48:19.237796 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c468da4-e589-44aa-ba99-b627be8ca268 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:48:19.273066 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf734b-f37b-4ab1-92f7-ab991c50a5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:48:19.273673 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf734b-f37b-4ab1-92f7-ab991c50a5c4 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:48:19.273952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf734b-f37b-4ab1-92f7-ab991c50a5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:48:19.274223 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf734b-f37b-4ab1-92f7-ab991c50a5c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:48:19.274892 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf734b-f37b-4ab1-92f7-ab991c50a5c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:48:19.276336 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf734b-f37b-4ab1-92f7-ab991c50a5c4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:48:19.303728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 653/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:48:19 2022] POST /identity/v3/endpoints => generated 331 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:48:29.104099 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=30 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:48:29.295074 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:22.992739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f690e-c1fc-4055-84ec-099b812e4a66 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:22.993849 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f690e-c1fc-4055-84ec-099b812e4a66 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:22.994336 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f690e-c1fc-4055-84ec-099b812e4a66 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:23.001628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4346939-4432-44b1-ac66-2aec1b1ebd16 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:23.002757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4346939-4432-44b1-ac66-2aec1b1ebd16 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:23.003237 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4346939-4432-44b1-ac66-2aec1b1ebd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:23.008884 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 654/1307] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:49:22 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:49:23.165853 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b4346939-4432-44b1-ac66-2aec1b1ebd16 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:23.167422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b4346939-4432-44b1-ac66-2aec1b1ebd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:23.323385 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 654/1308] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:49:23.603592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19597c87-faea-42b5-b336-b8dc89923be1 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:23.604233 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19597c87-faea-42b5-b336-b8dc89923be1 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:23.604892 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19597c87-faea-42b5-b336-b8dc89923be1 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:23.606881 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 655/1309] 10.222.0.27 () {54 vars in 965 bytes} [Tue Aug 30 11:49:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:49:23.612533 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840a702-7eda-4a0b-975e-117bfd2460fd None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:23.612814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840a702-7eda-4a0b-975e-117bfd2460fd None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:23.613091 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840a702-7eda-4a0b-975e-117bfd2460fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:23.699775 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5840a702-7eda-4a0b-975e-117bfd2460fd None None] MFA Rules not processed for user `f3be96d37b4e4dd889be755b004bfe52`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:23.701206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5840a702-7eda-4a0b-975e-117bfd2460fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:23.725539 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:23.787967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 655/1310] 10.222.0.27 () {58 vars in 1062 bytes} [Tue Aug 30 11:49:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:23.796646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19597c87-faea-42b5-b336-b8dc89923be1 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:23.798708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-19597c87-faea-42b5-b336-b8dc89923be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:23.937077 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19597c87-faea-42b5-b336-b8dc89923be1 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:24.030803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2350e-7bfe-44b9-904d-a4cf932cf20a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:24.031476 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2350e-7bfe-44b9-904d-a4cf932cf20a service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:24.031762 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2350e-7bfe-44b9-904d-a4cf932cf20a service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:24.032040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2350e-7bfe-44b9-904d-a4cf932cf20a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:24.033663 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8ad2350e-7bfe-44b9-904d-a4cf932cf20a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:24.096247 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:24.157843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2350e-7bfe-44b9-904d-a4cf932cf20a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:24.159317 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2350e-7bfe-44b9-904d-a4cf932cf20a service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:24.180253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 656/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:26.404548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84fec2-2967-450e-ad8d-58c486354498 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:26.405091 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84fec2-2967-450e-ad8d-58c486354498 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:26.405091 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84fec2-2967-450e-ad8d-58c486354498 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:26.406419 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 656/1312] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:49:26.412312 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c250e21-ef09-4105-89d1-96e0ccf2c90c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:26.412858 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c250e21-ef09-4105-89d1-96e0ccf2c90c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:26.412858 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c250e21-ef09-4105-89d1-96e0ccf2c90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:26.491333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2c250e21-ef09-4105-89d1-96e0ccf2c90c None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:26.492545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2c250e21-ef09-4105-89d1-96e0ccf2c90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:26.593991 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 657/1313] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:26.878075 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84fec2-2967-450e-ad8d-58c486354498 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:26.879626 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-af84fec2-2967-450e-ad8d-58c486354498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:26.989430 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84fec2-2967-450e-ad8d-58c486354498 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:27.067018 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:27.069727 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7960a9e-c8d3-4347-859b-5f5e015639f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:27.070301 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7960a9e-c8d3-4347-859b-5f5e015639f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:27.070585 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7960a9e-c8d3-4347-859b-5f5e015639f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:27.071262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7960a9e-c8d3-4347-859b-5f5e015639f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:27.073292 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d7960a9e-c8d3-4347-859b-5f5e015639f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:27.193942 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7960a9e-c8d3-4347-859b-5f5e015639f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:27.195397 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7960a9e-c8d3-4347-859b-5f5e015639f0 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:27.216675 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 657/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:49:29.447542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fc80d-445c-4ede-a362-34f9f2fa9bfc None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:29.448374 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fc80d-445c-4ede-a362-34f9f2fa9bfc None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:29.448374 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fc80d-445c-4ede-a362-34f9f2fa9bfc None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:29.450434 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 658/1315] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:49:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:49:29.459665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc9faa-bed8-4fcd-bb58-8c2b73a1334c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:29.460108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc9faa-bed8-4fcd-bb58-8c2b73a1334c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:29.460232 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc9faa-bed8-4fcd-bb58-8c2b73a1334c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:29.538370 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c2cc9faa-bed8-4fcd-bb58-8c2b73a1334c None None] MFA Rules not processed for user `69abfe9255ec4f2e97b3d7b9e1433201`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:29.539606 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c2cc9faa-bed8-4fcd-bb58-8c2b73a1334c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:29.592278 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:29.639107 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 658/1316] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:49:29 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:29.924367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fc80d-445c-4ede-a362-34f9f2fa9bfc None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:29.925877 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0f7fc80d-445c-4ede-a362-34f9f2fa9bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:29.936502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:30.045299 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fc80d-445c-4ede-a362-34f9f2fa9bfc None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:30.136818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8cb66-ee51-4d8e-a156-82f67dab599b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:30.137451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8cb66-ee51-4d8e-a156-82f67dab599b service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:30.137726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8cb66-ee51-4d8e-a156-82f67dab599b service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:30.137992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8cb66-ee51-4d8e-a156-82f67dab599b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:30.139608 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f0d8cb66-ee51-4d8e-a156-82f67dab599b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:30.214714 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:30.267123 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8cb66-ee51-4d8e-a156-82f67dab599b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:30.268615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8cb66-ee51-4d8e-a156-82f67dab599b service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:30.287501 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 659/1317] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:29 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:49:32.725616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fd950-a856-4d3e-8a13-714746592bd3 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:32.726145 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fd950-a856-4d3e-8a13-714746592bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:32.726243 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fd950-a856-4d3e-8a13-714746592bd3 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:32.728389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 659/1318] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:49:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:49:32.737422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23628a4-0c28-48e9-8603-f681d7c3f7f3 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:32.738159 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23628a4-0c28-48e9-8603-f681d7c3f7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:32.738339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23628a4-0c28-48e9-8603-f681d7c3f7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:32.820633 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-b23628a4-0c28-48e9-8603-f681d7c3f7f3 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:32.821842 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b23628a4-0c28-48e9-8603-f681d7c3f7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:32.925295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 660/1319] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:49:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:33.208431 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fd950-a856-4d3e-8a13-714746592bd3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:33.210934 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-050fd950-a856-4d3e-8a13-714746592bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:33.335803 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fd950-a856-4d3e-8a13-714746592bd3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:33.420290 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8da952-0637-4f01-b339-b89a573aa762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:33.420817 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8da952-0637-4f01-b339-b89a573aa762 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:33.421094 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8da952-0637-4f01-b339-b89a573aa762 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:33.421361 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8da952-0637-4f01-b339-b89a573aa762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:33.422946 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7d8da952-0637-4f01-b339-b89a573aa762 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:33.430985 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:33.543397 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8da952-0637-4f01-b339-b89a573aa762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:33.544861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8da952-0637-4f01-b339-b89a573aa762 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:33.563311 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 660/1320] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:36.092356 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425bec6-2822-4631-898f-5fc410509c13 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:36.092957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425bec6-2822-4631-898f-5fc410509c13 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:36.092957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425bec6-2822-4631-898f-5fc410509c13 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:36.094278 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 661/1321] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:49:36.100027 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ad506-eb3f-403b-9251-f1e9d91b7376 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:36.100484 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ad506-eb3f-403b-9251-f1e9d91b7376 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:36.100585 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ad506-eb3f-403b-9251-f1e9d91b7376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:36.173851 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-da2ad506-eb3f-403b-9251-f1e9d91b7376 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:36.175070 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-da2ad506-eb3f-403b-9251-f1e9d91b7376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:36.235255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:36.276621 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 661/1322] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:36.555075 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425bec6-2822-4631-898f-5fc410509c13 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:36.556697 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7425bec6-2822-4631-898f-5fc410509c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:36.578330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:36.669829 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425bec6-2822-4631-898f-5fc410509c13 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:36.749045 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1dfe2-fa84-47c5-ad40-6a2c230a7dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:36.749666 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1dfe2-fa84-47c5-ad40-6a2c230a7dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:36.749944 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1dfe2-fa84-47c5-ad40-6a2c230a7dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:36.750212 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1dfe2-fa84-47c5-ad40-6a2c230a7dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:36.751848 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f2f1dfe2-fa84-47c5-ad40-6a2c230a7dc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:36.830530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:36.871555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1dfe2-fa84-47c5-ad40-6a2c230a7dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:36.873021 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1dfe2-fa84-47c5-ad40-6a2c230a7dc3 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:36.891436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 662/1323] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:38.865056 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b46f0-3c43-4b0f-87e4-676726e9034e None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:38.865625 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b46f0-3c43-4b0f-87e4-676726e9034e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:38.865625 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b46f0-3c43-4b0f-87e4-676726e9034e None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:38.866829 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 662/1324] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:49:38.872211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de333e8f-ecb1-4eac-b28f-ef14503a6cfa None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:38.872638 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de333e8f-ecb1-4eac-b28f-ef14503a6cfa None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:38.872749 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de333e8f-ecb1-4eac-b28f-ef14503a6cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:38.942030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-de333e8f-ecb1-4eac-b28f-ef14503a6cfa None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:38.943266 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-de333e8f-ecb1-4eac-b28f-ef14503a6cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:39.049857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 663/1325] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:39.348356 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443bf2d-28d8-40fb-b2ec-af33b3cc1866 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:39.348685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443bf2d-28d8-40fb-b2ec-af33b3cc1866 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:39.348958 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443bf2d-28d8-40fb-b2ec-af33b3cc1866 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:39.350335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 663/1326] 10.222.0.27 () {54 vars in 965 bytes} [Tue Aug 30 11:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:49:39.356566 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad86c7-d4f5-4739-ae30-7525b5e1b44f None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:39.356857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad86c7-d4f5-4739-ae30-7525b5e1b44f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:39.357130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad86c7-d4f5-4739-ae30-7525b5e1b44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:39.389931 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:39.447107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-35ad86c7-d4f5-4739-ae30-7525b5e1b44f None None] MFA Rules not processed for user `f3be96d37b4e4dd889be755b004bfe52`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:39.448374 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-35ad86c7-d4f5-4739-ae30-7525b5e1b44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:39.529391 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 664/1327] 10.222.0.27 () {58 vars in 1062 bytes} [Tue Aug 30 11:49:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:39.538552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443bf2d-28d8-40fb-b2ec-af33b3cc1866 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:39.540109 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b443bf2d-28d8-40fb-b2ec-af33b3cc1866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:39.650288 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443bf2d-28d8-40fb-b2ec-af33b3cc1866 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:39.726023 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc702c-36fa-4529-ad02-8766b5eb22eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:39.726517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc702c-36fa-4529-ad02-8766b5eb22eb service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:39.726795 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc702c-36fa-4529-ad02-8766b5eb22eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:39.727026 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc702c-36fa-4529-ad02-8766b5eb22eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:39.728666 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6afc702c-36fa-4529-ad02-8766b5eb22eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:39.745837 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:39.843989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc702c-36fa-4529-ad02-8766b5eb22eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:39.845459 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc702c-36fa-4529-ad02-8766b5eb22eb service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:39.865068 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 664/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:42.028747 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d67d8-2b23-4b99-a9b6-373aca4f56e7 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:42.029348 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d67d8-2b23-4b99-a9b6-373aca4f56e7 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:42.029348 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d67d8-2b23-4b99-a9b6-373aca4f56e7 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:42.030609 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 665/1329] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:49:42.036551 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27fb83-8e3d-4eb5-a50c-615021c74adc None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:42.037161 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27fb83-8e3d-4eb5-a50c-615021c74adc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:42.037161 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27fb83-8e3d-4eb5-a50c-615021c74adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:42.109832 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ee27fb83-8e3d-4eb5-a50c-615021c74adc None None] MFA Rules not processed for user `69abfe9255ec4f2e97b3d7b9e1433201`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:42.111056 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ee27fb83-8e3d-4eb5-a50c-615021c74adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:42.175178 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:42.212317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 665/1330] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:49:42 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:42.497274 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d67d8-2b23-4b99-a9b6-373aca4f56e7 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:42.498809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ad4d67d8-2b23-4b99-a9b6-373aca4f56e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:42.611856 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d67d8-2b23-4b99-a9b6-373aca4f56e7 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:42.635425 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:42.693596 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f608d-132f-463f-b969-6dc20997e82e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:42.694696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f608d-132f-463f-b969-6dc20997e82e service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:42.695072 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f608d-132f-463f-b969-6dc20997e82e service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:42.695439 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f608d-132f-463f-b969-6dc20997e82e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:42.697208 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d07f608d-132f-463f-b969-6dc20997e82e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:42.822442 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f608d-132f-463f-b969-6dc20997e82e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:42.824059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f608d-132f-463f-b969-6dc20997e82e service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:42.847974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 666/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:42 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:49:45.174516 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a109702-8e83-4134-b49d-eef3b0c92cf9 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:45.175120 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a109702-8e83-4134-b49d-eef3b0c92cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:45.175120 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a109702-8e83-4134-b49d-eef3b0c92cf9 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:45.176624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 666/1332] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:49:45.182917 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb0741-03f4-471b-ac1f-4114464b13ac None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:45.183663 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb0741-03f4-471b-ac1f-4114464b13ac None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:45.183845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb0741-03f4-471b-ac1f-4114464b13ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:45.253427 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:45.256385 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-adeb0741-03f4-471b-ac1f-4114464b13ac None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:45.258279 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-adeb0741-03f4-471b-ac1f-4114464b13ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:45.370661 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 667/1333] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:45.657872 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a109702-8e83-4134-b49d-eef3b0c92cf9 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:45.659476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0a109702-8e83-4134-b49d-eef3b0c92cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:45.770570 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a109702-8e83-4134-b49d-eef3b0c92cf9 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:45.850013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556b22a-689c-4c67-bb72-013158ac2466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:45.850622 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556b22a-689c-4c67-bb72-013158ac2466 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:45.850900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556b22a-689c-4c67-bb72-013158ac2466 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:45.851171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556b22a-689c-4c67-bb72-013158ac2466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:45.852765 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8556b22a-689c-4c67-bb72-013158ac2466 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:45.880925 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:45.966422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556b22a-689c-4c67-bb72-013158ac2466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:45.967815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556b22a-689c-4c67-bb72-013158ac2466 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:45.987788 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 667/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:47.916287 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4390aa-a237-4c1f-bd17-a1ac95066a84 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:47.916872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4390aa-a237-4c1f-bd17-a1ac95066a84 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:47.916872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4390aa-a237-4c1f-bd17-a1ac95066a84 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:47.919058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 668/1335] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:49:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:49:47.926837 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a6187-1f7c-4db0-9606-c83711e2326e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:47.927217 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a6187-1f7c-4db0-9606-c83711e2326e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:47.927458 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a6187-1f7c-4db0-9606-c83711e2326e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:47.995467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d19a6187-1f7c-4db0-9606-c83711e2326e None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:47.996688 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d19a6187-1f7c-4db0-9606-c83711e2326e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:48.078928 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:48.103625 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 668/1336] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:48.398787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4390aa-a237-4c1f-bd17-a1ac95066a84 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:48.401322 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-fc4390aa-a237-4c1f-bd17-a1ac95066a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:48.521293 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4390aa-a237-4c1f-bd17-a1ac95066a84 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:48.557077 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:48.606904 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f81b39-5b9f-4f65-b246-56ec77c43416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:48.607535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f81b39-5b9f-4f65-b246-56ec77c43416 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:48.607811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f81b39-5b9f-4f65-b246-56ec77c43416 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:48.608072 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f81b39-5b9f-4f65-b246-56ec77c43416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:48.609647 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-88f81b39-5b9f-4f65-b246-56ec77c43416 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:48.724098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f81b39-5b9f-4f65-b246-56ec77c43416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:48.725565 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f81b39-5b9f-4f65-b246-56ec77c43416 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:48.743939 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 669/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:50.980984 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5665f4d-c3f8-4052-a92a-bee87efed7f3 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:50.981788 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5665f4d-c3f8-4052-a92a-bee87efed7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:50.981788 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5665f4d-c3f8-4052-a92a-bee87efed7f3 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:50.983908 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 669/1338] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:49:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:49:50.990886 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0337fec-d98a-4211-92cb-a884f2110e3f None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:50.991314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0337fec-d98a-4211-92cb-a884f2110e3f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:50.991431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0337fec-d98a-4211-92cb-a884f2110e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:51.063066 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-c0337fec-d98a-4211-92cb-a884f2110e3f None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:51.064292 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c0337fec-d98a-4211-92cb-a884f2110e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:51.073680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:51.163691 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 670/1339] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:49:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:49:51.441226 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5665f4d-c3f8-4052-a92a-bee87efed7f3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:51.444018 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a5665f4d-c3f8-4052-a92a-bee87efed7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:51.564602 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5665f4d-c3f8-4052-a92a-bee87efed7f3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:51.646540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906bb7e-f622-4cbb-8c82-23c9c7d53bd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:51.647156 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906bb7e-f622-4cbb-8c82-23c9c7d53bd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:51.647456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906bb7e-f622-4cbb-8c82-23c9c7d53bd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:51.647723 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906bb7e-f622-4cbb-8c82-23c9c7d53bd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:51.649313 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1906bb7e-f622-4cbb-8c82-23c9c7d53bd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:51.695945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:51.778279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906bb7e-f622-4cbb-8c82-23c9c7d53bd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:51.779773 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906bb7e-f622-4cbb-8c82-23c9c7d53bd5 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:51.798420 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 670/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:55.714253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b93887-4cc3-4169-a4ea-e1cd51aae52f None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:55.714760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b93887-4cc3-4169-a4ea-e1cd51aae52f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:55.714871 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b93887-4cc3-4169-a4ea-e1cd51aae52f None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:55.717001 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 671/1341] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:49:55.722678 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c929bd-6181-4650-a77a-ca13839b502e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:55.723231 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c929bd-6181-4650-a77a-ca13839b502e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:55.723231 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c929bd-6181-4650-a77a-ca13839b502e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:55.792512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-37c929bd-6181-4650-a77a-ca13839b502e None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:55.793721 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-37c929bd-6181-4650-a77a-ca13839b502e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:55.882785 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:55.895030 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 671/1342] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:56.172382 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b93887-4cc3-4169-a4ea-e1cd51aae52f None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:56.173918 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c2b93887-4cc3-4169-a4ea-e1cd51aae52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:56.281778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b93887-4cc3-4169-a4ea-e1cd51aae52f None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:56.321759 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:56.361034 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59feed5d-d16b-44bc-81a8-273ab91925a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:56.361868 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59feed5d-d16b-44bc-81a8-273ab91925a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:56.362113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59feed5d-d16b-44bc-81a8-273ab91925a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:56.362461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59feed5d-d16b-44bc-81a8-273ab91925a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:56.364123 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-59feed5d-d16b-44bc-81a8-273ab91925a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:56.488752 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59feed5d-d16b-44bc-81a8-273ab91925a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:56.490187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59feed5d-d16b-44bc-81a8-273ab91925a2 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:56.508616 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 672/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:49:59.058070 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2c42b-40b4-4f88-ad6d-faceb7283e58 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:59.058561 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2c42b-40b4-4f88-ad6d-faceb7283e58 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:59.058669 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2c42b-40b4-4f88-ad6d-faceb7283e58 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:59.060034 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 672/1344] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:49:59.065672 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88b58a-3fc2-4237-ba85-ebfd7c3fad7c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:59.066146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88b58a-3fc2-4237-ba85-ebfd7c3fad7c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:59.066255 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88b58a-3fc2-4237-ba85-ebfd7c3fad7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:59.141062 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-4b88b58a-3fc2-4237-ba85-ebfd7c3fad7c None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:49:59.142280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4b88b58a-3fc2-4237-ba85-ebfd7c3fad7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:59.162365 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:59.249587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 673/1345] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:49:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:49:59.530465 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2c42b-40b4-4f88-ad6d-faceb7283e58 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:49:59.532353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b9b2c42b-40b4-4f88-ad6d-faceb7283e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:59.642884 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2c42b-40b4-4f88-ad6d-faceb7283e58 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:49:59.719106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7105024-a59f-4e01-a0bb-b46186ea5616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:49:59.719753 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7105024-a59f-4e01-a0bb-b46186ea5616 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:49:59.720028 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7105024-a59f-4e01-a0bb-b46186ea5616 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:49:59.720297 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7105024-a59f-4e01-a0bb-b46186ea5616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:49:59.722489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f7105024-a59f-4e01-a0bb-b46186ea5616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:49:59.772626 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:49:59.840584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7105024-a59f-4e01-a0bb-b46186ea5616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:49:59.842038 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7105024-a59f-4e01-a0bb-b46186ea5616 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:49:59.862656 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 673/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:49:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:04.148862 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fbecf-cc49-477e-a00c-6f8ac317b570 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:04.149520 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fbecf-cc49-477e-a00c-6f8ac317b570 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:04.149520 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fbecf-cc49-477e-a00c-6f8ac317b570 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:04.150760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 674/1347] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:50:04.156414 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50f69a-17d4-4015-9b85-60877610c6f7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:04.156961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50f69a-17d4-4015-9b85-60877610c6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:04.156961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50f69a-17d4-4015-9b85-60877610c6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:04.227888 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1b50f69a-17d4-4015-9b85-60877610c6f7 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:04.229131 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1b50f69a-17d4-4015-9b85-60877610c6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:04.332916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:04.339720 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 674/1348] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:04.616877 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fbecf-cc49-477e-a00c-6f8ac317b570 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:04.618416 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ea2fbecf-cc49-477e-a00c-6f8ac317b570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:04.733854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fbecf-cc49-477e-a00c-6f8ac317b570 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:04.785447 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:04.812438 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5a0c4-bf60-4967-ba82-614963e4364b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:04.813044 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5a0c4-bf60-4967-ba82-614963e4364b service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:04.813321 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5a0c4-bf60-4967-ba82-614963e4364b service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:04.813609 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5a0c4-bf60-4967-ba82-614963e4364b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:04.815433 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0ec5a0c4-bf60-4967-ba82-614963e4364b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:04.929516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5a0c4-bf60-4967-ba82-614963e4364b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:04.931058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5a0c4-bf60-4967-ba82-614963e4364b service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:04.950964 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 675/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:50:09.838238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677353df-daf3-4d16-b94d-56a57d0ebf8b None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:09.838686 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677353df-daf3-4d16-b94d-56a57d0ebf8b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:09.838788 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677353df-daf3-4d16-b94d-56a57d0ebf8b None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:09.841556 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 675/1350] 10.222.0.27 () {54 vars in 921 bytes} [Tue Aug 30 11:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:50:09.846271 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85d9bc-f2ef-4dfd-bbef-9fb0f7bfa583 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:09.846734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85d9bc-f2ef-4dfd-bbef-9fb0f7bfa583 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:09.847270 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85d9bc-f2ef-4dfd-bbef-9fb0f7bfa583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:09.998972 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-8d85d9bc-f2ef-4dfd-bbef-9fb0f7bfa583 None None] MFA Rules not processed for user `9efd2ac7fc4a42558e8dc48c408ce525`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:10.005463 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8d85d9bc-f2ef-4dfd-bbef-9fb0f7bfa583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:10.047917 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:10.163156 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 676/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Aug 30 11:50:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:14.219872 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fde40-a5d1-466a-992d-a4b5759dd6b7 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:14.220962 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fde40-a5d1-466a-992d-a4b5759dd6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:14.221317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fde40-a5d1-466a-992d-a4b5759dd6b7 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:14.222866 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 676/1352] 10.222.0.27 () {54 vars in 921 bytes} [Tue Aug 30 11:50:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:50:14.228129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c5791-906e-4426-b7d2-704d074c720c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:14.228556 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c5791-906e-4426-b7d2-704d074c720c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:14.228864 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c5791-906e-4426-b7d2-704d074c720c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:14.310083 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-151c5791-906e-4426-b7d2-704d074c720c None None] MFA Rules not processed for user `9efd2ac7fc4a42558e8dc48c408ce525`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:14.311391 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-151c5791-906e-4426-b7d2-704d074c720c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:14.388260 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:14.426529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 677/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Aug 30 11:50:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:15.823081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc4c13-eacd-4110-a9a2-4cb8a1422876 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:15.823659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc4c13-eacd-4110-a9a2-4cb8a1422876 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:15.823659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc4c13-eacd-4110-a9a2-4cb8a1422876 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:15.825051 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 677/1354] 10.222.0.27 () {54 vars in 921 bytes} [Tue Aug 30 11:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:50:15.830543 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80432f2f-382b-43a5-b79b-67e25d69614e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:15.830936 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80432f2f-382b-43a5-b79b-67e25d69614e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:15.831123 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80432f2f-382b-43a5-b79b-67e25d69614e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:15.911272 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-80432f2f-382b-43a5-b79b-67e25d69614e None None] MFA Rules not processed for user `9efd2ac7fc4a42558e8dc48c408ce525`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:15.912575 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-80432f2f-382b-43a5-b79b-67e25d69614e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:16.020691 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 678/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Aug 30 11:50:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:19.450939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23b7cd-3f17-4741-a34a-c09fdd402bec None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:19.451798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23b7cd-3f17-4741-a34a-c09fdd402bec None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:19.452228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23b7cd-3f17-4741-a34a-c09fdd402bec None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:19.454265 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 678/1356] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:50:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:50:19.459846 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6ad60-081c-4fd6-8161-19dcc757ab31 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:19.460350 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6ad60-081c-4fd6-8161-19dcc757ab31 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:19.460350 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6ad60-081c-4fd6-8161-19dcc757ab31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:19.505955 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:19.546177 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e9a6ad60-081c-4fd6-8161-19dcc757ab31 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:19.547815 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e9a6ad60-081c-4fd6-8161-19dcc757ab31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:19.664594 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 679/1357] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:19.966709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb1533-9a33-4932-a5a2-f98ef7c5b1d9 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:19.966998 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb1533-9a33-4932-a5a2-f98ef7c5b1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:19.967272 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb1533-9a33-4932-a5a2-f98ef7c5b1d9 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:19.968683 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 679/1358] 10.222.0.27 () {54 vars in 962 bytes} [Tue Aug 30 11:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:50:19.976298 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6d556-a94a-4e42-af8c-1357ee9ce764 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:19.976586 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6d556-a94a-4e42-af8c-1357ee9ce764 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:19.976857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6d556-a94a-4e42-af8c-1357ee9ce764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:20.062714 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-dcb6d556-a94a-4e42-af8c-1357ee9ce764 None None] MFA Rules not processed for user `8d17f1d0577a41ed8859706073f79d77`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:20.063839 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-dcb6d556-a94a-4e42-af8c-1357ee9ce764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:20.117293 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:20.189429 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 680/1359] 10.222.0.27 () {58 vars in 1059 bytes} [Tue Aug 30 11:50:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:20.198243 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb1533-9a33-4932-a5a2-f98ef7c5b1d9 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:20.199970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2ddb1533-9a33-4932-a5a2-f98ef7c5b1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:20.356613 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb1533-9a33-4932-a5a2-f98ef7c5b1d9 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:20.434628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:20.478195 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda57318-3e76-4fd5-83cc-74be9879d2f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:20.478899 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda57318-3e76-4fd5-83cc-74be9879d2f7 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:20.479062 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda57318-3e76-4fd5-83cc-74be9879d2f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:20.479340 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda57318-3e76-4fd5-83cc-74be9879d2f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:20.480932 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dda57318-3e76-4fd5-83cc-74be9879d2f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:20.579604 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda57318-3e76-4fd5-83cc-74be9879d2f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:20.581201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda57318-3e76-4fd5-83cc-74be9879d2f7 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:20.599981 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 680/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:50:22.712577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d9b7a-abd9-4695-9be0-ee723ea971c0 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:22.713092 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d9b7a-abd9-4695-9be0-ee723ea971c0 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:22.713598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d9b7a-abd9-4695-9be0-ee723ea971c0 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:22.715325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 681/1361] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:50:22.721623 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e5c11-7bfb-4ad5-a83f-b07aa9cf2d33 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:22.721623 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e5c11-7bfb-4ad5-a83f-b07aa9cf2d33 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:22.722060 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e5c11-7bfb-4ad5-a83f-b07aa9cf2d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:22.795871 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-445e5c11-7bfb-4ad5-a83f-b07aa9cf2d33 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:22.797069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-445e5c11-7bfb-4ad5-a83f-b07aa9cf2d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:22.837353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:22.903310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 681/1362] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:23.205010 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d9b7a-abd9-4695-9be0-ee723ea971c0 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:23.210124 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5b2d9b7a-abd9-4695-9be0-ee723ea971c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:23.374638 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d9b7a-abd9-4695-9be0-ee723ea971c0 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:23.384723 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:23.494874 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86207ebe-2856-4656-ac22-a5a5248a705b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:23.495599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86207ebe-2856-4656-ac22-a5a5248a705b service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:23.495880 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86207ebe-2856-4656-ac22-a5a5248a705b service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:23.496189 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86207ebe-2856-4656-ac22-a5a5248a705b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:23.497888 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-86207ebe-2856-4656-ac22-a5a5248a705b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:23.606998 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86207ebe-2856-4656-ac22-a5a5248a705b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:23.609154 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86207ebe-2856-4656-ac22-a5a5248a705b service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:23.630742 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 682/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:25.834534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53491708-108c-4569-ace8-6bc1b11ece45 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:25.835438 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53491708-108c-4569-ace8-6bc1b11ece45 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:25.835721 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53491708-108c-4569-ace8-6bc1b11ece45 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:25.837101 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 682/1364] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:50:25.844558 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6693c-060c-45fc-a582-46c73e4d66ea None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:25.845018 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6693c-060c-45fc-a582-46c73e4d66ea None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:25.845101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6693c-060c-45fc-a582-46c73e4d66ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:25.862696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:25.924421 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-dae6693c-060c-45fc-a582-46c73e4d66ea None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:25.925758 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-dae6693c-060c-45fc-a582-46c73e4d66ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:26.033997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 683/1365] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:26.323250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ff020-b217-4e73-8705-11cedbbb8447 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:26.323638 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ff020-b217-4e73-8705-11cedbbb8447 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:26.323795 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ff020-b217-4e73-8705-11cedbbb8447 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:26.325302 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 683/1366] 10.222.0.27 () {54 vars in 962 bytes} [Tue Aug 30 11:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:50:26.331377 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f7961-ba43-4a93-94a7-d5c85fb695fd None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:26.331888 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f7961-ba43-4a93-94a7-d5c85fb695fd None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:26.332278 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f7961-ba43-4a93-94a7-d5c85fb695fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:26.420857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-127f7961-ba43-4a93-94a7-d5c85fb695fd None None] MFA Rules not processed for user `8d17f1d0577a41ed8859706073f79d77`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:26.422184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-127f7961-ba43-4a93-94a7-d5c85fb695fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:26.460742 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:26.550708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 684/1367] 10.222.0.27 () {58 vars in 1059 bytes} [Tue Aug 30 11:50:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:26.558830 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ff020-b217-4e73-8705-11cedbbb8447 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:26.560462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e94ff020-b217-4e73-8705-11cedbbb8447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:26.728410 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ff020-b217-4e73-8705-11cedbbb8447 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:26.750532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:26.851499 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f081f-ddf4-4e70-a8c2-fc3604d11db0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:26.852158 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f081f-ddf4-4e70-a8c2-fc3604d11db0 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:26.852400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f081f-ddf4-4e70-a8c2-fc3604d11db0 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:26.852641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f081f-ddf4-4e70-a8c2-fc3604d11db0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:26.854203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-874f081f-ddf4-4e70-a8c2-fc3604d11db0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:26.946065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f081f-ddf4-4e70-a8c2-fc3604d11db0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:26.947927 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f081f-ddf4-4e70-a8c2-fc3604d11db0 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:26.968262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 684/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:27.666863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64478f-1159-41ab-b9ce-c49859699e16 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.667464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64478f-1159-41ab-b9ce-c49859699e16 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.667464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64478f-1159-41ab-b9ce-c49859699e16 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.668992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 685/1369] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:50:27.675048 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9f1ad-1fd9-4a24-adfb-cc981c4f2e59 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:27.675338 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9f1ad-1fd9-4a24-adfb-cc981c4f2e59 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:27.675643 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9f1ad-1fd9-4a24-adfb-cc981c4f2e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:27.714330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:27.757789 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3fa9f1ad-1fd9-4a24-adfb-cc981c4f2e59 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:27.759025 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3fa9f1ad-1fd9-4a24-adfb-cc981c4f2e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:27.869041 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 685/1370] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:28.465954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea576b64-d64e-47bc-8052-f3d0fee47615 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:28.466359 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea576b64-d64e-47bc-8052-f3d0fee47615 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:28.467036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea576b64-d64e-47bc-8052-f3d0fee47615 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:28.468530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 686/1371] 10.222.0.27 () {54 vars in 964 bytes} [Tue Aug 30 11:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:50:28.473569 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e29b1-3932-498e-897d-2ee3db7d71d6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:28.473857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e29b1-3932-498e-897d-2ee3db7d71d6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:28.474747 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e29b1-3932-498e-897d-2ee3db7d71d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:28.557766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-012e29b1-3932-498e-897d-2ee3db7d71d6 None None] MFA Rules not processed for user `b9bbec99965e4444bcf88a32502b3257`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:28.558977 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-012e29b1-3932-498e-897d-2ee3db7d71d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:28.613346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:28.651807 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 686/1372] 10.222.0.27 () {58 vars in 1061 bytes} [Tue Aug 30 11:50:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:28.662307 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea576b64-d64e-47bc-8052-f3d0fee47615 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:28.664926 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ea576b64-d64e-47bc-8052-f3d0fee47615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:28.820313 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea576b64-d64e-47bc-8052-f3d0fee47615 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:28.868549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:28.910598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe67389-e2c2-45db-8d48-c26b7e20cff0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:28.910598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe67389-e2c2-45db-8d48-c26b7e20cff0 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:28.910598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe67389-e2c2-45db-8d48-c26b7e20cff0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:28.911536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe67389-e2c2-45db-8d48-c26b7e20cff0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:28.912463 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3fe67389-e2c2-45db-8d48-c26b7e20cff0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:28.936874 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984b8e7-93ed-4b27-9022-e4fdedcfa5e6 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:28.936874 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984b8e7-93ed-4b27-9022-e4fdedcfa5e6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:28.937649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984b8e7-93ed-4b27-9022-e4fdedcfa5e6 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:28.945409 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 687/1373] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:50:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:50:28.950146 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204751c-2099-447b-8a67-db28b877f5e9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:28.950597 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204751c-2099-447b-8a67-db28b877f5e9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:28.950875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204751c-2099-447b-8a67-db28b877f5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:29.035306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a204751c-2099-447b-8a67-db28b877f5e9 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:29.036840 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a204751c-2099-447b-8a67-db28b877f5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:29.047339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe67389-e2c2-45db-8d48-c26b7e20cff0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:29.050329 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe67389-e2c2-45db-8d48-c26b7e20cff0 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:29.073223 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 687/1374] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:29.171417 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 688/1375] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:29.504483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe67389-e2c2-45db-8d48-c26b7e20cff0 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:29.505700 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3fe67389-e2c2-45db-8d48-c26b7e20cff0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:29.578572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:29.613070 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe67389-e2c2-45db-8d48-c26b7e20cff0 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:29.732362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47626e-d3fd-4813-806c-f0eef9839294 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:29.732948 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47626e-d3fd-4813-806c-f0eef9839294 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:29.733224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47626e-d3fd-4813-806c-f0eef9839294 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:29.733640 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47626e-d3fd-4813-806c-f0eef9839294 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:29.735343 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8d47626e-d3fd-4813-806c-f0eef9839294 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:29.821108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:29.832000 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47626e-d3fd-4813-806c-f0eef9839294 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:29.833622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47626e-d3fd-4813-806c-f0eef9839294 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:29.852824 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 688/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:31.774831 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b233f-b740-41c9-b19f-116b3905b1dc None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:31.775398 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b233f-b740-41c9-b19f-116b3905b1dc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:31.775398 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b233f-b740-41c9-b19f-116b3905b1dc None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:31.776725 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 689/1377] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:50:31.782453 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7d7de-1ac4-418f-8587-7bdc85ed1296 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:31.782861 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7d7de-1ac4-418f-8587-7bdc85ed1296 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:31.782978 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7d7de-1ac4-418f-8587-7bdc85ed1296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:31.852394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d5d7d7de-1ac4-418f-8587-7bdc85ed1296 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:31.853589 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d5d7d7de-1ac4-418f-8587-7bdc85ed1296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:31.960226 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 689/1378] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:32.243316 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b233f-b740-41c9-b19f-116b3905b1dc None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:32.245050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-783b233f-b740-41c9-b19f-116b3905b1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:32.300274 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:32.397135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b233f-b740-41c9-b19f-116b3905b1dc None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:32.540251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b32584-5792-49fa-a230-973e2f8e51da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:32.540960 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b32584-5792-49fa-a230-973e2f8e51da service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:32.541470 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b32584-5792-49fa-a230-973e2f8e51da service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:32.541846 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b32584-5792-49fa-a230-973e2f8e51da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:32.543696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-57b32584-5792-49fa-a230-973e2f8e51da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:32.558370 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:32.648103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b32584-5792-49fa-a230-973e2f8e51da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:32.649740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b32584-5792-49fa-a230-973e2f8e51da service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:32.675202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 690/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:34.655148 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb95ea-c870-4621-86ac-b05319e3decc None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:34.655932 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb95ea-c870-4621-86ac-b05319e3decc None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:34.656169 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb95ea-c870-4621-86ac-b05319e3decc None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:34.657734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 690/1380] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:50:34.663061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19599bd3-ae9a-4ed8-baf9-b8edc2469a25 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:34.663569 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19599bd3-ae9a-4ed8-baf9-b8edc2469a25 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:34.663664 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19599bd3-ae9a-4ed8-baf9-b8edc2469a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:34.739557 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-19599bd3-ae9a-4ed8-baf9-b8edc2469a25 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:34.740822 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-19599bd3-ae9a-4ed8-baf9-b8edc2469a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:34.847984 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:34.868237 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 691/1381] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:35.154889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb95ea-c870-4621-86ac-b05319e3decc None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:35.156686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1fcb95ea-c870-4621-86ac-b05319e3decc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:35.224224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:35.313859 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb95ea-c870-4621-86ac-b05319e3decc None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:35.449905 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1b725-dbc8-4d78-be15-c47b5edccd3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:35.450856 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1b725-dbc8-4d78-be15-c47b5edccd3d service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:35.451119 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1b725-dbc8-4d78-be15-c47b5edccd3d service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:35.451401 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1b725-dbc8-4d78-be15-c47b5edccd3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:35.453262 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-89d1b725-dbc8-4d78-be15-c47b5edccd3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:35.479429 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:35.555895 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1b725-dbc8-4d78-be15-c47b5edccd3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:35.557505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1b725-dbc8-4d78-be15-c47b5edccd3d service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:35.578504 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 691/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:37.576085 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb651edb-08ec-491d-99f1-befe6752fc0e None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:37.576800 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb651edb-08ec-491d-99f1-befe6752fc0e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:37.577188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb651edb-08ec-491d-99f1-befe6752fc0e None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:37.579857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 692/1383] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:50:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:50:37.587870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79face-51e8-46f4-b419-7ecc627774fc None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:37.588383 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79face-51e8-46f4-b419-7ecc627774fc None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:37.588482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79face-51e8-46f4-b419-7ecc627774fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:37.661132 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-ff79face-51e8-46f4-b419-7ecc627774fc None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:37.662439 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ff79face-51e8-46f4-b419-7ecc627774fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:37.768275 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:37.772377 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 692/1384] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:38.068675 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb651edb-08ec-491d-99f1-befe6752fc0e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:38.070401 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bb651edb-08ec-491d-99f1-befe6752fc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:38.237601 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb651edb-08ec-491d-99f1-befe6752fc0e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:38.321124 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:38.376860 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30370dcb-3e02-47b1-9c93-b173ff8a3e62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:38.377645 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30370dcb-3e02-47b1-9c93-b173ff8a3e62 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:38.377961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30370dcb-3e02-47b1-9c93-b173ff8a3e62 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:38.378324 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30370dcb-3e02-47b1-9c93-b173ff8a3e62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:38.380360 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-30370dcb-3e02-47b1-9c93-b173ff8a3e62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:38.480081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30370dcb-3e02-47b1-9c93-b173ff8a3e62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:38.482509 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30370dcb-3e02-47b1-9c93-b173ff8a3e62 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:38.507263 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 693/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:40.978358 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035d65c-933e-402d-8275-7d5d77ec677a None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:40.978970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035d65c-933e-402d-8275-7d5d77ec677a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:40.979073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035d65c-933e-402d-8275-7d5d77ec677a None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:40.981262 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 693/1386] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:50:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:50:40.988773 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb4473-f431-43be-af48-0de4e1936c9f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:40.989305 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb4473-f431-43be-af48-0de4e1936c9f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:40.989436 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb4473-f431-43be-af48-0de4e1936c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:41.079053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a5bb4473-f431-43be-af48-0de4e1936c9f None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:41.080655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a5bb4473-f431-43be-af48-0de4e1936c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:41.118923 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:41.206429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 694/1387] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:41.505391 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035d65c-933e-402d-8275-7d5d77ec677a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:41.509101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6035d65c-933e-402d-8275-7d5d77ec677a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:41.702770 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035d65c-933e-402d-8275-7d5d77ec677a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:41.778863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:41.827885 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4c7a2-4b22-4a25-9d35-ae645465bd82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:41.828610 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4c7a2-4b22-4a25-9d35-ae645465bd82 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:41.828940 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4c7a2-4b22-4a25-9d35-ae645465bd82 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:41.829215 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4c7a2-4b22-4a25-9d35-ae645465bd82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:41.830939 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-98f4c7a2-4b22-4a25-9d35-ae645465bd82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:41.938558 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4c7a2-4b22-4a25-9d35-ae645465bd82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:41.940611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4c7a2-4b22-4a25-9d35-ae645465bd82 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:41.960214 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 694/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:43.924306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9479d57-beb3-4f5c-b96a-d7bd6b6a406b None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:43.924941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9479d57-beb3-4f5c-b96a-d7bd6b6a406b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:43.924941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9479d57-beb3-4f5c-b96a-d7bd6b6a406b None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:43.926233 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 695/1389] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:50:43.931588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59098686-f409-465f-a21a-d684e4ddc7de None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:43.932070 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59098686-f409-465f-a21a-d684e4ddc7de None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:43.932176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59098686-f409-465f-a21a-d684e4ddc7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:43.939415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e59dd0-7172-4e14-92be-1c71ab8c195b None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:43.939688 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e59dd0-7172-4e14-92be-1c71ab8c195b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:43.939952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e59dd0-7172-4e14-92be-1c71ab8c195b None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:43.941435 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 696/1390] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:50:43.946344 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076126af-9596-42a7-91a7-7a2f441b82a1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:43.946608 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076126af-9596-42a7-91a7-7a2f441b82a1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:43.946868 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076126af-9596-42a7-91a7-7a2f441b82a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:44.000546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-59098686-f409-465f-a21a-d684e4ddc7de None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:44.001739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-59098686-f409-465f-a21a-d684e4ddc7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:44.013213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-076126af-9596-42a7-91a7-7a2f441b82a1 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:44.014398 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-076126af-9596-42a7-91a7-7a2f441b82a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:44.037368 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:44.103865 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 695/1391] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:44.125804 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 697/1392] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:44.391623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59098686-f409-465f-a21a-d684e4ddc7de None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:44.393143 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-59098686-f409-465f-a21a-d684e4ddc7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:44.421228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e46c8f-a776-4f8d-8308-8b856bae7e18 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:44.421516 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e46c8f-a776-4f8d-8308-8b856bae7e18 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:44.421791 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e46c8f-a776-4f8d-8308-8b856bae7e18 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:44.423247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 698/1393] 10.222.0.27 () {54 vars in 967 bytes} [Tue Aug 30 11:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:50:44.427962 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c538ae7-86cb-47fa-b54c-9180a10312c0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:44.428241 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c538ae7-86cb-47fa-b54c-9180a10312c0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:44.428510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c538ae7-86cb-47fa-b54c-9180a10312c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:44.438904 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:44.509462 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59098686-f409-465f-a21a-d684e4ddc7de None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:44.509921 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1c538ae7-86cb-47fa-b54c-9180a10312c0 None None] MFA Rules not processed for user `c6682c22be8c4bdca4be33a93e802409`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:44.511125 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1c538ae7-86cb-47fa-b54c-9180a10312c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:44.564930 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:44.588188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 699/1394] 10.222.0.27 () {58 vars in 1064 bytes} [Tue Aug 30 11:50:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:50:44.596500 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c538ae7-86cb-47fa-b54c-9180a10312c0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:44.603840 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c538ae7-86cb-47fa-b54c-9180a10312c0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:44.629066 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66fa3b-8787-4c18-ab39-abdb857c88a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:44.629596 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66fa3b-8787-4c18-ab39-abdb857c88a0 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:44.629871 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66fa3b-8787-4c18-ab39-abdb857c88a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:44.630139 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66fa3b-8787-4c18-ab39-abdb857c88a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:44.631771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-fb66fa3b-8787-4c18-ab39-abdb857c88a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:44.679240 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a687707-39fb-4685-96c4-747c74e3ef63 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6682c22be8c4bdca4be33a93e802409', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:44.679878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a687707-39fb-4685-96c4-747c74e3ef63 service glance] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:44.680152 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a687707-39fb-4685-96c4-747c74e3ef63 service glance] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:44.680427 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a687707-39fb-4685-96c4-747c74e3ef63 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:44.681990 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2a687707-39fb-4685-96c4-747c74e3ef63 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:44.704426 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:44.725453 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66fa3b-8787-4c18-ab39-abdb857c88a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:44.727330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66fa3b-8787-4c18-ab39-abdb857c88a0 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:44.746965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 696/1395] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:44.794426 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a687707-39fb-4685-96c4-747c74e3ef63 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:44.796018 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a687707-39fb-4685-96c4-747c74e3ef63 service glance] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:44.816713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 700/1396] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:50:45.575507 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3cfb4-c8a3-469c-8054-2d85f75e6c16 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:45.576066 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3cfb4-c8a3-469c-8054-2d85f75e6c16 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:45.576066 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3cfb4-c8a3-469c-8054-2d85f75e6c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:45.647239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2ab3cfb4-c8a3-469c-8054-2d85f75e6c16 None None] MFA Rules not processed for user `58c86110ce97463e9b3d53691ae3e12c`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:45.648811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2ab3cfb4-c8a3-469c-8054-2d85f75e6c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:45.656244 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:45.742181 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 697/1397] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Aug 30 11:50:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:45.784111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af37fa1-08c4-4bc4-9bca-39a839ab410e None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:45.784596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af37fa1-08c4-4bc4-9bca-39a839ab410e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:45.784688 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af37fa1-08c4-4bc4-9bca-39a839ab410e None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:45.785999 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 701/1398] 10.222.0.27 () {54 vars in 943 bytes} [Tue Aug 30 11:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:50:45.792207 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5a361-0ddb-40a9-9874-082dd521bc47 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:45.792489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5a361-0ddb-40a9-9874-082dd521bc47 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:45.792759 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5a361-0ddb-40a9-9874-082dd521bc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:45.873941 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f9f5a361-0ddb-40a9-9874-082dd521bc47 None None] MFA Rules not processed for user `8d27bfb8c0b64763b7db7cffa5f230f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:45.875209 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f9f5a361-0ddb-40a9-9874-082dd521bc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:45.962192 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:45.989185 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 698/1399] 10.222.0.27 () {58 vars in 1040 bytes} [Tue Aug 30 11:50:45 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:45.998674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af37fa1-08c4-4bc4-9bca-39a839ab410e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:46.000350 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4af37fa1-08c4-4bc4-9bca-39a839ab410e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:46.137062 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:46.149105 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af37fa1-08c4-4bc4-9bca-39a839ab410e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:46.256494 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fd2ac-2e0c-47a4-94bf-1ae30941e8d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d27bfb8c0b64763b7db7cffa5f230f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:46.257108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fd2ac-2e0c-47a4-94bf-1ae30941e8d6 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:46.257381 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fd2ac-2e0c-47a4-94bf-1ae30941e8d6 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:46.257660 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fd2ac-2e0c-47a4-94bf-1ae30941e8d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:46.259260 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1c0fd2ac-2e0c-47a4-94bf-1ae30941e8d6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:46.346232 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0fd2ac-2e0c-47a4-94bf-1ae30941e8d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:46.347842 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0fd2ac-2e0c-47a4-94bf-1ae30941e8d6 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:46.356245 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 702/1400] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Aug 30 11:50:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 11:50:46.693515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712a396-e1cc-4062-a310-83f61040472d None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:46.694065 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712a396-e1cc-4062-a310-83f61040472d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:46.694238 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712a396-e1cc-4062-a310-83f61040472d None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:46.699572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 699/1401] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:50:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:50:46.701593 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd6b09-b510-447c-a35b-d790bec3d49b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:46.702112 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd6b09-b510-447c-a35b-d790bec3d49b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:46.702517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd6b09-b510-447c-a35b-d790bec3d49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:46.754104 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:46.799275 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b7cd6b09-b510-447c-a35b-d790bec3d49b None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:46.800501 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b7cd6b09-b510-447c-a35b-d790bec3d49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:46.906277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 703/1402] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:47.197812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712a396-e1cc-4062-a310-83f61040472d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:47.199462 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5712a396-e1cc-4062-a310-83f61040472d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:47.364851 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712a396-e1cc-4062-a310-83f61040472d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:47.430688 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:47.495573 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb46f7-10af-431d-9038-985722764cab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:47.496203 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb46f7-10af-431d-9038-985722764cab service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:47.496470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb46f7-10af-431d-9038-985722764cab service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:47.496748 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb46f7-10af-431d-9038-985722764cab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:47.498588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f9bb46f7-10af-431d-9038-985722764cab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:47.602998 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb46f7-10af-431d-9038-985722764cab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:47.604663 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb46f7-10af-431d-9038-985722764cab service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:47.629130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 700/1403] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:49.594577 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8055d68-bd84-489e-9ddd-cdd04dccb779 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:49.595250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8055d68-bd84-489e-9ddd-cdd04dccb779 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:49.595250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8055d68-bd84-489e-9ddd-cdd04dccb779 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:49.596786 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 704/1404] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:50:49.601796 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037ce10-2adc-4404-bf44-9d735cf15dba None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:49.602225 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037ce10-2adc-4404-bf44-9d735cf15dba None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:49.602335 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037ce10-2adc-4404-bf44-9d735cf15dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:49.674823 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2037ce10-2adc-4404-bf44-9d735cf15dba None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:49.676094 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2037ce10-2adc-4404-bf44-9d735cf15dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:49.695980 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:49.795600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 701/1405] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:50.079115 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8055d68-bd84-489e-9ddd-cdd04dccb779 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:50.080926 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c8055d68-bd84-489e-9ddd-cdd04dccb779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:50.196405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:50.252205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8055d68-bd84-489e-9ddd-cdd04dccb779 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:50.375795 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37353d-d4ea-4321-becb-051c24a54a08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:50.376425 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37353d-d4ea-4321-becb-051c24a54a08 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:50.376847 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37353d-d4ea-4321-becb-051c24a54a08 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:50.377126 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37353d-d4ea-4321-becb-051c24a54a08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:50.378900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6a37353d-d4ea-4321-becb-051c24a54a08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:50.455691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:50.486783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37353d-d4ea-4321-becb-051c24a54a08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:50.488594 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37353d-d4ea-4321-becb-051c24a54a08 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:50.511808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 705/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:50:52.461223 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adff27-5c44-48bf-aab1-e3b2aa9f5e56 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:52.461769 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adff27-5c44-48bf-aab1-e3b2aa9f5e56 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:52.461769 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adff27-5c44-48bf-aab1-e3b2aa9f5e56 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:52.463301 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 702/1407] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:50:52.470258 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de8da7-812f-4b34-9863-a8caed5d4aaa None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:52.470777 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de8da7-812f-4b34-9863-a8caed5d4aaa None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:52.470869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de8da7-812f-4b34-9863-a8caed5d4aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:52.543613 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f3de8da7-812f-4b34-9863-a8caed5d4aaa None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:50:52.545248 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f3de8da7-812f-4b34-9863-a8caed5d4aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:52.655400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 706/1408] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:50:52.943572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adff27-5c44-48bf-aab1-e3b2aa9f5e56 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:50:52.945122 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-48adff27-5c44-48bf-aab1-e3b2aa9f5e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:53.114842 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:50:53.117286 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adff27-5c44-48bf-aab1-e3b2aa9f5e56 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:50:53.256562 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd751f-377d-47c0-a041-1fd2ce549f85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:50:53.257178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd751f-377d-47c0-a041-1fd2ce549f85 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:50:53.257450 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd751f-377d-47c0-a041-1fd2ce549f85 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:50:53.257719 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd751f-377d-47c0-a041-1fd2ce549f85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:50:53.259333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-02bd751f-377d-47c0-a041-1fd2ce549f85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:50:53.364549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd751f-377d-47c0-a041-1fd2ce549f85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:50:53.366036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd751f-377d-47c0-a041-1fd2ce549f85 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:50:53.387261 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 703/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:50:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:02.653292 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=82 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:03.384304 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:08.249850 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce25b6-d969-4609-be8b-96da0c535439 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:08.250454 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce25b6-d969-4609-be8b-96da0c535439 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:08.250454 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce25b6-d969-4609-be8b-96da0c535439 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:08.251790 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 707/1410] 10.222.0.27 () {54 vars in 918 bytes} [Tue Aug 30 11:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:51:08.257848 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881a4b2-111f-4d0e-9d4b-ec5e4a038711 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:08.258319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881a4b2-111f-4d0e-9d4b-ec5e4a038711 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:08.258521 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881a4b2-111f-4d0e-9d4b-ec5e4a038711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:08.338061 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e881a4b2-111f-4d0e-9d4b-ec5e4a038711 None None] MFA Rules not processed for user `9efd2ac7fc4a42558e8dc48c408ce525`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:08.339253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e881a4b2-111f-4d0e-9d4b-ec5e4a038711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:08.454596 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 704/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Tue Aug 30 11:51:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:08.473077 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bf392-1408-4413-87b1-778d66e98899 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:08.473360 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bf392-1408-4413-87b1-778d66e98899 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:08.473633 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bf392-1408-4413-87b1-778d66e98899 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:08.475030 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 708/1412] 10.222.0.27 () {54 vars in 918 bytes} [Tue Aug 30 11:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:51:08.479851 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddccf5b-33bb-4b8d-b574-5012c5890f88 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:08.480140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddccf5b-33bb-4b8d-b574-5012c5890f88 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:08.480413 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddccf5b-33bb-4b8d-b574-5012c5890f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:08.571804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:08.575125 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2ddccf5b-33bb-4b8d-b574-5012c5890f88 None None] MFA Rules not processed for user `8d17f1d0577a41ed8859706073f79d77`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:08.576830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2ddccf5b-33bb-4b8d-b574-5012c5890f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:08.706992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 705/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Tue Aug 30 11:51:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:11.081281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6d141-2372-488b-99d3-0275f6e5b6e5 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:11.082179 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6d141-2372-488b-99d3-0275f6e5b6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:11.082179 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6d141-2372-488b-99d3-0275f6e5b6e5 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:11.084531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:51:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:51:11.090876 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd409cd6-456e-45a0-9944-c24d33970696 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:11.091576 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd409cd6-456e-45a0-9944-c24d33970696 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:11.091849 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd409cd6-456e-45a0-9944-c24d33970696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:11.160916 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-bd409cd6-456e-45a0-9944-c24d33970696 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:11.162159 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bd409cd6-456e-45a0-9944-c24d33970696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:11.229416 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:11.274175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:11.561269 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6d141-2372-488b-99d3-0275f6e5b6e5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:11.564279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6dd6d141-2372-488b-99d3-0275f6e5b6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:11.721129 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6d141-2372-488b-99d3-0275f6e5b6e5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:11.796988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:11.841275 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a3f52-b85f-40ec-9fff-d1bb60fafd61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:11.841890 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a3f52-b85f-40ec-9fff-d1bb60fafd61 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:11.842161 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a3f52-b85f-40ec-9fff-d1bb60fafd61 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:11.842482 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a3f52-b85f-40ec-9fff-d1bb60fafd61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:11.844099 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b92a3f52-b85f-40ec-9fff-d1bb60fafd61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:11.944527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a3f52-b85f-40ec-9fff-d1bb60fafd61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:11.946155 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a3f52-b85f-40ec-9fff-d1bb60fafd61 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:11.965120 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 710/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:12.844509 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c789a5b-f9aa-42e3-a90e-2d6ef7af085f None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:12.845458 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c789a5b-f9aa-42e3-a90e-2d6ef7af085f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:12.845458 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c789a5b-f9aa-42e3-a90e-2d6ef7af085f None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:12.847627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:51:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:51:12.855742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dde43-0843-418e-9d6a-6b43130bbfb9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:12.856238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dde43-0843-418e-9d6a-6b43130bbfb9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:12.856354 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dde43-0843-418e-9d6a-6b43130bbfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:12.937234 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-870dde43-0843-418e-9d6a-6b43130bbfb9 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:12.938753 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-870dde43-0843-418e-9d6a-6b43130bbfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:12.971830 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:13.048527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:13.202316 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c789a5b-f9aa-42e3-a90e-2d6ef7af085f None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:13.204983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2c789a5b-f9aa-42e3-a90e-2d6ef7af085f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:13.369865 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c789a5b-f9aa-42e3-a90e-2d6ef7af085f None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:13.413043 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:13.491268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e62873-d8c9-4a3a-9a80-f3cb5918d760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:13.491892 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e62873-d8c9-4a3a-9a80-f3cb5918d760 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:13.492166 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e62873-d8c9-4a3a-9a80-f3cb5918d760 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:13.492435 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e62873-d8c9-4a3a-9a80-f3cb5918d760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:13.493999 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b8e62873-d8c9-4a3a-9a80-f3cb5918d760 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:13.592003 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e62873-d8c9-4a3a-9a80-f3cb5918d760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:13.593798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e62873-d8c9-4a3a-9a80-f3cb5918d760 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:13.611894 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 708/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:14.521418 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba47c6-ee7f-4daa-bdb5-8c9dd8c0bf5e None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:14.522295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba47c6-ee7f-4daa-bdb5-8c9dd8c0bf5e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:14.522295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba47c6-ee7f-4daa-bdb5-8c9dd8c0bf5e None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:14.524392 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:51:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:51:14.529782 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8abcdd-377e-46c3-ba13-d9252438fb3a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:14.530306 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8abcdd-377e-46c3-ba13-d9252438fb3a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:14.530306 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8abcdd-377e-46c3-ba13-d9252438fb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:14.589272 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:14.614833 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-de8abcdd-377e-46c3-ba13-d9252438fb3a None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:14.616086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-de8abcdd-377e-46c3-ba13-d9252438fb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:14.720219 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:14.873732 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba47c6-ee7f-4daa-bdb5-8c9dd8c0bf5e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:14.876103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-18ba47c6-ee7f-4daa-bdb5-8c9dd8c0bf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:15.043645 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba47c6-ee7f-4daa-bdb5-8c9dd8c0bf5e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:15.058966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:15.178637 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde617c-908a-44ad-a92e-9200b8db50f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:15.179175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde617c-908a-44ad-a92e-9200b8db50f8 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:15.179522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde617c-908a-44ad-a92e-9200b8db50f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:15.179828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde617c-908a-44ad-a92e-9200b8db50f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:15.182278 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8cde617c-908a-44ad-a92e-9200b8db50f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:15.282155 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde617c-908a-44ad-a92e-9200b8db50f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:15.283818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde617c-908a-44ad-a92e-9200b8db50f8 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:15.302426 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 713/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:16.166807 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e902a66-4ecc-4e71-97dc-4c414e6f951b None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:16.167410 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e902a66-4ecc-4e71-97dc-4c414e6f951b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:16.167530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e902a66-4ecc-4e71-97dc-4c414e6f951b None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:16.168886 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:51:16.174024 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b342fd9-004b-4171-a2ea-8879a1b222eb None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:16.174505 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b342fd9-004b-4171-a2ea-8879a1b222eb None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:16.174600 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b342fd9-004b-4171-a2ea-8879a1b222eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:16.196578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:16.267693 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4b342fd9-004b-4171-a2ea-8879a1b222eb None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:16.268918 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4b342fd9-004b-4171-a2ea-8879a1b222eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:16.373703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:16.525182 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e902a66-4ecc-4e71-97dc-4c414e6f951b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:16.526700 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8e902a66-4ecc-4e71-97dc-4c414e6f951b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:16.657669 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:16.701755 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e902a66-4ecc-4e71-97dc-4c414e6f951b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:16.829329 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c950d-741e-48e0-9737-cda4871da397 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:16.829948 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c950d-741e-48e0-9737-cda4871da397 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:16.830224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c950d-741e-48e0-9737-cda4871da397 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:16.830490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c950d-741e-48e0-9737-cda4871da397 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:16.832126 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b97c950d-741e-48e0-9737-cda4871da397 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:16.926082 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:16.942250 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c950d-741e-48e0-9737-cda4871da397 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:16.943906 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c950d-741e-48e0-9737-cda4871da397 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:16.962724 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 711/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:17.814733 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7e74f-43f0-461a-8efe-09c7e0481637 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:17.815303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7e74f-43f0-461a-8efe-09c7e0481637 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:17.815303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7e74f-43f0-461a-8efe-09c7e0481637 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:17.816677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:51:17.822743 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89d34b-459a-4b60-b6f8-d861d11663ac None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:17.823195 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89d34b-459a-4b60-b6f8-d861d11663ac None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:17.823303 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89d34b-459a-4b60-b6f8-d861d11663ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:17.912566 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-be89d34b-459a-4b60-b6f8-d861d11663ac None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:17.913784 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-be89d34b-459a-4b60-b6f8-d861d11663ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:18.018827 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:18.173948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7e74f-43f0-461a-8efe-09c7e0481637 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:18.176400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1dd7e74f-43f0-461a-8efe-09c7e0481637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:18.276078 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:18.344359 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7e74f-43f0-461a-8efe-09c7e0481637 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:18.477999 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61b19e-cae8-45c9-9993-9c3046bfed21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:18.478528 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61b19e-cae8-45c9-9993-9c3046bfed21 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:18.478806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61b19e-cae8-45c9-9993-9c3046bfed21 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:18.479076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61b19e-cae8-45c9-9993-9c3046bfed21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:18.480704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8f61b19e-cae8-45c9-9993-9c3046bfed21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:18.533304 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:18.582701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61b19e-cae8-45c9-9993-9c3046bfed21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:18.584444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61b19e-cae8-45c9-9993-9c3046bfed21 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:18.603029 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 716/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:19.401823 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd999ee-912a-4fab-9d31-ae90df910910 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:19.402401 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd999ee-912a-4fab-9d31-ae90df910910 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:19.402401 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd999ee-912a-4fab-9d31-ae90df910910 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:19.403678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:51:19.408880 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b0fb1-a159-46ba-ac7b-4e51bb3b6f00 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:19.409292 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b0fb1-a159-46ba-ac7b-4e51bb3b6f00 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:19.409403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b0fb1-a159-46ba-ac7b-4e51bb3b6f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:19.497193 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-161b0fb1-a159-46ba-ac7b-4e51bb3b6f00 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:19.498578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-161b0fb1-a159-46ba-ac7b-4e51bb3b6f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:19.602951 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:19.764974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd999ee-912a-4fab-9d31-ae90df910910 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:19.766551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bbd999ee-912a-4fab-9d31-ae90df910910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:19.816940 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:19.925675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd999ee-912a-4fab-9d31-ae90df910910 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:20.041490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8bb41-44bd-40cd-b2ab-0be762933290 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:20.042010 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8bb41-44bd-40cd-b2ab-0be762933290 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:20.042285 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8bb41-44bd-40cd-b2ab-0be762933290 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:20.042571 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8bb41-44bd-40cd-b2ab-0be762933290 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:20.044153 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-33f8bb41-44bd-40cd-b2ab-0be762933290 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:20.051514 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:20.140888 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8bb41-44bd-40cd-b2ab-0be762933290 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:20.142532 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8bb41-44bd-40cd-b2ab-0be762933290 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:20.164178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 714/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:20.992145 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66888cb6-83d7-4951-8da1-8bfb228aa026 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:20.992793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66888cb6-83d7-4951-8da1-8bfb228aa026 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:20.992793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66888cb6-83d7-4951-8da1-8bfb228aa026 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:20.994062 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:51:21.000142 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07683cde-7ec8-48ad-bbec-0917ca2411c2 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:21.000597 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07683cde-7ec8-48ad-bbec-0917ca2411c2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:21.000708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07683cde-7ec8-48ad-bbec-0917ca2411c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:21.084081 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-07683cde-7ec8-48ad-bbec-0917ca2411c2 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:21.085267 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-07683cde-7ec8-48ad-bbec-0917ca2411c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:21.159720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:21.190695 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:21.343647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66888cb6-83d7-4951-8da1-8bfb228aa026 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:21.344979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-66888cb6-83d7-4951-8da1-8bfb228aa026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:21.364582 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:21.512029 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66888cb6-83d7-4951-8da1-8bfb228aa026 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:21.609984 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:21.638575 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a1b5e-6f3e-478f-a28f-3b6e35e2463e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:21.638813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a1b5e-6f3e-478f-a28f-3b6e35e2463e service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:21.638924 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a1b5e-6f3e-478f-a28f-3b6e35e2463e service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:21.639186 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a1b5e-6f3e-478f-a28f-3b6e35e2463e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:21.641075 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c15a1b5e-6f3e-478f-a28f-3b6e35e2463e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:21.736947 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a1b5e-6f3e-478f-a28f-3b6e35e2463e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:21.738574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a1b5e-6f3e-478f-a28f-3b6e35e2463e service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:21.757987 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 719/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:51:22.561009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aee9bf-b0dd-4b4b-8fb4-e31473b486a1 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:22.561993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aee9bf-b0dd-4b4b-8fb4-e31473b486a1 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:22.562208 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aee9bf-b0dd-4b4b-8fb4-e31473b486a1 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:22.563641 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:51:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:51:22.572278 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2859c7-ed4c-41ef-8f9f-1005dfcd24c7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:22.572722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2859c7-ed4c-41ef-8f9f-1005dfcd24c7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:22.572854 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2859c7-ed4c-41ef-8f9f-1005dfcd24c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:22.659228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2d2859c7-ed4c-41ef-8f9f-1005dfcd24c7 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:22.660471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2d2859c7-ed4c-41ef-8f9f-1005dfcd24c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:22.706125 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:22.766685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:51:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:22.916001 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aee9bf-b0dd-4b4b-8fb4-e31473b486a1 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:22.918356 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-72aee9bf-b0dd-4b4b-8fb4-e31473b486a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:23.077744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aee9bf-b0dd-4b4b-8fb4-e31473b486a1 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:23.138837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:23.202402 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b5a27-e17b-4ddb-9faf-9bb5e74a962e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:23.202959 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b5a27-e17b-4ddb-9faf-9bb5e74a962e service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:23.203339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b5a27-e17b-4ddb-9faf-9bb5e74a962e service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:23.203638 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b5a27-e17b-4ddb-9faf-9bb5e74a962e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:23.205202 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8d7b5a27-e17b-4ddb-9faf-9bb5e74a962e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:23.308508 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b5a27-e17b-4ddb-9faf-9bb5e74a962e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:23.310128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b5a27-e17b-4ddb-9faf-9bb5e74a962e service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:23.330616 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 717/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:24.136008 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73878995-b17f-471c-8062-71fcb9da4615 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:24.136458 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73878995-b17f-471c-8062-71fcb9da4615 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:24.136568 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73878995-b17f-471c-8062-71fcb9da4615 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:24.137928 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:51:24.143694 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643ae24-6a59-41bf-a2d5-8d9b7963d02b None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:24.144117 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643ae24-6a59-41bf-a2d5-8d9b7963d02b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:24.144237 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643ae24-6a59-41bf-a2d5-8d9b7963d02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:24.236323 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-5643ae24-6a59-41bf-a2d5-8d9b7963d02b None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:24.237535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5643ae24-6a59-41bf-a2d5-8d9b7963d02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:24.239578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:24.336866 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:24.488453 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73878995-b17f-471c-8062-71fcb9da4615 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:24.490549 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-73878995-b17f-471c-8062-71fcb9da4615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:24.669554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73878995-b17f-471c-8062-71fcb9da4615 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:24.707014 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:24.809734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e0be3-9d73-4134-be10-d5687e01211f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:24.810346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e0be3-9d73-4134-be10-d5687e01211f service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:24.810624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e0be3-9d73-4134-be10-d5687e01211f service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:24.810894 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e0be3-9d73-4134-be10-d5687e01211f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:24.812674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-610e0be3-9d73-4134-be10-d5687e01211f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:24.906679 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e0be3-9d73-4134-be10-d5687e01211f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:24.908347 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e0be3-9d73-4134-be10-d5687e01211f service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:24.927960 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 722/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:26.727132 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010db52-9486-4362-aa9e-84dded0006e5 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:26.727761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010db52-9486-4362-aa9e-84dded0006e5 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:26.727761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010db52-9486-4362-aa9e-84dded0006e5 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:26.729634 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:51:26.735787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745ef41-d6f0-47a5-b296-d1bd4942c9a5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:26.736232 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745ef41-d6f0-47a5-b296-d1bd4942c9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:26.736331 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745ef41-d6f0-47a5-b296-d1bd4942c9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:26.778671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:26.805563 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1745ef41-d6f0-47a5-b296-d1bd4942c9a5 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:26.806776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1745ef41-d6f0-47a5-b296-d1bd4942c9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:26.928058 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:27.209281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010db52-9486-4362-aa9e-84dded0006e5 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:27.210850 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9010db52-9486-4362-aa9e-84dded0006e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:27.327182 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010db52-9486-4362-aa9e-84dded0006e5 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:27.361779 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:27.415033 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5831068-e01c-45fb-b3c9-a890cf0ef036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:27.415672 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5831068-e01c-45fb-b3c9-a890cf0ef036 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:27.415950 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5831068-e01c-45fb-b3c9-a890cf0ef036 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:27.416218 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5831068-e01c-45fb-b3c9-a890cf0ef036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:27.417796 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e5831068-e01c-45fb-b3c9-a890cf0ef036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:27.541080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5831068-e01c-45fb-b3c9-a890cf0ef036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:27.542538 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5831068-e01c-45fb-b3c9-a890cf0ef036 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:27.562139 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 720/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:29.628653 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cb53e-1b7f-4a67-9417-8474983a8e3c None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:29.629247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cb53e-1b7f-4a67-9417-8474983a8e3c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:29.629247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cb53e-1b7f-4a67-9417-8474983a8e3c None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:29.630570 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:51:29.636862 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2674ee-4ab7-4e69-bc77-099ca1e0b4d6 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:29.637563 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2674ee-4ab7-4e69-bc77-099ca1e0b4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:29.637727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2674ee-4ab7-4e69-bc77-099ca1e0b4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:29.707522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-0d2674ee-4ab7-4e69-bc77-099ca1e0b4d6 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:29.708729 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0d2674ee-4ab7-4e69-bc77-099ca1e0b4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:29.724780 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:29.815396 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:30.095442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cb53e-1b7f-4a67-9417-8474983a8e3c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:30.097932 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-206cb53e-1b7f-4a67-9417-8474983a8e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:30.209449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cb53e-1b7f-4a67-9417-8474983a8e3c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:30.222245 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:30.287682 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ec27b-c0ab-4990-b7d4-ba9f9f2dc64c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:30.288291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ec27b-c0ab-4990-b7d4-ba9f9f2dc64c service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:30.288569 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ec27b-c0ab-4990-b7d4-ba9f9f2dc64c service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:30.288836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ec27b-c0ab-4990-b7d4-ba9f9f2dc64c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:30.290439 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-987ec27b-c0ab-4990-b7d4-ba9f9f2dc64c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:30.411230 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ec27b-c0ab-4990-b7d4-ba9f9f2dc64c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:30.412673 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ec27b-c0ab-4990-b7d4-ba9f9f2dc64c service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:30.439264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 725/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:32.771446 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36522bc6-e2b5-40f8-980f-ce1f16f7dbcf None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:32.771924 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36522bc6-e2b5-40f8-980f-ce1f16f7dbcf None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:32.772031 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36522bc6-e2b5-40f8-980f-ce1f16f7dbcf None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:32.774319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:51:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:51:32.783574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad49c9-6599-4c10-a604-10a8b77c741e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:32.784044 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad49c9-6599-4c10-a604-10a8b77c741e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:32.784153 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad49c9-6599-4c10-a604-10a8b77c741e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:32.834856 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:32.854261 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-18ad49c9-6599-4c10-a604-10a8b77c741e None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:32.855496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-18ad49c9-6599-4c10-a604-10a8b77c741e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:32.958138 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:51:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:51:33.239313 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36522bc6-e2b5-40f8-980f-ce1f16f7dbcf None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:33.240915 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-36522bc6-e2b5-40f8-980f-ce1f16f7dbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:33.352406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36522bc6-e2b5-40f8-980f-ce1f16f7dbcf None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:33.395689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:33.431125 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fc940-e697-43cc-9d06-bbbcf6356f09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:33.431773 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fc940-e697-43cc-9d06-bbbcf6356f09 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:33.432047 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fc940-e697-43cc-9d06-bbbcf6356f09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:33.432317 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fc940-e697-43cc-9d06-bbbcf6356f09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:33.433902 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2c5fc940-e697-43cc-9d06-bbbcf6356f09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:33.548216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5fc940-e697-43cc-9d06-bbbcf6356f09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:33.549824 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5fc940-e697-43cc-9d06-bbbcf6356f09 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:33.570007 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 723/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:35.604386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaaaf0-1b5e-4538-811d-d65701523c28 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:35.604949 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaaaf0-1b5e-4538-811d-d65701523c28 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:35.604949 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaaaf0-1b5e-4538-811d-d65701523c28 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:35.606257 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:51:35.612677 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80d065-e9a8-4cde-bf18-af1cef034119 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:35.613139 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80d065-e9a8-4cde-bf18-af1cef034119 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:35.613235 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80d065-e9a8-4cde-bf18-af1cef034119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:35.695220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-7e80d065-e9a8-4cde-bf18-af1cef034119 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:35.696530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7e80d065-e9a8-4cde-bf18-af1cef034119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:35.717904 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:35.799827 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:36.083793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaaaf0-1b5e-4538-811d-d65701523c28 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:36.085323 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-daaaaaf0-1b5e-4538-811d-d65701523c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:36.196293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaaaf0-1b5e-4538-811d-d65701523c28 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:36.217999 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:36.292425 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8bf6a-dea8-4eb0-9b5a-0c6c86b0a531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:36.293039 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8bf6a-dea8-4eb0-9b5a-0c6c86b0a531 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:36.293309 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8bf6a-dea8-4eb0-9b5a-0c6c86b0a531 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:36.293574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8bf6a-dea8-4eb0-9b5a-0c6c86b0a531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:36.295158 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-10b8bf6a-dea8-4eb0-9b5a-0c6c86b0a531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:36.415922 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8bf6a-dea8-4eb0-9b5a-0c6c86b0a531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:36.417275 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8bf6a-dea8-4eb0-9b5a-0c6c86b0a531 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:36.436390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 728/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:38.379055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f89cb1-663c-497c-8221-4941200576b6 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:38.379720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f89cb1-663c-497c-8221-4941200576b6 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:38.379720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f89cb1-663c-497c-8221-4941200576b6 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:38.381725 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:51:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:51:38.389884 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59e2bb-f7d8-4bc3-843c-3f559d083e19 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:38.390356 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59e2bb-f7d8-4bc3-843c-3f559d083e19 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:38.390464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59e2bb-f7d8-4bc3-843c-3f559d083e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:38.462166 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:38.465218 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0e59e2bb-f7d8-4bc3-843c-3f559d083e19 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:38.467160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0e59e2bb-f7d8-4bc3-843c-3f559d083e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:38.569430 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:51:38.856549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f89cb1-663c-497c-8221-4941200576b6 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:38.859103 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-75f89cb1-663c-497c-8221-4941200576b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:38.998490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f89cb1-663c-497c-8221-4941200576b6 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:39.051709 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:39.082109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6994b4-36e3-408c-a201-0d12a5a5fbfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:39.082724 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6994b4-36e3-408c-a201-0d12a5a5fbfe service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:39.083000 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6994b4-36e3-408c-a201-0d12a5a5fbfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:39.083269 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6994b4-36e3-408c-a201-0d12a5a5fbfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:39.084870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1e6994b4-36e3-408c-a201-0d12a5a5fbfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:39.219976 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6994b4-36e3-408c-a201-0d12a5a5fbfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:39.221471 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6994b4-36e3-408c-a201-0d12a5a5fbfe service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:39.241655 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 726/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:41.172228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03204b4-bf80-4da6-a55d-72b1a8e8612f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:41.173057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03204b4-bf80-4da6-a55d-72b1a8e8612f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:41.173178 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03204b4-bf80-4da6-a55d-72b1a8e8612f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:41.175410 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:51:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:51:41.184325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee41627-973b-4154-b571-ab4eab6d9fba None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:41.184787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee41627-973b-4154-b571-ab4eab6d9fba None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:41.184916 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee41627-973b-4154-b571-ab4eab6d9fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:41.261345 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-3ee41627-973b-4154-b571-ab4eab6d9fba None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:41.262545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3ee41627-973b-4154-b571-ab4eab6d9fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:41.296373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:41.369282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:41.655412 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03204b4-bf80-4da6-a55d-72b1a8e8612f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:41.658019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d03204b4-bf80-4da6-a55d-72b1a8e8612f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:41.775387 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03204b4-bf80-4da6-a55d-72b1a8e8612f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:41.806195 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:41.855212 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab0b52-0d6c-43f1-86c9-97d56180521f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:41.855852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab0b52-0d6c-43f1-86c9-97d56180521f service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:41.856129 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab0b52-0d6c-43f1-86c9-97d56180521f service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:41.856400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab0b52-0d6c-43f1-86c9-97d56180521f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:41.857977 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-40ab0b52-0d6c-43f1-86c9-97d56180521f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:41.983628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab0b52-0d6c-43f1-86c9-97d56180521f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:41.985032 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab0b52-0d6c-43f1-86c9-97d56180521f service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:42.004425 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 731/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:43.984695 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14185257-8414-44ba-a04b-78fdcb87b5c1 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:43.985370 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14185257-8414-44ba-a04b-78fdcb87b5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:43.985370 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14185257-8414-44ba-a04b-78fdcb87b5c1 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:43.986706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:51:43.993304 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93215a-4021-4e45-b517-842dbd4eb2ab None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:43.993788 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93215a-4021-4e45-b517-842dbd4eb2ab None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:43.993900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93215a-4021-4e45-b517-842dbd4eb2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:44.076993 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7f93215a-4021-4e45-b517-842dbd4eb2ab None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:44.078808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7f93215a-4021-4e45-b517-842dbd4eb2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:44.091713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:44.194255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:44.478282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14185257-8414-44ba-a04b-78fdcb87b5c1 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:44.480783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-14185257-8414-44ba-a04b-78fdcb87b5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:44.588825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14185257-8414-44ba-a04b-78fdcb87b5c1 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:44.647744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:44.675224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f647e3-7943-4f84-b0ea-da270b2e1fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:44.675875 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f647e3-7943-4f84-b0ea-da270b2e1fea service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:44.676161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f647e3-7943-4f84-b0ea-da270b2e1fea service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:44.676421 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f647e3-7943-4f84-b0ea-da270b2e1fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:44.678015 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c8f647e3-7943-4f84-b0ea-da270b2e1fea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:44.794201 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f647e3-7943-4f84-b0ea-da270b2e1fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:44.795716 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f647e3-7943-4f84-b0ea-da270b2e1fea service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:44.814231 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 729/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:46.773695 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62fd8c-5fba-4e61-afcf-749aed211a2c None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:46.774249 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62fd8c-5fba-4e61-afcf-749aed211a2c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:46.774249 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62fd8c-5fba-4e61-afcf-749aed211a2c None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:46.776036 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:51:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:51:46.785094 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf7d31-ab90-4598-9899-5adb44890e9f None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:46.785797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf7d31-ab90-4598-9899-5adb44890e9f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:46.785941 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf7d31-ab90-4598-9899-5adb44890e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:46.859015 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-92bf7d31-ab90-4598-9899-5adb44890e9f None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:46.860150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-92bf7d31-ab90-4598-9899-5adb44890e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:46.899562 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:46.965821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:47.247553 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62fd8c-5fba-4e61-afcf-749aed211a2c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:47.250015 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ed62fd8c-5fba-4e61-afcf-749aed211a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:47.366321 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62fd8c-5fba-4e61-afcf-749aed211a2c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:47.409119 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:47.462720 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168be6ed-25dc-4226-a906-f7b1031abc1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:47.463336 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168be6ed-25dc-4226-a906-f7b1031abc1e service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:47.463657 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168be6ed-25dc-4226-a906-f7b1031abc1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:47.463929 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168be6ed-25dc-4226-a906-f7b1031abc1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:47.465530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-168be6ed-25dc-4226-a906-f7b1031abc1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:47.588223 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168be6ed-25dc-4226-a906-f7b1031abc1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:47.589685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168be6ed-25dc-4226-a906-f7b1031abc1e service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:47.608634 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 734/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:49.512403 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6eb20-9ff6-4392-9710-ef2efb1af6f8 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:49.512963 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6eb20-9ff6-4392-9710-ef2efb1af6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:49.512963 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6eb20-9ff6-4392-9710-ef2efb1af6f8 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:49.514263 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:51:49.520977 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77810e3-16fc-435b-8ca4-7c0c6792d728 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:49.521597 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77810e3-16fc-435b-8ca4-7c0c6792d728 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:49.521705 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77810e3-16fc-435b-8ca4-7c0c6792d728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:49.593545 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c77810e3-16fc-435b-8ca4-7c0c6792d728 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:49.594747 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c77810e3-16fc-435b-8ca4-7c0c6792d728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:49.613448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:49.696295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:49.977856 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6eb20-9ff6-4392-9710-ef2efb1af6f8 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:49.979394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a2c6eb20-9ff6-4392-9710-ef2efb1af6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:50.105123 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6eb20-9ff6-4392-9710-ef2efb1af6f8 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:50.181764 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:50.189410 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5932c8-0926-4146-955f-7b7a497c52c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:50.190046 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5932c8-0926-4146-955f-7b7a497c52c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:50.190308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5932c8-0926-4146-955f-7b7a497c52c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:50.190580 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5932c8-0926-4146-955f-7b7a497c52c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:50.192569 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9d5932c8-0926-4146-955f-7b7a497c52c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:50.310132 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5932c8-0926-4146-955f-7b7a497c52c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:50.311657 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5932c8-0926-4146-955f-7b7a497c52c2 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:50.330605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 732/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:51:52.241012 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd5a90-d28f-461f-8e4f-acd170d15709 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:52.241604 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd5a90-d28f-461f-8e4f-acd170d15709 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:52.241604 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd5a90-d28f-461f-8e4f-acd170d15709 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:52.242908 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:51:52.248471 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b5819-412d-4c12-b42b-1cc7901b0e52 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:52.248964 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b5819-412d-4c12-b42b-1cc7901b0e52 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:52.248964 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b5819-412d-4c12-b42b-1cc7901b0e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:52.317164 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d04b5819-412d-4c12-b42b-1cc7901b0e52 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:51:52.318359 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d04b5819-412d-4c12-b42b-1cc7901b0e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:52.371620 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:52.423292 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:51:52.706549 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd5a90-d28f-461f-8e4f-acd170d15709 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:51:52.708144 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d7cd5a90-d28f-461f-8e4f-acd170d15709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:52.820785 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd5a90-d28f-461f-8e4f-acd170d15709 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:51:52.869643 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:51:52.897495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89067c99-1396-4fa6-ba8f-bc9eeeea994e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:51:52.898102 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89067c99-1396-4fa6-ba8f-bc9eeeea994e service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:51:52.898379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89067c99-1396-4fa6-ba8f-bc9eeeea994e service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:51:52.898642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89067c99-1396-4fa6-ba8f-bc9eeeea994e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:51:52.900257 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-89067c99-1396-4fa6-ba8f-bc9eeeea994e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:51:53.016008 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89067c99-1396-4fa6-ba8f-bc9eeeea994e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:51:53.017411 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89067c99-1396-4fa6-ba8f-bc9eeeea994e service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:51:53.035735 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 737/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:51:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:52:02.421271 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=22 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:03.033250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=66 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:12.597101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd47763-6f50-4519-af2d-80403f59cd6b None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:12.598075 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd47763-6f50-4519-af2d-80403f59cd6b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:12.598198 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd47763-6f50-4519-af2d-80403f59cd6b None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:12.599681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 734/1471] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:52:12.605114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90504dab-ca02-4f85-ac3c-d20e41c66a5f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:12.605577 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90504dab-ca02-4f85-ac3c-d20e41c66a5f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:12.605674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90504dab-ca02-4f85-ac3c-d20e41c66a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:12.679041 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-90504dab-ca02-4f85-ac3c-d20e41c66a5f None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:12.680303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-90504dab-ca02-4f85-ac3c-d20e41c66a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:12.781879 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 738/1472] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:52:13.086835 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd1cd5-e41c-4d24-9707-118c6e2a18f8 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:13.087121 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd1cd5-e41c-4d24-9707-118c6e2a18f8 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:13.087432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd1cd5-e41c-4d24-9707-118c6e2a18f8 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:13.088795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 735/1473] 10.222.0.27 () {54 vars in 967 bytes} [Tue Aug 30 11:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:52:13.093859 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac2dfe-a32d-4315-b9b2-92b9c31ea8ea None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:13.094148 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac2dfe-a32d-4315-b9b2-92b9c31ea8ea None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:13.094424 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac2dfe-a32d-4315-b9b2-92b9c31ea8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:13.178389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-feac2dfe-a32d-4315-b9b2-92b9c31ea8ea None None] MFA Rules not processed for user `c6682c22be8c4bdca4be33a93e802409`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:13.179658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-feac2dfe-a32d-4315-b9b2-92b9c31ea8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:13.202830 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:13.262987 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 739/1474] 10.222.0.27 () {58 vars in 1064 bytes} [Tue Aug 30 11:52:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:52:13.270922 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd1cd5-e41c-4d24-9707-118c6e2a18f8 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:13.272495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c4cd1cd5-e41c-4d24-9707-118c6e2a18f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:13.383302 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd1cd5-e41c-4d24-9707-118c6e2a18f8 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:13.467783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06319c1-255b-40fd-b825-06106bd9dc88 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6682c22be8c4bdca4be33a93e802409', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:13.468377 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06319c1-255b-40fd-b825-06106bd9dc88 service glance] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:13.468680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06319c1-255b-40fd-b825-06106bd9dc88 service glance] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:13.468928 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06319c1-255b-40fd-b825-06106bd9dc88 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:13.470533 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f06319c1-255b-40fd-b825-06106bd9dc88 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:13.528731 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:13.588355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06319c1-255b-40fd-b825-06106bd9dc88 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:13.589829 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06319c1-255b-40fd-b825-06106bd9dc88 service glance] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:13.609252 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 736/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:52:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:52:15.646037 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3dd186-9dfd-4db8-892b-a74aa68b342a None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:15.646642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3dd186-9dfd-4db8-892b-a74aa68b342a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:15.646642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3dd186-9dfd-4db8-892b-a74aa68b342a None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:15.648248 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 740/1476] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:52:15.653878 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7d7b6-583c-47e3-bf07-2443806e9129 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:15.654368 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7d7b6-583c-47e3-bf07-2443806e9129 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:15.654465 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7d7b6-583c-47e3-bf07-2443806e9129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:15.723878 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-40e7d7b6-583c-47e3-bf07-2443806e9129 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:15.725072 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-40e7d7b6-583c-47e3-bf07-2443806e9129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:15.825553 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 737/1477] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:52:16.095800 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3dd186-9dfd-4db8-892b-a74aa68b342a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:16.097372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8b3dd186-9dfd-4db8-892b-a74aa68b342a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:16.231812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3dd186-9dfd-4db8-892b-a74aa68b342a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:16.296552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:16.344009 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74293daa-dfb7-43d1-b18b-bd3640da6021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:16.344617 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74293daa-dfb7-43d1-b18b-bd3640da6021 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:16.344893 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74293daa-dfb7-43d1-b18b-bd3640da6021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:16.345166 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74293daa-dfb7-43d1-b18b-bd3640da6021 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:16.345863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74293daa-dfb7-43d1-b18b-bd3640da6021 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:16.347720 dv-cinder-839768-2-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-74293daa-dfb7-43d1-b18b-bd3640da6021 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:52:16.347720 dv-cinder-839768-2-smb devstack@keystone.service[81554]: warnings.warn(msg) Aug 30 11:52:16.347720 dv-cinder-839768-2-smb devstack@keystone.service[81554]: Aug 30 11:52:16.349132 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74293daa-dfb7-43d1-b18b-bd3640da6021 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:16.368882 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 741/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Aug 30 11:52:16 2022] GET /identity/v3/projects => generated 2553 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:52:18.295834 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf0aca-41d7-459e-b954-dc98dfb0ca5d None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:18.296453 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf0aca-41d7-459e-b954-dc98dfb0ca5d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:18.296453 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf0aca-41d7-459e-b954-dc98dfb0ca5d None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:18.297728 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 738/1479] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:52:18.306620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84824eb-ec9f-407b-8182-4f486f337ff8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:18.307082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84824eb-ec9f-407b-8182-4f486f337ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:18.307196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84824eb-ec9f-407b-8182-4f486f337ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:18.395288 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a84824eb-ec9f-407b-8182-4f486f337ff8 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:18.396507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a84824eb-ec9f-407b-8182-4f486f337ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:18.502435 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 742/1480] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:52:18.810465 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf0aca-41d7-459e-b954-dc98dfb0ca5d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:18.813065 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-fabf0aca-41d7-459e-b954-dc98dfb0ca5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:18.825076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:18.979380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf0aca-41d7-459e-b954-dc98dfb0ca5d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:19.076881 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:19.118641 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd9137-6082-4d3b-94d4-ded32fc00e73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:19.119260 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd9137-6082-4d3b-94d4-ded32fc00e73 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:19.119569 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd9137-6082-4d3b-94d4-ded32fc00e73 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:19.119834 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd9137-6082-4d3b-94d4-ded32fc00e73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:19.121450 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-eefd9137-6082-4d3b-94d4-ded32fc00e73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:19.232517 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd9137-6082-4d3b-94d4-ded32fc00e73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:19.235204 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd9137-6082-4d3b-94d4-ded32fc00e73 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:19.255912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 739/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:52:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:52:21.351252 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d5a7e-d964-4479-ad80-51289437a57a None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:21.352143 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d5a7e-d964-4479-ad80-51289437a57a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:21.352143 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d5a7e-d964-4479-ad80-51289437a57a None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:21.354344 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 743/1482] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:52:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:52:21.363478 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa390e-ae1c-4c5c-88e4-823ef5bf57c5 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:21.363951 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa390e-ae1c-4c5c-88e4-823ef5bf57c5 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:21.364065 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa390e-ae1c-4c5c-88e4-823ef5bf57c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:21.440133 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-58fa390e-ae1c-4c5c-88e4-823ef5bf57c5 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:21.441376 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-58fa390e-ae1c-4c5c-88e4-823ef5bf57c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:21.487811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:21.540339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 740/1483] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:52:21.828881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d5a7e-d964-4479-ad80-51289437a57a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:21.831328 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2e1d5a7e-d964-4479-ad80-51289437a57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:21.864276 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:22.078373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d5a7e-d964-4479-ad80-51289437a57a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:22.156339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e910d-5fdf-4156-8c58-6e7e902ffd70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:22.156981 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e910d-5fdf-4156-8c58-6e7e902ffd70 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:22.157255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e910d-5fdf-4156-8c58-6e7e902ffd70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:22.157524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e910d-5fdf-4156-8c58-6e7e902ffd70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:22.159066 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a76e910d-5fdf-4156-8c58-6e7e902ffd70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:22.234778 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:22.272483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e910d-5fdf-4156-8c58-6e7e902ffd70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:22.273932 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e910d-5fdf-4156-8c58-6e7e902ffd70 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:22.292713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 744/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:52:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:52:24.272273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3aab21-1c28-4759-bd3b-3458ed09c4e2 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:24.272911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3aab21-1c28-4759-bd3b-3458ed09c4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:24.272911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3aab21-1c28-4759-bd3b-3458ed09c4e2 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:24.274758 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 741/1485] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:52:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:52:24.280902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079b0b7-8305-4fe8-a1f7-8e0f260665a3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:24.281340 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079b0b7-8305-4fe8-a1f7-8e0f260665a3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:24.281446 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079b0b7-8305-4fe8-a1f7-8e0f260665a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:24.356844 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6079b0b7-8305-4fe8-a1f7-8e0f260665a3 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:24.358067 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6079b0b7-8305-4fe8-a1f7-8e0f260665a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:24.481012 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 745/1486] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:52:24.773531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3aab21-1c28-4759-bd3b-3458ed09c4e2 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:24.776051 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bb3aab21-1c28-4759-bd3b-3458ed09c4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:24.896824 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3aab21-1c28-4759-bd3b-3458ed09c4e2 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:24.974119 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:24.976406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74547cd-c730-4884-afdd-0415d2ad655f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:24.977081 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74547cd-c730-4884-afdd-0415d2ad655f service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:24.977361 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74547cd-c730-4884-afdd-0415d2ad655f service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:24.977643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74547cd-c730-4884-afdd-0415d2ad655f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:24.979811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f74547cd-c730-4884-afdd-0415d2ad655f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:25.218831 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74547cd-c730-4884-afdd-0415d2ad655f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:25.220303 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74547cd-c730-4884-afdd-0415d2ad655f service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:25.238887 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 742/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:52:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:52:27.248409 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfaf53-9f30-4c9b-a32d-9a62950761f4 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:27.249006 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfaf53-9f30-4c9b-a32d-9a62950761f4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:27.249006 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfaf53-9f30-4c9b-a32d-9a62950761f4 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:27.251124 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 746/1488] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:52:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:52:27.258869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19690f9b-f12d-47d4-b12f-09fa5a680c9b None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:27.259268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19690f9b-f12d-47d4-b12f-09fa5a680c9b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:27.259441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19690f9b-f12d-47d4-b12f-09fa5a680c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:27.330072 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-19690f9b-f12d-47d4-b12f-09fa5a680c9b None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:27.331301 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-19690f9b-f12d-47d4-b12f-09fa5a680c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:27.388664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:27.437524 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 743/1489] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:52:27.733479 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfaf53-9f30-4c9b-a32d-9a62950761f4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:27.736011 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-02cfaf53-9f30-4c9b-a32d-9a62950761f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:27.784177 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:27.859530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfaf53-9f30-4c9b-a32d-9a62950761f4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:27.964146 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c3250-cc72-4711-bcbc-6b9f046b0c2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:27.964756 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c3250-cc72-4711-bcbc-6b9f046b0c2d service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:27.965031 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c3250-cc72-4711-bcbc-6b9f046b0c2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:27.965264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c3250-cc72-4711-bcbc-6b9f046b0c2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:27.966947 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f18c3250-cc72-4711-bcbc-6b9f046b0c2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:28.051746 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:28.082722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c3250-cc72-4711-bcbc-6b9f046b0c2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:28.084179 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c3250-cc72-4711-bcbc-6b9f046b0c2d service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:28.102963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 747/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:52:30.179627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165d142-af1f-4989-bc1e-fb8089dc9005 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:30.180185 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165d142-af1f-4989-bc1e-fb8089dc9005 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:30.180185 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165d142-af1f-4989-bc1e-fb8089dc9005 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:30.181495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 744/1491] 10.222.0.27 () {54 vars in 927 bytes} [Tue Aug 30 11:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:52:30.190409 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cad93-70be-4e2e-8e3c-e36ba48a0760 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:30.191166 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cad93-70be-4e2e-8e3c-e36ba48a0760 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:30.191347 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cad93-70be-4e2e-8e3c-e36ba48a0760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:30.277027 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6f4cad93-70be-4e2e-8e3c-e36ba48a0760 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:52:30.278271 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6f4cad93-70be-4e2e-8e3c-e36ba48a0760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:30.383463 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 748/1492] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Aug 30 11:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:52:30.667088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165d142-af1f-4989-bc1e-fb8089dc9005 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:52:30.669203 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9165d142-af1f-4989-bc1e-fb8089dc9005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:30.782889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165d142-af1f-4989-bc1e-fb8089dc9005 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:52:30.870005 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8989f0-6d1a-470d-9966-8be8470c6284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:52:30.870607 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8989f0-6d1a-470d-9966-8be8470c6284 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:52:30.870878 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8989f0-6d1a-470d-9966-8be8470c6284 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:52:30.871141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8989f0-6d1a-470d-9966-8be8470c6284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:52:30.872751 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-af8989f0-6d1a-470d-9966-8be8470c6284 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:52:30.882229 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:30.992995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8989f0-6d1a-470d-9966-8be8470c6284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:52:30.994358 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8989f0-6d1a-470d-9966-8be8470c6284 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:52:31.014152 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 745/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:52:40.381200 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=82 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:52:41.011741 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=50 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:54:07.279475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdac98f-0e19-4430-aebe-d1911293f61c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:07.280501 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdac98f-0e19-4430-aebe-d1911293f61c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:07.280501 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdac98f-0e19-4430-aebe-d1911293f61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:07.369421 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-fcdac98f-0e19-4430-aebe-d1911293f61c None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:54:07.378469 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fcdac98f-0e19-4430-aebe-d1911293f61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:07.474751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 749/1494] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:54:07.484128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92274e45-d2a9-4a15-8c90-c40b26315437 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:07.484912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92274e45-d2a9-4a15-8c90-c40b26315437 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:07.484912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92274e45-d2a9-4a15-8c90-c40b26315437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:07.564536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-92274e45-d2a9-4a15-8c90-c40b26315437 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:54:07.565731 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-92274e45-d2a9-4a15-8c90-c40b26315437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:07.671288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 746/1495] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:54:07.676353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdac98f-0e19-4430-aebe-d1911293f61c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:07.677570 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fcdac98f-0e19-4430-aebe-d1911293f61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:07.690383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdac98f-0e19-4430-aebe-d1911293f61c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:07.755582 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:54:07.793729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1beef-badc-45d5-8df3-a3797ae3ad39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:07.794343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1beef-badc-45d5-8df3-a3797ae3ad39 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:07.794617 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1beef-badc-45d5-8df3-a3797ae3ad39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:07.794887 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1beef-badc-45d5-8df3-a3797ae3ad39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:07.795568 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1beef-badc-45d5-8df3-a3797ae3ad39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:54:07.795874 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1beef-badc-45d5-8df3-a3797ae3ad39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:07.796889 dv-cinder-839768-2-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-e5d1beef-badc-45d5-8df3-a3797ae3ad39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:54:07.796889 dv-cinder-839768-2-smb devstack@keystone.service[81554]: warnings.warn(msg) Aug 30 11:54:07.796889 dv-cinder-839768-2-smb devstack@keystone.service[81554]: Aug 30 11:54:07.797819 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1beef-badc-45d5-8df3-a3797ae3ad39 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:07.812608 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 750/1496] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:54:07.824682 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92274e45-d2a9-4a15-8c90-c40b26315437 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:07.834169 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92274e45-d2a9-4a15-8c90-c40b26315437 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:07.906812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:54:07.945542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29425f86-7fd0-47f5-b7f6-6c4e95e17a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:07.946271 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29425f86-7fd0-47f5-b7f6-6c4e95e17a59 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:07.946745 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29425f86-7fd0-47f5-b7f6-6c4e95e17a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:07.947035 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29425f86-7fd0-47f5-b7f6-6c4e95e17a59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:07.947708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29425f86-7fd0-47f5-b7f6-6c4e95e17a59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:07.949497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: WARNING py.warnings [None req-29425f86-7fd0-47f5-b7f6-6c4e95e17a59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:54:07.949497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: warnings.warn(msg) Aug 30 11:54:07.949497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: Aug 30 11:54:07.950692 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29425f86-7fd0-47f5-b7f6-6c4e95e17a59 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:08.011766 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 747/1497] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:54:07 2022] POST /identity/v3/projects => generated 379 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:54:08.016287 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1beef-badc-45d5-8df3-a3797ae3ad39 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:08.017826 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e5d1beef-badc-45d5-8df3-a3797ae3ad39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:08.052348 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1beef-badc-45d5-8df3-a3797ae3ad39 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:08.156234 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945469e-5502-4a21-be4f-ff69b7d87e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:08.156839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945469e-5502-4a21-be4f-ff69b7d87e5d admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:08.157111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945469e-5502-4a21-be4f-ff69b7d87e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:08.157379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945469e-5502-4a21-be4f-ff69b7d87e5d admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:08.158015 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945469e-5502-4a21-be4f-ff69b7d87e5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:08.159032 dv-cinder-839768-2-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-8945469e-5502-4a21-be4f-ff69b7d87e5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:54:08.159032 dv-cinder-839768-2-smb devstack@keystone.service[81554]: warnings.warn(msg) Aug 30 11:54:08.159032 dv-cinder-839768-2-smb devstack@keystone.service[81554]: Aug 30 11:54:08.160270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945469e-5502-4a21-be4f-ff69b7d87e5d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:08.207124 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 751/1498] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:54:08 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:54:08.211423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29425f86-7fd0-47f5-b7f6-6c4e95e17a59 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:08.213184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-29425f86-7fd0-47f5-b7f6-6c4e95e17a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:08.281768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29425f86-7fd0-47f5-b7f6-6c4e95e17a59 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:08.372078 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:54:08.384650 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5035463-cfa1-4321-870d-a014f6d8b253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:08.385261 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5035463-cfa1-4321-870d-a014f6d8b253 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:08.385537 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5035463-cfa1-4321-870d-a014f6d8b253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:08.385807 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5035463-cfa1-4321-870d-a014f6d8b253 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:08.386457 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5035463-cfa1-4321-870d-a014f6d8b253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:08.387518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: WARNING py.warnings [None req-d5035463-cfa1-4321-870d-a014f6d8b253 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:54:08.387518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: warnings.warn(msg) Aug 30 11:54:08.387518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: Aug 30 11:54:08.388409 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5035463-cfa1-4321-870d-a014f6d8b253 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:08.401472 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 748/1499] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:54:08.405829 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945469e-5502-4a21-be4f-ff69b7d87e5d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:08.407352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8945469e-5502-4a21-be4f-ff69b7d87e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:08.419697 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945469e-5502-4a21-be4f-ff69b7d87e5d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:08.447389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:54:08.523778 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2aa1e9-7613-4a86-9901-a06251591a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:08.524579 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2aa1e9-7613-4a86-9901-a06251591a16 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:08.525048 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2aa1e9-7613-4a86-9901-a06251591a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:08.525424 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2aa1e9-7613-4a86-9901-a06251591a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:08.526748 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2aa1e9-7613-4a86-9901-a06251591a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:08.528321 dv-cinder-839768-2-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-cf2aa1e9-7613-4a86-9901-a06251591a16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:54:08.528321 dv-cinder-839768-2-smb devstack@keystone.service[81554]: warnings.warn(msg) Aug 30 11:54:08.528321 dv-cinder-839768-2-smb devstack@keystone.service[81554]: Aug 30 11:54:08.530064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2aa1e9-7613-4a86-9901-a06251591a16 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:08.546521 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 752/1500] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:54:08.551063 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5035463-cfa1-4321-870d-a014f6d8b253 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:08.552643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d5035463-cfa1-4321-870d-a014f6d8b253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:08.587783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5035463-cfa1-4321-870d-a014f6d8b253 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:08.687256 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8569cd3-6642-44c0-82b8-82c47239e435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:08.687928 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8569cd3-6642-44c0-82b8-82c47239e435 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:08.688202 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8569cd3-6642-44c0-82b8-82c47239e435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:08.688497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8569cd3-6642-44c0-82b8-82c47239e435 admin admin] PATH_INFO: `/v3/projects/f67124d4737544c4b978cfb97b9d8fee/users/9ada1d395e4b4c089b6f3994c9d55b48/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:08.710829 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8569cd3-6642-44c0-82b8-82c47239e435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f67124d4737544c4b978cfb97b9d8fee, user_id=9ada1d395e4b4c089b6f3994c9d55b48, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:08.711995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: WARNING py.warnings [None req-a8569cd3-6642-44c0-82b8-82c47239e435 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:54:08.711995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: warnings.warn(msg) Aug 30 11:54:08.711995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: Aug 30 11:54:08.713895 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8569cd3-6642-44c0-82b8-82c47239e435 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:08.739981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 749/1501] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:54:08 2022] PUT /identity/v3/projects/f67124d4737544c4b978cfb97b9d8fee/users/9ada1d395e4b4c089b6f3994c9d55b48/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:54:08.759335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032bcf3-6e80-4d29-a044-7b52ad810bd0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:08.759656 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032bcf3-6e80-4d29-a044-7b52ad810bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:08.759918 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032bcf3-6e80-4d29-a044-7b52ad810bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:08.817427 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d032bcf3-6e80-4d29-a044-7b52ad810bd0 None None] MFA Rules not processed for user `9ada1d395e4b4c089b6f3994c9d55b48`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:54:08.818629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d032bcf3-6e80-4d29-a044-7b52ad810bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:08.901600 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 753/1502] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:54:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:54:08.915830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90823b-bf5a-4f51-9b39-801f45099b70 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:08.916116 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90823b-bf5a-4f51-9b39-801f45099b70 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:08.916383 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90823b-bf5a-4f51-9b39-801f45099b70 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:08.917731 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 750/1503] 10.222.0.27 () {54 vars in 964 bytes} [Tue Aug 30 11:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:54:08.922584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6d1a6-977d-497a-a71c-615adb1ce94d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:08.922863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6d1a6-977d-497a-a71c-615adb1ce94d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:08.923140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6d1a6-977d-497a-a71c-615adb1ce94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:08.955564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:54:09.000920 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-33c6d1a6-977d-497a-a71c-615adb1ce94d None None] MFA Rules not processed for user `b9bbec99965e4444bcf88a32502b3257`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:54:09.002122 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-33c6d1a6-977d-497a-a71c-615adb1ce94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:09.098438 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 754/1504] 10.222.0.27 () {58 vars in 1061 bytes} [Tue Aug 30 11:54:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:54:09.108795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90823b-bf5a-4f51-9b39-801f45099b70 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:09.110283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bf90823b-bf5a-4f51-9b39-801f45099b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:09.165247 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:54:09.222649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90823b-bf5a-4f51-9b39-801f45099b70 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:09.307125 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ed2e6-680c-4ae6-b092-84093dfa2851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:09.307766 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ed2e6-680c-4ae6-b092-84093dfa2851 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:09.308045 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ed2e6-680c-4ae6-b092-84093dfa2851 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:09.308315 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ed2e6-680c-4ae6-b092-84093dfa2851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:09.309900 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-032ed2e6-680c-4ae6-b092-84093dfa2851 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:09.416945 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ed2e6-680c-4ae6-b092-84093dfa2851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:09.418404 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ed2e6-680c-4ae6-b092-84093dfa2851 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:09.421881 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:54:09.438697 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 751/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:54:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:54:09.487404 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18571b1b-d429-4616-a787-d57ed330b5c3 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:09.487849 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18571b1b-d429-4616-a787-d57ed330b5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:09.487987 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18571b1b-d429-4616-a787-d57ed330b5c3 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:09.489234 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 755/1506] 10.222.0.27 () {52 vars in 830 bytes} [Tue Aug 30 11:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:54:09.493273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ed2e6-680c-4ae6-b092-84093dfa2851 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:09.494661 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-032ed2e6-680c-4ae6-b092-84093dfa2851 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:09.601721 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ed2e6-680c-4ae6-b092-84093dfa2851 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:09.710328 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a263e-cfe1-459f-a2e1-83bbdb663863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:09.710866 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a263e-cfe1-459f-a2e1-83bbdb663863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:09.711141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a263e-cfe1-459f-a2e1-83bbdb663863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:09.711441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a263e-cfe1-459f-a2e1-83bbdb663863 admin admin] PATH_INFO: `/v3/users/9ada1d395e4b4c089b6f3994c9d55b48` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:09.724502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a263e-cfe1-459f-a2e1-83bbdb663863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ada1d395e4b4c089b6f3994c9d55b48)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:09.725542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: WARNING py.warnings [None req-cf7a263e-cfe1-459f-a2e1-83bbdb663863 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:54:09.725542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: warnings.warn(msg) Aug 30 11:54:09.725542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: Aug 30 11:54:09.726753 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a263e-cfe1-459f-a2e1-83bbdb663863 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:09.736650 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:54:09.812179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-cf7a263e-cfe1-459f-a2e1-83bbdb663863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ada1d395e4b4c089b6f3994c9d55b48'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:54:09.826777 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-cf7a263e-cfe1-459f-a2e1-83bbdb663863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ada1d395e4b4c089b6f3994c9d55b48'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:54:09.838254 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-cf7a263e-cfe1-459f-a2e1-83bbdb663863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ada1d395e4b4c089b6f3994c9d55b48'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:54:09.838625 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-cf7a263e-cfe1-459f-a2e1-83bbdb663863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ada1d395e4b4c089b6f3994c9d55b48'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:54:09.863118 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-cf7a263e-cfe1-459f-a2e1-83bbdb663863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ada1d395e4b4c089b6f3994c9d55b48'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:54:09.868922 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 752/1507] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:54:09 2022] DELETE /identity/v3/users/9ada1d395e4b4c089b6f3994c9d55b48 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:54:09.873811 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1ae08-9520-4255-957d-03f71da5ca20 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:09.874075 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1ae08-9520-4255-957d-03f71da5ca20 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:09.874378 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1ae08-9520-4255-957d-03f71da5ca20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:09.947187 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-eba1ae08-9520-4255-957d-03f71da5ca20 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:54:09.949071 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-eba1ae08-9520-4255-957d-03f71da5ca20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:10.035612 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:54:10.051017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 756/1508] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:54:10.060835 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a263e-cfe1-459f-a2e1-83bbdb663863 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:10.062075 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-cf7a263e-cfe1-459f-a2e1-83bbdb663863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:10.176392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a263e-cfe1-459f-a2e1-83bbdb663863 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:10.236095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:54:10.258057 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab04c61-156b-488d-9be0-694d136b7648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:10.258648 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab04c61-156b-488d-9be0-694d136b7648 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:10.258948 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab04c61-156b-488d-9be0-694d136b7648 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:10.259207 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab04c61-156b-488d-9be0-694d136b7648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:10.260845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bab04c61-156b-488d-9be0-694d136b7648 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:10.383269 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab04c61-156b-488d-9be0-694d136b7648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:10.384758 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab04c61-156b-488d-9be0-694d136b7648 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:10.403721 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 753/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:54:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:54:10.900756 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1ae08-9520-4255-957d-03f71da5ca20 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:54:10.903047 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-eba1ae08-9520-4255-957d-03f71da5ca20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:54:10.923436 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1ae08-9520-4255-957d-03f71da5ca20 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:54:11.042309 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f379c-607e-4320-8fac-3a659eff2fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:54:11.042982 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f379c-607e-4320-8fac-3a659eff2fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:54:11.043276 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f379c-607e-4320-8fac-3a659eff2fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:54:11.043629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f379c-607e-4320-8fac-3a659eff2fd6 admin admin] PATH_INFO: `/v3/projects/f67124d4737544c4b978cfb97b9d8fee` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:54:11.054448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f379c-607e-4320-8fac-3a659eff2fd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f67124d4737544c4b978cfb97b9d8fee)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:54:11.055527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-d92f379c-607e-4320-8fac-3a659eff2fd6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:54:11.055527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: warnings.warn(msg) Aug 30 11:54:11.055527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: Aug 30 11:54:11.056741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f379c-607e-4320-8fac-3a659eff2fd6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:54:11.119794 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d92f379c-607e-4320-8fac-3a659eff2fd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f67124d4737544c4b978cfb97b9d8fee', 'request_id': 'req-d92f379c-607e-4320-8fac-3a659eff2fd6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:54:11.131091 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d92f379c-607e-4320-8fac-3a659eff2fd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f67124d4737544c4b978cfb97b9d8fee', 'request_id': 'req-d92f379c-607e-4320-8fac-3a659eff2fd6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:54:11.137622 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d92f379c-607e-4320-8fac-3a659eff2fd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f67124d4737544c4b978cfb97b9d8fee', 'request_id': 'req-d92f379c-607e-4320-8fac-3a659eff2fd6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:54:11.168310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d92f379c-607e-4320-8fac-3a659eff2fd6 admin admin] The token cache is being invalidate because project f67124d4737544c4b978cfb97b9d8fee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:54:11.168516 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d92f379c-607e-4320-8fac-3a659eff2fd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:54:11.168918 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d92f379c-607e-4320-8fac-3a659eff2fd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:54:11.170338 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 757/1510] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:54:10 2022] DELETE /identity/v3/projects/f67124d4737544c4b978cfb97b9d8fee => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:54:20.401085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=62 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:54:21.165856 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:55:44.005382 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7c506-8edc-46ef-81a6-6c27b197d677 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:44.006044 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7c506-8edc-46ef-81a6-6c27b197d677 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:44.006044 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7c506-8edc-46ef-81a6-6c27b197d677 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:44.007523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:55:44.012982 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414113f5-40d3-498e-b73f-bc7d7484c4e0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:44.013513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414113f5-40d3-498e-b73f-bc7d7484c4e0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:44.013513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414113f5-40d3-498e-b73f-bc7d7484c4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:44.100405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-414113f5-40d3-498e-b73f-bc7d7484c4e0 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:55:44.101625 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-414113f5-40d3-498e-b73f-bc7d7484c4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:55:44.213902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:55:44.369336 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7c506-8edc-46ef-81a6-6c27b197d677 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:55:44.373105 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b3d7c506-8edc-46ef-81a6-6c27b197d677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:55:44.505174 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7c506-8edc-46ef-81a6-6c27b197d677 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:55:44.511739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f83c85-4758-4293-9327-59820443b2e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:55:44.512353 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f83c85-4758-4293-9327-59820443b2e4 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:44.512610 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f83c85-4758-4293-9327-59820443b2e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:44.512875 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f83c85-4758-4293-9327-59820443b2e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:44.521194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f83c85-4758-4293-9327-59820443b2e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:55:44.522794 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f83c85-4758-4293-9327-59820443b2e4 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:55:44.536281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 755/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:55:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:55:45.405462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833c0ff-a5b4-461e-a146-6ad647159f57 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:45.406066 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833c0ff-a5b4-461e-a146-6ad647159f57 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:45.406066 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833c0ff-a5b4-461e-a146-6ad647159f57 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:45.407406 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:55:45.413557 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7792a3-bffa-403a-a443-b7ac8829fb27 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:45.414326 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7792a3-bffa-403a-a443-b7ac8829fb27 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:45.414514 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7792a3-bffa-403a-a443-b7ac8829fb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:45.436043 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2b7792a3-bffa-403a-a443-b7ac8829fb27 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:55:45.437238 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2b7792a3-bffa-403a-a443-b7ac8829fb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:55:45.446504 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:55:45.600811 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833c0ff-a5b4-461e-a146-6ad647159f57 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:55:45.618952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833c0ff-a5b4-461e-a146-6ad647159f57 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:55:45.625318 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a7537-9bfe-4a00-8a80-3d2c7249a6e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:55:45.625922 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a7537-9bfe-4a00-8a80-3d2c7249a6e9 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:45.626201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a7537-9bfe-4a00-8a80-3d2c7249a6e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:45.626475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a7537-9bfe-4a00-8a80-3d2c7249a6e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:45.635120 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a7537-9bfe-4a00-8a80-3d2c7249a6e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:55:45.636982 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a7537-9bfe-4a00-8a80-3d2c7249a6e9 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:55:45.646853 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 760/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:55:46.413758 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3149dc8-eebb-4dd3-9b19-fa4b4cec1441 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:46.414355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3149dc8-eebb-4dd3-9b19-fa4b4cec1441 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:46.414355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3149dc8-eebb-4dd3-9b19-fa4b4cec1441 None None] PATH_INFO: `/v3` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:46.415626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 757/1517] 10.222.0.45 () {54 vars in 925 bytes} [Tue Aug 30 11:55:46 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:55:46.422391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae24af7-9adc-4bd9-b7cb-b9e8b741c711 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:46.422836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae24af7-9adc-4bd9-b7cb-b9e8b741c711 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:46.422962 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae24af7-9adc-4bd9-b7cb-b9e8b741c711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:46.484511 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bae24af7-9adc-4bd9-b7cb-b9e8b741c711 None None] MFA Rules not processed for user `9efd2ac7fc4a42558e8dc48c408ce525`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:55:46.485716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bae24af7-9adc-4bd9-b7cb-b9e8b741c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:55:46.507974 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:55:46.566342 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 761/1518] 10.222.0.45 () {58 vars in 1015 bytes} [Tue Aug 30 11:55:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:55:50.404236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7cb15-691c-469f-80ff-17e16596a253 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:50.404833 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7cb15-691c-469f-80ff-17e16596a253 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:50.404833 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7cb15-691c-469f-80ff-17e16596a253 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:50.406102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 758/1519] 10.222.0.27 () {54 vars in 961 bytes} [Tue Aug 30 11:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:55:50.411595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c6d79-099d-43ad-8c21-00450dee5965 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:50.412042 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c6d79-099d-43ad-8c21-00450dee5965 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:50.412236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c6d79-099d-43ad-8c21-00450dee5965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:50.435980 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9d6c6d79-099d-43ad-8c21-00450dee5965 None None] MFA Rules not processed for user `9efd2ac7fc4a42558e8dc48c408ce525`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:55:50.437197 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9d6c6d79-099d-43ad-8c21-00450dee5965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:55:50.449190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 762/1520] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Aug 30 11:55:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:55:50.457047 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7cb15-691c-469f-80ff-17e16596a253 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:55:50.472249 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7cb15-691c-469f-80ff-17e16596a253 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:55:50.477705 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aec733-343e-4cba-8956-02cc773fd21c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9efd2ac7fc4a42558e8dc48c408ce525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:55:50.478300 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aec733-343e-4cba-8956-02cc773fd21c service placement] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:50.478588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aec733-343e-4cba-8956-02cc773fd21c service placement] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:50.478856 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aec733-343e-4cba-8956-02cc773fd21c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:50.487879 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aec733-343e-4cba-8956-02cc773fd21c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:55:50.489504 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aec733-343e-4cba-8956-02cc773fd21c service placement] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:55:50.499879 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 759/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:55:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:55:56.876366 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff41966-25e0-4c78-848d-ab04b07753e6 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:56.876944 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff41966-25e0-4c78-848d-ab04b07753e6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:56.876944 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff41966-25e0-4c78-848d-ab04b07753e6 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:56.879058 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:55:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:55:56.887096 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532e7c9-1ccc-4cca-a2a6-37c99ea6f7d6 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:56.887537 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532e7c9-1ccc-4cca-a2a6-37c99ea6f7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:56.887717 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532e7c9-1ccc-4cca-a2a6-37c99ea6f7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:56.915108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d532e7c9-1ccc-4cca-a2a6-37c99ea6f7d6 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:55:56.916350 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d532e7c9-1ccc-4cca-a2a6-37c99ea6f7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:55:56.926460 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:55:57.083063 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff41966-25e0-4c78-848d-ab04b07753e6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:55:57.102782 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff41966-25e0-4c78-848d-ab04b07753e6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:55:57.110536 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e06993-8ff6-4808-8f45-e9ead801c232 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:55:57.111752 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e06993-8ff6-4808-8f45-e9ead801c232 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:57.111752 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e06993-8ff6-4808-8f45-e9ead801c232 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:57.111752 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e06993-8ff6-4808-8f45-e9ead801c232 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:57.120898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e06993-8ff6-4808-8f45-e9ead801c232 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:55:57.122552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e06993-8ff6-4808-8f45-e9ead801c232 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:55:57.132450 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 764/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:55:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:55:57.946672 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee31da-b37d-428c-be7f-fe4943609517 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:57.947716 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee31da-b37d-428c-be7f-fe4943609517 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:57.947716 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee31da-b37d-428c-be7f-fe4943609517 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:57.949728 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 11:55:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:55:57.955802 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b11a0-452e-45a7-b51e-d7f645686186 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:57.956251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b11a0-452e-45a7-b51e-d7f645686186 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:57.956358 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b11a0-452e-45a7-b51e-d7f645686186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:57.986543 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f90b11a0-452e-45a7-b51e-d7f645686186 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:55:57.987781 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f90b11a0-452e-45a7-b51e-d7f645686186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:55:57.996400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 11:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:55:58.149979 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee31da-b37d-428c-be7f-fe4943609517 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:55:58.165624 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee31da-b37d-428c-be7f-fe4943609517 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:55:58.172762 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9608c2-8e78-42dc-998e-ec65dcb3d3a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:55:58.173360 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9608c2-8e78-42dc-998e-ec65dcb3d3a8 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:55:58.173633 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9608c2-8e78-42dc-998e-ec65dcb3d3a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:55:58.173899 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9608c2-8e78-42dc-998e-ec65dcb3d3a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:55:58.182180 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9608c2-8e78-42dc-998e-ec65dcb3d3a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:55:58.183799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9608c2-8e78-42dc-998e-ec65dcb3d3a8 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:55:58.193961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 762/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:55:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:56:01.868822 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000609d8-9433-456d-92d9-4e757bbe79c5 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:56:01.869764 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000609d8-9433-456d-92d9-4e757bbe79c5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:56:01.869764 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000609d8-9433-456d-92d9-4e757bbe79c5 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:56:01.871991 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:56:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:56:01.880900 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba944d-ed6f-4783-8568-e5aafec8a9ea None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:56:01.881629 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba944d-ed6f-4783-8568-e5aafec8a9ea None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:56:01.881800 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba944d-ed6f-4783-8568-e5aafec8a9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:56:01.905900 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-59ba944d-ed6f-4783-8568-e5aafec8a9ea None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:56:01.907161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-59ba944d-ed6f-4783-8568-e5aafec8a9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:56:01.916484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:56:02.201914 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000609d8-9433-456d-92d9-4e757bbe79c5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:56:02.205321 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-000609d8-9433-456d-92d9-4e757bbe79c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:56:02.301074 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000609d8-9433-456d-92d9-4e757bbe79c5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:56:02.305039 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f89b9-7562-4aa3-9938-d6ba991cd893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:56:02.305653 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f89b9-7562-4aa3-9938-d6ba991cd893 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:56:02.305935 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f89b9-7562-4aa3-9938-d6ba991cd893 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:56:02.306213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f89b9-7562-4aa3-9938-d6ba991cd893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:56:02.315539 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f89b9-7562-4aa3-9938-d6ba991cd893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:56:02.316981 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f89b9-7562-4aa3-9938-d6ba991cd893 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:56:02.326888 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 767/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:56:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:56:04.253289 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485f6e9-0fdd-4847-81d3-5ccfe1321b49 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:56:04.254229 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485f6e9-0fdd-4847-81d3-5ccfe1321b49 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:56:04.254229 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485f6e9-0fdd-4847-81d3-5ccfe1321b49 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:56:04.256484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:56:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:56:04.262706 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4f74f-9524-4317-bcba-4829d0c8c15c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:56:04.263492 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4f74f-9524-4317-bcba-4829d0c8c15c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:56:04.263640 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4f74f-9524-4317-bcba-4829d0c8c15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:56:04.290642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-37b4f74f-9524-4317-bcba-4829d0c8c15c None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:56:04.291874 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-37b4f74f-9524-4317-bcba-4829d0c8c15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:56:04.300723 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:56:04.584833 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485f6e9-0fdd-4847-81d3-5ccfe1321b49 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:56:04.586527 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e485f6e9-0fdd-4847-81d3-5ccfe1321b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:56:04.600633 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485f6e9-0fdd-4847-81d3-5ccfe1321b49 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:56:04.604713 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82505aa-75bd-4ed7-857d-fee52cb306a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:56:04.605311 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82505aa-75bd-4ed7-857d-fee52cb306a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:56:04.605587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82505aa-75bd-4ed7-857d-fee52cb306a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:56:04.605854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82505aa-75bd-4ed7-857d-fee52cb306a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:56:04.616130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82505aa-75bd-4ed7-857d-fee52cb306a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:56:04.617588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82505aa-75bd-4ed7-857d-fee52cb306a1 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:56:04.627370 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 765/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:56:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:56:08.045606 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0211448-1848-4dd5-92e2-74037f82206f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:56:08.046277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0211448-1848-4dd5-92e2-74037f82206f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:56:08.046277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0211448-1848-4dd5-92e2-74037f82206f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:56:08.048158 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:56:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:56:08.054530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530af9b-ed40-469a-8c02-f2cec3bb7fe4 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:56:08.055251 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530af9b-ed40-469a-8c02-f2cec3bb7fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:56:08.055475 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530af9b-ed40-469a-8c02-f2cec3bb7fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:56:08.080216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-b530af9b-ed40-469a-8c02-f2cec3bb7fe4 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:56:08.081400 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b530af9b-ed40-469a-8c02-f2cec3bb7fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:56:08.090105 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:56:08.668429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0211448-1848-4dd5-92e2-74037f82206f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:56:08.671929 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b0211448-1848-4dd5-92e2-74037f82206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:56:08.742485 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:56:08.757739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0211448-1848-4dd5-92e2-74037f82206f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:56:08.761649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93511372-dd72-44cc-9e62-dbaba14f735d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:56:08.762251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93511372-dd72-44cc-9e62-dbaba14f735d service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:56:08.762524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93511372-dd72-44cc-9e62-dbaba14f735d service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:56:08.762797 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93511372-dd72-44cc-9e62-dbaba14f735d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:56:08.772530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93511372-dd72-44cc-9e62-dbaba14f735d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:56:08.773977 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93511372-dd72-44cc-9e62-dbaba14f735d service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:56:08.783208 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 770/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:56:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:56:10.718825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4d35e-efe0-4f0e-87ed-431409c74aae None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:56:10.719759 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4d35e-efe0-4f0e-87ed-431409c74aae None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:56:10.719759 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4d35e-efe0-4f0e-87ed-431409c74aae None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:56:10.721898 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 11:56:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:56:10.727241 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16046777-3704-4523-9964-fbf4f17de5cf None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:56:10.727712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16046777-3704-4523-9964-fbf4f17de5cf None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:56:10.727806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16046777-3704-4523-9964-fbf4f17de5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:56:10.748405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-16046777-3704-4523-9964-fbf4f17de5cf None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:56:10.749606 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-16046777-3704-4523-9964-fbf4f17de5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:56:10.758103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 11:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:56:11.310535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4d35e-efe0-4f0e-87ed-431409c74aae None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:56:11.313070 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-aca4d35e-efe0-4f0e-87ed-431409c74aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:56:11.325593 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=84 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:56:11.333583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4d35e-efe0-4f0e-87ed-431409c74aae None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:56:11.338444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08c1f2-9240-4a15-a656-492457153f6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:56:11.339312 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08c1f2-9240-4a15-a656-492457153f6e service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:56:11.339754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08c1f2-9240-4a15-a656-492457153f6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:56:11.340149 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08c1f2-9240-4a15-a656-492457153f6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:56:11.350541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08c1f2-9240-4a15-a656-492457153f6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:56:11.352014 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08c1f2-9240-4a15-a656-492457153f6e service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:56:11.361645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 768/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:56:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:56:20.743460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=11 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:56:21.357499 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:37.300760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b369b-8538-4d5f-82e2-48186ff5749e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:37.303071 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b369b-8538-4d5f-82e2-48186ff5749e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:37.303071 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b369b-8538-4d5f-82e2-48186ff5749e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:37.329634 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-959b369b-8538-4d5f-82e2-48186ff5749e None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:37.330886 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-959b369b-8538-4d5f-82e2-48186ff5749e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:37.343017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 772/1540] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:37.356832 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45995d88-cd37-4a62-bc28-a40e3e782211 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:37.357460 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45995d88-cd37-4a62-bc28-a40e3e782211 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:37.357460 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45995d88-cd37-4a62-bc28-a40e3e782211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:37.400438 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-45995d88-cd37-4a62-bc28-a40e3e782211 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:37.401675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-45995d88-cd37-4a62-bc28-a40e3e782211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:37.417266 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 769/1541] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:37.422563 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b369b-8538-4d5f-82e2-48186ff5749e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:37.436880 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b369b-8538-4d5f-82e2-48186ff5749e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:37.446285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419613d1-4b4a-4f5d-8130-f6eb5edb33e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:37.446984 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419613d1-4b4a-4f5d-8130-f6eb5edb33e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:37.447264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419613d1-4b4a-4f5d-8130-f6eb5edb33e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:37.450584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419613d1-4b4a-4f5d-8130-f6eb5edb33e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:37.450584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419613d1-4b4a-4f5d-8130-f6eb5edb33e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:57:37.450584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419613d1-4b4a-4f5d-8130-f6eb5edb33e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:37.450584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419613d1-4b4a-4f5d-8130-f6eb5edb33e6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:37.467964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 773/1542] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:57:37.476797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45995d88-cd37-4a62-bc28-a40e3e782211 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:37.486860 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45995d88-cd37-4a62-bc28-a40e3e782211 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:37.495861 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17b34d-a000-4bc5-bd0b-c903b4519f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:37.496525 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17b34d-a000-4bc5-bd0b-c903b4519f9f admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:37.496784 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17b34d-a000-4bc5-bd0b-c903b4519f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:37.497058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17b34d-a000-4bc5-bd0b-c903b4519f9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:37.497714 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17b34d-a000-4bc5-bd0b-c903b4519f9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:37.499771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17b34d-a000-4bc5-bd0b-c903b4519f9f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:37.574059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 770/1543] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:57:37 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:37.578256 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419613d1-4b4a-4f5d-8130-f6eb5edb33e6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:37.592154 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419613d1-4b4a-4f5d-8130-f6eb5edb33e6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:37.658765 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c7f4f-4638-427b-a41c-09e82f5d7071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:37.659933 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c7f4f-4638-427b-a41c-09e82f5d7071 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:37.660251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c7f4f-4638-427b-a41c-09e82f5d7071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:37.660525 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c7f4f-4638-427b-a41c-09e82f5d7071 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:37.661236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c7f4f-4638-427b-a41c-09e82f5d7071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:37.663392 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c7f4f-4638-427b-a41c-09e82f5d7071 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:37.699304 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3ebbf-fad7-40dc-87cf-ceb2c0013a65 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:37.699695 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3ebbf-fad7-40dc-87cf-ceb2c0013a65 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:37.699899 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3ebbf-fad7-40dc-87cf-ceb2c0013a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:37.730292 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 774/1544] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:57:37 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:37.731615 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25c34e-8d3e-4feb-b530-80bc43958029 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:37.731902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25c34e-8d3e-4feb-b530-80bc43958029 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:37.732182 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25c34e-8d3e-4feb-b530-80bc43958029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:37.744989 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d1d3ebbf-fad7-40dc-87cf-ceb2c0013a65 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:37.746265 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d1d3ebbf-fad7-40dc-87cf-ceb2c0013a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:37.770086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 771/1545] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:37.770965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3ebbf-fad7-40dc-87cf-ceb2c0013a65 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:37.781159 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ca25c34e-8d3e-4feb-b530-80bc43958029 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:37.782400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ca25c34e-8d3e-4feb-b530-80bc43958029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:37.790838 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3ebbf-fad7-40dc-87cf-ceb2c0013a65 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:37.796470 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 775/1546] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:37.798303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851ef09-d828-46b4-acee-a562bc001dca None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:37.799321 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851ef09-d828-46b4-acee-a562bc001dca None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:37.800655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851ef09-d828-46b4-acee-a562bc001dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:37.805696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0245fe-107f-45e6-943c-6df9350fd0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:37.806624 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0245fe-107f-45e6-943c-6df9350fd0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:37.807123 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0245fe-107f-45e6-943c-6df9350fd0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:37.807703 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0245fe-107f-45e6-943c-6df9350fd0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:37.808562 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0245fe-107f-45e6-943c-6df9350fd0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:37.811046 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0245fe-107f-45e6-943c-6df9350fd0d9 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:37.828324 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 772/1547] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:37.834532 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56513ff-584e-43e0-bc96-c9aa09c50c48 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:37.837258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56513ff-584e-43e0-bc96-c9aa09c50c48 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:37.837789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56513ff-584e-43e0-bc96-c9aa09c50c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:37.842097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7851ef09-d828-46b4-acee-a562bc001dca None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:37.843302 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7851ef09-d828-46b4-acee-a562bc001dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:37.851977 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 776/1548] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:37.856779 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d85790-5f19-4ecf-a28a-33dbc0405e8d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:37.857059 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d85790-5f19-4ecf-a28a-33dbc0405e8d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:37.857377 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d85790-5f19-4ecf-a28a-33dbc0405e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:37.860996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f56513ff-584e-43e0-bc96-c9aa09c50c48 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:37.862656 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f56513ff-584e-43e0-bc96-c9aa09c50c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:37.875217 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 773/1549] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:37.881654 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-69d85790-5f19-4ecf-a28a-33dbc0405e8d None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:37.881654 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-69d85790-5f19-4ecf-a28a-33dbc0405e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:37.882893 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fca5b0-e1cb-4f90-881c-8f42c5ade39c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:37.883414 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fca5b0-e1cb-4f90-881c-8f42c5ade39c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:37.883698 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fca5b0-e1cb-4f90-881c-8f42c5ade39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:37.889879 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 777/1550] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:37.891073 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d85790-5f19-4ecf-a28a-33dbc0405e8d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:37.901843 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d85790-5f19-4ecf-a28a-33dbc0405e8d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:37.906577 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d7fd1-dbe6-4e08-8df6-99eba152dc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:37.907188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d7fd1-dbe6-4e08-8df6-99eba152dc8d admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:37.907507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d7fd1-dbe6-4e08-8df6-99eba152dc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:37.907784 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d7fd1-dbe6-4e08-8df6-99eba152dc8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:37.908040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-84fca5b0-e1cb-4f90-881c-8f42c5ade39c None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:37.908679 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d7fd1-dbe6-4e08-8df6-99eba152dc8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:37.909422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-84fca5b0-e1cb-4f90-881c-8f42c5ade39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:37.910343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d7fd1-dbe6-4e08-8df6-99eba152dc8d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:37.919115 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 774/1551] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:37.920246 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b75da5-9f47-4069-b59b-1792126ccf59 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:37.920536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b75da5-9f47-4069-b59b-1792126ccf59 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:37.920953 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b75da5-9f47-4069-b59b-1792126ccf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:37.921072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 778/1552] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:37.924556 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d7fd1-dbe6-4e08-8df6-99eba152dc8d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:37.935113 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d7fd1-dbe6-4e08-8df6-99eba152dc8d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:37.939737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc5f84-485e-4d55-b661-f76c7d163d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:37.940820 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc5f84-485e-4d55-b661-f76c7d163d0a admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:37.941397 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc5f84-485e-4d55-b661-f76c7d163d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:37.941397 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc5f84-485e-4d55-b661-f76c7d163d0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:37.941978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc5f84-485e-4d55-b661-f76c7d163d0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:57:37.942281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc5f84-485e-4d55-b661-f76c7d163d0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:37.942912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-41b75da5-9f47-4069-b59b-1792126ccf59 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:37.944134 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc5f84-485e-4d55-b661-f76c7d163d0a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:37.944503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-41b75da5-9f47-4069-b59b-1792126ccf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:37.957757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 775/1553] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:37.959490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a981c2-3676-455d-81be-023e435dba8a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:37.959490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a981c2-3676-455d-81be-023e435dba8a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:37.959669 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a981c2-3676-455d-81be-023e435dba8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:37.961202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 779/1554] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:57:37.962490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3113a8d-015d-4e29-b432-e7f92364234f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:37.963392 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3113a8d-015d-4e29-b432-e7f92364234f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:37.963392 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3113a8d-015d-4e29-b432-e7f92364234f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:37.982228 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-75a981c2-3676-455d-81be-023e435dba8a None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:37.983468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-75a981c2-3676-455d-81be-023e435dba8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:37.984020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b3113a8d-015d-4e29-b432-e7f92364234f None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:37.985211 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b3113a8d-015d-4e29-b432-e7f92364234f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:37.991834 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 776/1555] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:37.992824 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b548f7b-49ec-4cb9-8d0d-b998437f0b24 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:37.993120 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b548f7b-49ec-4cb9-8d0d-b998437f0b24 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:37.993244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 780/1556] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:37.993359 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b548f7b-49ec-4cb9-8d0d-b998437f0b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:37.993944 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3113a8d-015d-4e29-b432-e7f92364234f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:38.005243 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3113a8d-015d-4e29-b432-e7f92364234f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:38.010145 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d41fee-951e-4d83-8831-52ada4663549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:38.010765 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d41fee-951e-4d83-8831-52ada4663549 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.011039 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d41fee-951e-4d83-8831-52ada4663549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.011305 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d41fee-951e-4d83-8831-52ada4663549 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.012057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d41fee-951e-4d83-8831-52ada4663549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:57:38.012358 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d41fee-951e-4d83-8831-52ada4663549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:38.013429 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-1b548f7b-49ec-4cb9-8d0d-b998437f0b24 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:38.013971 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d41fee-951e-4d83-8831-52ada4663549 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:38.014632 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1b548f7b-49ec-4cb9-8d0d-b998437f0b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:38.023388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 777/1557] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:38.024903 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b548f7b-49ec-4cb9-8d0d-b998437f0b24 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:38.030580 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 781/1558] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:57:38.030580 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc53e7b-a77d-4d45-a1e2-43266a2a64a3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.030580 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc53e7b-a77d-4d45-a1e2-43266a2a64a3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.030580 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc53e7b-a77d-4d45-a1e2-43266a2a64a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.037369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b548f7b-49ec-4cb9-8d0d-b998437f0b24 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:38.043064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b40ff6-20b1-4133-a961-d2279f77be6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:38.043756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b40ff6-20b1-4133-a961-d2279f77be6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.044045 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b40ff6-20b1-4133-a961-d2279f77be6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.044305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b40ff6-20b1-4133-a961-d2279f77be6c admin admin] PATH_INFO: `/v3/projects/532ae2632ecb4f5ebefb4561b4472720/users/eaa19ceb39354acb9408a9c44652774d/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.049624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8cc53e7b-a77d-4d45-a1e2-43266a2a64a3 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:38.050990 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8cc53e7b-a77d-4d45-a1e2-43266a2a64a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:38.059679 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 782/1559] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:38.060114 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b40ff6-20b1-4133-a961-d2279f77be6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=532ae2632ecb4f5ebefb4561b4472720, user_id=eaa19ceb39354acb9408a9c44652774d, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:38.061037 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d36460-4ddd-46e9-a902-0840ad177350 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.061325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d36460-4ddd-46e9-a902-0840ad177350 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.061601 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d36460-4ddd-46e9-a902-0840ad177350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.062990 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b40ff6-20b1-4133-a961-d2279f77be6c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:38.079089 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 778/1560] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:57:38 2022] PUT /identity/v3/projects/532ae2632ecb4f5ebefb4561b4472720/users/eaa19ceb39354acb9408a9c44652774d/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:57:38.079844 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b40ff6-20b1-4133-a961-d2279f77be6c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:38.083532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-51d36460-4ddd-46e9-a902-0840ad177350 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:38.084736 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-51d36460-4ddd-46e9-a902-0840ad177350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:38.138346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:38.151330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 783/1561] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:38.151330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d36460-4ddd-46e9-a902-0840ad177350 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:38.155302 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b40ff6-20b1-4133-a961-d2279f77be6c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:38.157883 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d36460-4ddd-46e9-a902-0840ad177350 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:38.160552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca14098-751a-4789-a6cb-9038e8e5d9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:38.161255 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca14098-751a-4789-a6cb-9038e8e5d9dd admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.161657 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca14098-751a-4789-a6cb-9038e8e5d9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.161939 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca14098-751a-4789-a6cb-9038e8e5d9dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.162594 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca14098-751a-4789-a6cb-9038e8e5d9dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:38.163026 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6804cb-c26c-46ce-b952-99606be991b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:38.163683 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6804cb-c26c-46ce-b952-99606be991b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.163963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6804cb-c26c-46ce-b952-99606be991b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.164236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6804cb-c26c-46ce-b952-99606be991b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.164567 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca14098-751a-4789-a6cb-9038e8e5d9dd admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:38.164879 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6804cb-c26c-46ce-b952-99606be991b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:57:38.165184 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6804cb-c26c-46ce-b952-99606be991b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:38.166780 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6804cb-c26c-46ce-b952-99606be991b6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:38.179091 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 784/1562] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:57:38.179978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6804cb-c26c-46ce-b952-99606be991b6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:38.189643 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6804cb-c26c-46ce-b952-99606be991b6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:38.195939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba5f32-1f1f-43ae-9ae3-296904c07dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:38.196551 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba5f32-1f1f-43ae-9ae3-296904c07dba admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.196825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba5f32-1f1f-43ae-9ae3-296904c07dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.197092 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba5f32-1f1f-43ae-9ae3-296904c07dba admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.198030 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba5f32-1f1f-43ae-9ae3-296904c07dba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:57:38.198470 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba5f32-1f1f-43ae-9ae3-296904c07dba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:38.200433 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 779/1563] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:57:38 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:38.200592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba5f32-1f1f-43ae-9ae3-296904c07dba admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:38.201763 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36724219-6dc5-47ef-88f3-1440f2cf88fa None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.202248 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36724219-6dc5-47ef-88f3-1440f2cf88fa None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.202566 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36724219-6dc5-47ef-88f3-1440f2cf88fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.214568 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 785/1564] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:57:38.215426 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba5f32-1f1f-43ae-9ae3-296904c07dba admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:38.223722 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-36724219-6dc5-47ef-88f3-1440f2cf88fa None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:38.224930 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-36724219-6dc5-47ef-88f3-1440f2cf88fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:38.225973 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba5f32-1f1f-43ae-9ae3-296904c07dba admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:38.255117 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:38.283592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3a8d6-bb3c-46f5-bbee-f3711a9c3cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:38.284276 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3a8d6-bb3c-46f5-bbee-f3711a9c3cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.284618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3a8d6-bb3c-46f5-bbee-f3711a9c3cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.285045 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3a8d6-bb3c-46f5-bbee-f3711a9c3cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.285950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3a8d6-bb3c-46f5-bbee-f3711a9c3cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:38.286061 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 780/1565] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:38.286730 dv-cinder-839768-2-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-5ba3a8d6-bb3c-46f5-bbee-f3711a9c3cb5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:57:38.286730 dv-cinder-839768-2-smb devstack@keystone.service[81554]: warnings.warn(msg) Aug 30 11:57:38.286730 dv-cinder-839768-2-smb devstack@keystone.service[81554]: Aug 30 11:57:38.287125 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a5456-ca0a-40ef-b06b-81c9a747feb8 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.287437 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a5456-ca0a-40ef-b06b-81c9a747feb8 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.287709 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a5456-ca0a-40ef-b06b-81c9a747feb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.287985 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3a8d6-bb3c-46f5-bbee-f3711a9c3cb5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:38.306632 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d06a5456-ca0a-40ef-b06b-81c9a747feb8 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:38.307930 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d06a5456-ca0a-40ef-b06b-81c9a747feb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:38.316314 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 786/1566] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:57:38 2022] POST /identity/v3/projects => generated 391 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:38.316837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 781/1567] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:38.317892 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77185f-d048-45ca-a8f5-f5a4631a3731 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.318177 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77185f-d048-45ca-a8f5-f5a4631a3731 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.318451 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77185f-d048-45ca-a8f5-f5a4631a3731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.320464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a5456-ca0a-40ef-b06b-81c9a747feb8 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:38.330343 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a5456-ca0a-40ef-b06b-81c9a747feb8 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:38.346024 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cd77185f-d048-45ca-a8f5-f5a4631a3731 None None] MFA Rules not processed for user `eaa19ceb39354acb9408a9c44652774d`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:38.347530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cd77185f-d048-45ca-a8f5-f5a4631a3731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:38.388447 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab48da-c5bd-4a43-95b1-453c82680267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:38.389045 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab48da-c5bd-4a43-95b1-453c82680267 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.389327 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab48da-c5bd-4a43-95b1-453c82680267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.389601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab48da-c5bd-4a43-95b1-453c82680267 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.390389 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab48da-c5bd-4a43-95b1-453c82680267 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:57:38.390695 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab48da-c5bd-4a43-95b1-453c82680267 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:38.391840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: WARNING py.warnings [None req-edab48da-c5bd-4a43-95b1-453c82680267 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:57:38.391840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: warnings.warn(msg) Aug 30 11:57:38.391840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: Aug 30 11:57:38.392724 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab48da-c5bd-4a43-95b1-453c82680267 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:38.404598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 782/1568] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:57:38.405446 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab48da-c5bd-4a43-95b1-453c82680267 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:38.413739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 787/1569] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:38.414607 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77185f-d048-45ca-a8f5-f5a4631a3731 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:38.415308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab48da-c5bd-4a43-95b1-453c82680267 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:38.420161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cacfd0-c046-4d7b-b5dd-44138a5da96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:38.420778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cacfd0-c046-4d7b-b5dd-44138a5da96b admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.421054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cacfd0-c046-4d7b-b5dd-44138a5da96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.421320 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cacfd0-c046-4d7b-b5dd-44138a5da96b admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.421922 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cacfd0-c046-4d7b-b5dd-44138a5da96b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:38.423860 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cacfd0-c046-4d7b-b5dd-44138a5da96b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:38.427712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77185f-d048-45ca-a8f5-f5a4631a3731 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:38.432658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878af10-6e21-42ce-ba40-9ed0feb65141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:38.433270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878af10-6e21-42ce-ba40-9ed0feb65141 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.433552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878af10-6e21-42ce-ba40-9ed0feb65141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.433824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878af10-6e21-42ce-ba40-9ed0feb65141 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.434458 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878af10-6e21-42ce-ba40-9ed0feb65141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:38.437404 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878af10-6e21-42ce-ba40-9ed0feb65141 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:38.457454 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 783/1570] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:57:38 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:38.461558 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cacfd0-c046-4d7b-b5dd-44138a5da96b admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:38.468290 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 788/1571] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:57:38 2022] POST /identity/v3/users => generated 290 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:38.468290 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878af10-6e21-42ce-ba40-9ed0feb65141 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:38.478446 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878af10-6e21-42ce-ba40-9ed0feb65141 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:38.508233 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:38.524447 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cacfd0-c046-4d7b-b5dd-44138a5da96b admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:38.529117 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453ea4a-3c09-4a36-95e5-4528c4d5ba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:38.529784 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453ea4a-3c09-4a36-95e5-4528c4d5ba98 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.530004 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453ea4a-3c09-4a36-95e5-4528c4d5ba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.530274 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453ea4a-3c09-4a36-95e5-4528c4d5ba98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.530907 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453ea4a-3c09-4a36-95e5-4528c4d5ba98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:38.532864 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453ea4a-3c09-4a36-95e5-4528c4d5ba98 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:38.537209 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bb0e7-ec3a-46e5-8337-6921df031246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:38.537902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bb0e7-ec3a-46e5-8337-6921df031246 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.538173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bb0e7-ec3a-46e5-8337-6921df031246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.538444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bb0e7-ec3a-46e5-8337-6921df031246 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.539111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bb0e7-ec3a-46e5-8337-6921df031246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:57:38.539437 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bb0e7-ec3a-46e5-8337-6921df031246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:38.541030 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bb0e7-ec3a-46e5-8337-6921df031246 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:38.554767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 789/1572] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:57:38.555619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bb0e7-ec3a-46e5-8337-6921df031246 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:38.564422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 784/1573] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:57:38 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:38.565681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453ea4a-3c09-4a36-95e5-4528c4d5ba98 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:38.566338 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bb0e7-ec3a-46e5-8337-6921df031246 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:38.596913 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:38.624473 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94205791-169a-4757-83ba-a6406d6a3b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:38.625178 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94205791-169a-4757-83ba-a6406d6a3b39 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.625449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94205791-169a-4757-83ba-a6406d6a3b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.625716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94205791-169a-4757-83ba-a6406d6a3b39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.626350 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94205791-169a-4757-83ba-a6406d6a3b39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:57:38.626647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94205791-169a-4757-83ba-a6406d6a3b39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:38.628298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94205791-169a-4757-83ba-a6406d6a3b39 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:38.633214 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453ea4a-3c09-4a36-95e5-4528c4d5ba98 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:38.637891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3100e8c-d242-4054-ba18-fd946f8a9495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:38.638499 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3100e8c-d242-4054-ba18-fd946f8a9495 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.638774 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3100e8c-d242-4054-ba18-fd946f8a9495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.639045 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3100e8c-d242-4054-ba18-fd946f8a9495 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.639685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 790/1574] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:57:38.639815 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3100e8c-d242-4054-ba18-fd946f8a9495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:38.640532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94205791-169a-4757-83ba-a6406d6a3b39 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:38.640726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: WARNING py.warnings [None req-d3100e8c-d242-4054-ba18-fd946f8a9495 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:57:38.640726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: warnings.warn(msg) Aug 30 11:57:38.640726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: Aug 30 11:57:38.641937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3100e8c-d242-4054-ba18-fd946f8a9495 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:38.652201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94205791-169a-4757-83ba-a6406d6a3b39 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:38.657121 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4bfb0-fe89-489d-a9d0-52eddc50461f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:38.657782 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4bfb0-fe89-489d-a9d0-52eddc50461f admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.658061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4bfb0-fe89-489d-a9d0-52eddc50461f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.658330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4bfb0-fe89-489d-a9d0-52eddc50461f admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.658954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4bfb0-fe89-489d-a9d0-52eddc50461f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:38.661159 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4bfb0-fe89-489d-a9d0-52eddc50461f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:38.666946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 785/1575] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:57:38 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:38.666946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84884c36-24e6-4b85-be3a-6d3668b5398e None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.666946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84884c36-24e6-4b85-be3a-6d3668b5398e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.666946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84884c36-24e6-4b85-be3a-6d3668b5398e None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.667457 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 786/1576] 10.222.0.27 () {54 vars in 962 bytes} [Tue Aug 30 11:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:57:38.668142 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84884c36-24e6-4b85-be3a-6d3668b5398e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:38.681024 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84884c36-24e6-4b85-be3a-6d3668b5398e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:38.685596 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31475671-76a7-4bbe-9fbe-e7bc6fd61bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:38.686188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31475671-76a7-4bbe-9fbe-e7bc6fd61bbe admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.686464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31475671-76a7-4bbe-9fbe-e7bc6fd61bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.686729 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31475671-76a7-4bbe-9fbe-e7bc6fd61bbe admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.687346 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31475671-76a7-4bbe-9fbe-e7bc6fd61bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:38.689295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31475671-76a7-4bbe-9fbe-e7bc6fd61bbe admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:38.690988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 791/1577] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:57:38 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:38.691983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4bfb0-fe89-489d-a9d0-52eddc50461f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:38.714252 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 787/1578] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:57:38 2022] POST /identity/v3/users => generated 286 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:38.716195 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31475671-76a7-4bbe-9fbe-e7bc6fd61bbe admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:38.725824 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31475671-76a7-4bbe-9fbe-e7bc6fd61bbe admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:38.757078 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4bfb0-fe89-489d-a9d0-52eddc50461f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:38.762353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405be167-9e07-4929-9ad8-bd8801dc3ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:38.762959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405be167-9e07-4929-9ad8-bd8801dc3ebd admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.763232 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405be167-9e07-4929-9ad8-bd8801dc3ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.763535 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405be167-9e07-4929-9ad8-bd8801dc3ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.764173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405be167-9e07-4929-9ad8-bd8801dc3ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:38.765773 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405be167-9e07-4929-9ad8-bd8801dc3ebd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:38.776139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 792/1579] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:38.776914 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405be167-9e07-4929-9ad8-bd8801dc3ebd admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:38.784895 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c129aa-569c-4e4f-a6c9-dac98e5c59ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:38.785527 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c129aa-569c-4e4f-a6c9-dac98e5c59ad admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.785809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c129aa-569c-4e4f-a6c9-dac98e5c59ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.786085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c129aa-569c-4e4f-a6c9-dac98e5c59ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.786459 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405be167-9e07-4929-9ad8-bd8801dc3ebd admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:38.786807 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c129aa-569c-4e4f-a6c9-dac98e5c59ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:38.788759 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c129aa-569c-4e4f-a6c9-dac98e5c59ad admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:38.791289 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17958be-c60c-41c6-80fb-1f8e97635001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:38.791898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17958be-c60c-41c6-80fb-1f8e97635001 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.792172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17958be-c60c-41c6-80fb-1f8e97635001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.792441 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17958be-c60c-41c6-80fb-1f8e97635001 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.793056 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17958be-c60c-41c6-80fb-1f8e97635001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:38.795043 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17958be-c60c-41c6-80fb-1f8e97635001 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:38.817602 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 793/1581] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:57:38 2022] POST /identity/v3/users => generated 295 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:38.817851 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 788/1581] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:57:38 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:38.818416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17958be-c60c-41c6-80fb-1f8e97635001 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:38.823405 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c129aa-569c-4e4f-a6c9-dac98e5c59ad admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:38.827920 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17958be-c60c-41c6-80fb-1f8e97635001 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:38.840267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:38.885233 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07592e4-ea0b-478f-a6a5-2b8d45d19213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:38.885789 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07592e4-ea0b-478f-a6a5-2b8d45d19213 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.886043 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07592e4-ea0b-478f-a6a5-2b8d45d19213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.886309 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07592e4-ea0b-478f-a6a5-2b8d45d19213 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.886929 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07592e4-ea0b-478f-a6a5-2b8d45d19213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:38.887030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c129aa-569c-4e4f-a6c9-dac98e5c59ad admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:38.888870 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07592e4-ea0b-478f-a6a5-2b8d45d19213 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:38.891726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f58b0-17f1-4e22-b2bc-effef10e0ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:38.892577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f58b0-17f1-4e22-b2bc-effef10e0ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.892857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f58b0-17f1-4e22-b2bc-effef10e0ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.893127 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f58b0-17f1-4e22-b2bc-effef10e0ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.893817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f58b0-17f1-4e22-b2bc-effef10e0ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:38.895684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f58b0-17f1-4e22-b2bc-effef10e0ac8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:38.906660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 789/1582] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:38.908219 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880524a-c6d5-4ada-b595-7e0435fae70e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.908616 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880524a-c6d5-4ada-b595-7e0435fae70e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.908942 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880524a-c6d5-4ada-b595-7e0435fae70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.917307 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 794/1583] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:57:38 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:38.918184 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07592e4-ea0b-478f-a6a5-2b8d45d19213 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:38.944995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:38.953860 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-3880524a-c6d5-4ada-b595-7e0435fae70e None None] MFA Rules not processed for user `8d17f1d0577a41ed8859706073f79d77`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:38.955743 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3880524a-c6d5-4ada-b595-7e0435fae70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:38.980524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07592e4-ea0b-478f-a6a5-2b8d45d19213 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:38.988821 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0f1c7-908b-4c15-8742-6990220a4acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:38.989542 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0f1c7-908b-4c15-8742-6990220a4acc admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:38.989822 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0f1c7-908b-4c15-8742-6990220a4acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:38.990091 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0f1c7-908b-4c15-8742-6990220a4acc admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:38.990733 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0f1c7-908b-4c15-8742-6990220a4acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:38.992713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0f1c7-908b-4c15-8742-6990220a4acc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.015496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 795/1584] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:57:38 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:39.016475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0f1c7-908b-4c15-8742-6990220a4acc admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.024412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 790/1585] 10.222.0.27 () {58 vars in 1059 bytes} [Tue Aug 30 11:57:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:39.025363 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880524a-c6d5-4ada-b595-7e0435fae70e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.027428 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0f1c7-908b-4c15-8742-6990220a4acc admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.032028 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782255e-7b5e-40ce-b635-8c6ce1b780de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.032634 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782255e-7b5e-40ce-b635-8c6ce1b780de admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.032906 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782255e-7b5e-40ce-b635-8c6ce1b780de admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.033170 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782255e-7b5e-40ce-b635-8c6ce1b780de admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.033803 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782255e-7b5e-40ce-b635-8c6ce1b780de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.035496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782255e-7b5e-40ce-b635-8c6ce1b780de admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.035653 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880524a-c6d5-4ada-b595-7e0435fae70e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.040584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a705702-bab7-4760-a87d-5e0a36dc72ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.041311 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a705702-bab7-4760-a87d-5e0a36dc72ca admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.041662 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a705702-bab7-4760-a87d-5e0a36dc72ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.042002 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a705702-bab7-4760-a87d-5e0a36dc72ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.042892 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a705702-bab7-4760-a87d-5e0a36dc72ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.044661 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a705702-bab7-4760-a87d-5e0a36dc72ca admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.045748 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 796/1586] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:39.046639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782255e-7b5e-40ce-b635-8c6ce1b780de admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.056490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782255e-7b5e-40ce-b635-8c6ce1b780de admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.060314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 791/1587] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:39.061128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a705702-bab7-4760-a87d-5e0a36dc72ca admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.061247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e2f5a-9150-414f-a38f-06d8ff721962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.061746 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e2f5a-9150-414f-a38f-06d8ff721962 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.062023 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e2f5a-9150-414f-a38f-06d8ff721962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.062292 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e2f5a-9150-414f-a38f-06d8ff721962 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.062910 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e2f5a-9150-414f-a38f-06d8ff721962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.064620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e2f5a-9150-414f-a38f-06d8ff721962 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.072289 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a705702-bab7-4760-a87d-5e0a36dc72ca admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.075656 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 797/1588] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:39.076503 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e2f5a-9150-414f-a38f-06d8ff721962 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.079188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97d98d-125a-45bc-bc3c-e9a7279e9d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.079825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97d98d-125a-45bc-bc3c-e9a7279e9d04 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.080107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97d98d-125a-45bc-bc3c-e9a7279e9d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.080379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97d98d-125a-45bc-bc3c-e9a7279e9d04 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.081046 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97d98d-125a-45bc-bc3c-e9a7279e9d04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.082985 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97d98d-125a-45bc-bc3c-e9a7279e9d04 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.088108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e2f5a-9150-414f-a38f-06d8ff721962 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.092600 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba0711-db40-480e-b5d1-3cef824eec97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.093180 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba0711-db40-480e-b5d1-3cef824eec97 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.093451 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba0711-db40-480e-b5d1-3cef824eec97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.093722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba0711-db40-480e-b5d1-3cef824eec97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.094370 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba0711-db40-480e-b5d1-3cef824eec97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.095933 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba0711-db40-480e-b5d1-3cef824eec97 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.109580 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 798/1589] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:39.109580 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba0711-db40-480e-b5d1-3cef824eec97 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.113505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 792/1590] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:57:39 2022] POST /identity/v3/users => generated 283 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:39.114357 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97d98d-125a-45bc-bc3c-e9a7279e9d04 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.125829 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba0711-db40-480e-b5d1-3cef824eec97 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.128545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97d98d-125a-45bc-bc3c-e9a7279e9d04 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.130806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868375d-1445-42ec-90a4-f3fd9019b500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.131514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868375d-1445-42ec-90a4-f3fd9019b500 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.131860 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868375d-1445-42ec-90a4-f3fd9019b500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.132197 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868375d-1445-42ec-90a4-f3fd9019b500 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.132920 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868375d-1445-42ec-90a4-f3fd9019b500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.133785 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf3ab6-78fe-4ad6-b7ec-37017344ecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.134386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf3ab6-78fe-4ad6-b7ec-37017344ecc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.134663 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf3ab6-78fe-4ad6-b7ec-37017344ecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.134932 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf3ab6-78fe-4ad6-b7ec-37017344ecc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.135327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868375d-1445-42ec-90a4-f3fd9019b500 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.135602 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf3ab6-78fe-4ad6-b7ec-37017344ecc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.137210 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf3ab6-78fe-4ad6-b7ec-37017344ecc6 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.148506 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 793/1591] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:39.149458 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf3ab6-78fe-4ad6-b7ec-37017344ecc6 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.161134 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 799/1592] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:57:39 2022] POST /identity/v3/users => generated 289 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:39.161871 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf3ab6-78fe-4ad6-b7ec-37017344ecc6 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.162585 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868375d-1445-42ec-90a4-f3fd9019b500 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.167377 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2373498-1454-493c-8fd1-b708ce21230c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.167983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2373498-1454-493c-8fd1-b708ce21230c service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.168257 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2373498-1454-493c-8fd1-b708ce21230c service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.168527 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2373498-1454-493c-8fd1-b708ce21230c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.172538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868375d-1445-42ec-90a4-f3fd9019b500 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.177264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842d32f-37db-4c9e-a566-b4dc35f3fcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.178210 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842d32f-37db-4c9e-a566-b4dc35f3fcbf admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.178210 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842d32f-37db-4c9e-a566-b4dc35f3fcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.178428 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842d32f-37db-4c9e-a566-b4dc35f3fcbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.179008 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842d32f-37db-4c9e-a566-b4dc35f3fcbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.180700 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842d32f-37db-4c9e-a566-b4dc35f3fcbf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.191637 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 800/1593] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:39.192428 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842d32f-37db-4c9e-a566-b4dc35f3fcbf admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.201704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842d32f-37db-4c9e-a566-b4dc35f3fcbf admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.206413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7134de6-294b-4c90-9813-12d52f5d57db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.207063 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7134de6-294b-4c90-9813-12d52f5d57db admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.207418 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7134de6-294b-4c90-9813-12d52f5d57db admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.207687 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7134de6-294b-4c90-9813-12d52f5d57db admin admin] PATH_INFO: `/v3/projects/45407588871f437e9ad620b9637cd08f/users/4086920bf3624371a3d0444d592feb47/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.222043 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7134de6-294b-4c90-9813-12d52f5d57db admin admin] RBAC: Authorizing `identity:create_grant(project_id=45407588871f437e9ad620b9637cd08f, user_id=4086920bf3624371a3d0444d592feb47, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.223201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-f7134de6-294b-4c90-9813-12d52f5d57db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:57:39.223201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: warnings.warn(msg) Aug 30 11:57:39.223201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: Aug 30 11:57:39.225184 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7134de6-294b-4c90-9813-12d52f5d57db admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.226254 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2373498-1454-493c-8fd1-b708ce21230c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.227907 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2373498-1454-493c-8fd1-b708ce21230c service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.237791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 794/1594] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:57:39.238694 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2373498-1454-493c-8fd1-b708ce21230c service nova] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.241458 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 801/1595] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:57:39 2022] PUT /identity/v3/projects/45407588871f437e9ad620b9637cd08f/users/4086920bf3624371a3d0444d592feb47/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:57:39.242540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7134de6-294b-4c90-9813-12d52f5d57db admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.249463 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:39.249618 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2373498-1454-493c-8fd1-b708ce21230c service nova] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.308838 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:39.312677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7134de6-294b-4c90-9813-12d52f5d57db admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.317808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67775961-1658-4542-bcc7-35ed981236bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.319063 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d843531-daa8-4f14-a3ea-c01e0b698b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.319632 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67775961-1658-4542-bcc7-35ed981236bd admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.319632 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67775961-1658-4542-bcc7-35ed981236bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.319813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d843531-daa8-4f14-a3ea-c01e0b698b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.320039 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d843531-daa8-4f14-a3ea-c01e0b698b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.320167 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67775961-1658-4542-bcc7-35ed981236bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.320301 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d843531-daa8-4f14-a3ea-c01e0b698b17 admin admin] PATH_INFO: `/v3/projects/48cb907899ab4ea4b28ef88c3917d0ac/users/985216f4610e4da19d73c5d3a823a134/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.320971 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67775961-1658-4542-bcc7-35ed981236bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.323523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67775961-1658-4542-bcc7-35ed981236bd admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.338517 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 795/1596] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:39.338517 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67775961-1658-4542-bcc7-35ed981236bd admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.340854 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d843531-daa8-4f14-a3ea-c01e0b698b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48cb907899ab4ea4b28ef88c3917d0ac, user_id=985216f4610e4da19d73c5d3a823a134, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.343667 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d843531-daa8-4f14-a3ea-c01e0b698b17 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.346880 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67775961-1658-4542-bcc7-35ed981236bd admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.351915 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abc7b0-93c2-44bc-ab9a-7c2127b19ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.352635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abc7b0-93c2-44bc-ab9a-7c2127b19ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.352914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abc7b0-93c2-44bc-ab9a-7c2127b19ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.353183 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abc7b0-93c2-44bc-ab9a-7c2127b19ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.353988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39abc7b0-93c2-44bc-ab9a-7c2127b19ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.355665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39abc7b0-93c2-44bc-ab9a-7c2127b19ef2 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.360367 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 802/1597] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:57:39 2022] PUT /identity/v3/projects/48cb907899ab4ea4b28ef88c3917d0ac/users/985216f4610e4da19d73c5d3a823a134/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:57:39.361568 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d843531-daa8-4f14-a3ea-c01e0b698b17 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.367698 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 796/1598] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:39.371509 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abc7b0-93c2-44bc-ab9a-7c2127b19ef2 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.381639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abc7b0-93c2-44bc-ab9a-7c2127b19ef2 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.432029 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d843531-daa8-4f14-a3ea-c01e0b698b17 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.437748 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec6b9d-36cf-46a0-ae97-189eca27c99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.438556 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec6b9d-36cf-46a0-ae97-189eca27c99f admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.438997 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec6b9d-36cf-46a0-ae97-189eca27c99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.439462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec6b9d-36cf-46a0-ae97-189eca27c99f admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.441479 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec6b9d-36cf-46a0-ae97-189eca27c99f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.441897 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66fb37-a429-4efa-8140-fcbf301205ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.442510 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66fb37-a429-4efa-8140-fcbf301205ba admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.442785 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66fb37-a429-4efa-8140-fcbf301205ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.443057 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66fb37-a429-4efa-8140-fcbf301205ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.443721 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66fb37-a429-4efa-8140-fcbf301205ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.444507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec6b9d-36cf-46a0-ae97-189eca27c99f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.445312 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66fb37-a429-4efa-8140-fcbf301205ba admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.456798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 797/1599] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:39.457218 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 803/1600] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:39.458745 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb1e46-7001-4f92-830b-85e88b50131c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.459185 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb1e46-7001-4f92-830b-85e88b50131c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.459647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb1e46-7001-4f92-830b-85e88b50131c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.463772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66fb37-a429-4efa-8140-fcbf301205ba admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.474808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66fb37-a429-4efa-8140-fcbf301205ba admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.479898 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e325b-46e8-455e-b293-e8956300110f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.480553 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e325b-46e8-455e-b293-e8956300110f admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.480834 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e325b-46e8-455e-b293-e8956300110f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.481120 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e325b-46e8-455e-b293-e8956300110f admin admin] PATH_INFO: `/v3/projects/cc0ea8bab8584d6f98f8bbe1ffed98b8/users/107da08535dc40e88cf882051d29d0c4/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.481241 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-24eb1e46-7001-4f92-830b-85e88b50131c None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:39.482479 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-24eb1e46-7001-4f92-830b-85e88b50131c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:39.490428 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 804/1601] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:39.491200 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb1e46-7001-4f92-830b-85e88b50131c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.496552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e325b-46e8-455e-b293-e8956300110f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc0ea8bab8584d6f98f8bbe1ffed98b8, user_id=107da08535dc40e88cf882051d29d0c4, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.499229 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e325b-46e8-455e-b293-e8956300110f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.503256 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb1e46-7001-4f92-830b-85e88b50131c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.508277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034be81-09ba-4493-8381-4d667ff9f0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.508941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034be81-09ba-4493-8381-4d667ff9f0fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.509223 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034be81-09ba-4493-8381-4d667ff9f0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.509494 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034be81-09ba-4493-8381-4d667ff9f0fc admin admin] PATH_INFO: `/v3/projects/74303e62c3b84d2389603c8be4aa01fb/users/588d11e6ed3b4eda8c74e782669a63af/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.513350 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 798/1602] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:57:39 2022] PUT /identity/v3/projects/cc0ea8bab8584d6f98f8bbe1ffed98b8/users/107da08535dc40e88cf882051d29d0c4/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:57:39.525815 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81220aa6-f365-4097-9c7b-935a0228fd44 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.526010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034be81-09ba-4493-8381-4d667ff9f0fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=74303e62c3b84d2389603c8be4aa01fb, user_id=588d11e6ed3b4eda8c74e782669a63af, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.526159 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81220aa6-f365-4097-9c7b-935a0228fd44 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.526351 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81220aa6-f365-4097-9c7b-935a0228fd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.528866 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034be81-09ba-4493-8381-4d667ff9f0fc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.543928 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 805/1603] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:57:39 2022] PUT /identity/v3/projects/74303e62c3b84d2389603c8be4aa01fb/users/588d11e6ed3b4eda8c74e782669a63af/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:57:39.545146 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034be81-09ba-4493-8381-4d667ff9f0fc admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.545938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-81220aa6-f365-4097-9c7b-935a0228fd44 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:39.547333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-81220aa6-f365-4097-9c7b-935a0228fd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:39.601898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:39.607089 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 799/1604] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:39.607980 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81220aa6-f365-4097-9c7b-935a0228fd44 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.613537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034be81-09ba-4493-8381-4d667ff9f0fc admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.618475 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81220aa6-f365-4097-9c7b-935a0228fd44 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.618839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497890bb-55c0-4da0-b8c0-c1a0797cbc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.619492 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497890bb-55c0-4da0-b8c0-c1a0797cbc70 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.619801 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497890bb-55c0-4da0-b8c0-c1a0797cbc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.620070 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497890bb-55c0-4da0-b8c0-c1a0797cbc70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.620707 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497890bb-55c0-4da0-b8c0-c1a0797cbc70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.622318 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497890bb-55c0-4da0-b8c0-c1a0797cbc70 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.623051 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43438d3f-321c-41dd-8104-3a472e6370d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.623719 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43438d3f-321c-41dd-8104-3a472e6370d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.623995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43438d3f-321c-41dd-8104-3a472e6370d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.624266 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43438d3f-321c-41dd-8104-3a472e6370d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.624906 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43438d3f-321c-41dd-8104-3a472e6370d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.626509 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43438d3f-321c-41dd-8104-3a472e6370d6 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.635846 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 806/1605] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:39.635846 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497890bb-55c0-4da0-b8c0-c1a0797cbc70 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.639861 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 800/1606] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:39.639861 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcaedb-830c-4254-b7bb-d7050d40a4b0 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.639861 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcaedb-830c-4254-b7bb-d7050d40a4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.639861 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcaedb-830c-4254-b7bb-d7050d40a4b0 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.640234 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 801/1607] 10.222.0.27 () {54 vars in 912 bytes} [Tue Aug 30 11:57:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:57:39.640605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcaedb-830c-4254-b7bb-d7050d40a4b0 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.649526 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497890bb-55c0-4da0-b8c0-c1a0797cbc70 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.654058 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a22126-99a9-4fdf-92e4-413d76000a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.654717 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a22126-99a9-4fdf-92e4-413d76000a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.655048 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a22126-99a9-4fdf-92e4-413d76000a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.655329 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a22126-99a9-4fdf-92e4-413d76000a1f admin admin] PATH_INFO: `/v3/projects/48a9daa839e04fcb9189a753fa3df9db/users/654d1920610c4b1292739c5fca906260/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.670530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a22126-99a9-4fdf-92e4-413d76000a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a9daa839e04fcb9189a753fa3df9db, user_id=654d1920610c4b1292739c5fca906260, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.673330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a22126-99a9-4fdf-92e4-413d76000a1f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.688534 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:39.688990 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 807/1608] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:57:39 2022] PUT /identity/v3/projects/48a9daa839e04fcb9189a753fa3df9db/users/654d1920610c4b1292739c5fca906260/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:57:39.690706 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd57d71-00a0-4817-853f-582384c96945 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.690976 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd57d71-00a0-4817-853f-582384c96945 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.691437 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd57d71-00a0-4817-853f-582384c96945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.700723 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcaedb-830c-4254-b7bb-d7050d40a4b0 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.720716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5cd57d71-00a0-4817-853f-582384c96945 None None] MFA Rules not processed for user `107da08535dc40e88cf882051d29d0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:39.721971 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5cd57d71-00a0-4817-853f-582384c96945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:39.753179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb97aa-5cfc-4d70-9ae3-72bb5716f98c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.753798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb97aa-5cfc-4d70-9ae3-72bb5716f98c service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.754087 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb97aa-5cfc-4d70-9ae3-72bb5716f98c service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.754337 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb97aa-5cfc-4d70-9ae3-72bb5716f98c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.786968 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 808/1609] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:39.788259 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82258817-c7dd-47f5-8b9d-2127476079ab None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.788542 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82258817-c7dd-47f5-8b9d-2127476079ab None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.788812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82258817-c7dd-47f5-8b9d-2127476079ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.806944 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-82258817-c7dd-47f5-8b9d-2127476079ab None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:39.808185 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-82258817-c7dd-47f5-8b9d-2127476079ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:39.820914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb97aa-5cfc-4d70-9ae3-72bb5716f98c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.822694 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb97aa-5cfc-4d70-9ae3-72bb5716f98c service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.833092 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 802/1610] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:57:39.833883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb97aa-5cfc-4d70-9ae3-72bb5716f98c service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.842280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb97aa-5cfc-4d70-9ae3-72bb5716f98c service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.846207 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea511069-841e-474c-9740-cc4c0aafe334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.846878 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea511069-841e-474c-9740-cc4c0aafe334 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.847155 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea511069-841e-474c-9740-cc4c0aafe334 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.847497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea511069-841e-474c-9740-cc4c0aafe334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.857272 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea511069-841e-474c-9740-cc4c0aafe334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.858703 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea511069-841e-474c-9740-cc4c0aafe334 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.870037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 803/1611] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:57:39.870915 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea511069-841e-474c-9740-cc4c0aafe334 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.873267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 809/1612] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:39.874145 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82258817-c7dd-47f5-8b9d-2127476079ab None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:39.888295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82258817-c7dd-47f5-8b9d-2127476079ab None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.890539 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea511069-841e-474c-9740-cc4c0aafe334 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:39.893513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a651d-81c1-400a-aa58-1299a10bb983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.894407 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a651d-81c1-400a-aa58-1299a10bb983 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.894738 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a651d-81c1-400a-aa58-1299a10bb983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.895172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a651d-81c1-400a-aa58-1299a10bb983 admin admin] PATH_INFO: `/v3/projects/2f55b491c5594685b3fce63b764b1321/users/e9a57b9a59f84e16ac1e34d557d63a65/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.898742 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b5da6-1d05-4df0-95cb-a69128e518a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:39.899967 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b5da6-1d05-4df0-95cb-a69128e518a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.900530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b5da6-1d05-4df0-95cb-a69128e518a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.901100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b5da6-1d05-4df0-95cb-a69128e518a8 admin admin] PATH_INFO: `/v3/projects/12cab1ed65884379bdbc88121c4437a2/users/ce4eb9b498ee48a1828d47db4f835a2c/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.913329 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a651d-81c1-400a-aa58-1299a10bb983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f55b491c5594685b3fce63b764b1321, user_id=e9a57b9a59f84e16ac1e34d557d63a65, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.916379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a651d-81c1-400a-aa58-1299a10bb983 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.928164 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b5da6-1d05-4df0-95cb-a69128e518a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12cab1ed65884379bdbc88121c4437a2, user_id=ce4eb9b498ee48a1828d47db4f835a2c, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:39.932424 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 810/1613] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:57:39 2022] PUT /identity/v3/projects/2f55b491c5594685b3fce63b764b1321/users/e9a57b9a59f84e16ac1e34d557d63a65/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:57:39.934003 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b5da6-1d05-4df0-95cb-a69128e518a8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:39.934132 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09293b17-e46c-4c3f-8299-685d9feadd03 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.934580 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09293b17-e46c-4c3f-8299-685d9feadd03 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.934910 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09293b17-e46c-4c3f-8299-685d9feadd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.955308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 804/1614] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:57:39 2022] PUT /identity/v3/projects/12cab1ed65884379bdbc88121c4437a2/users/ce4eb9b498ee48a1828d47db4f835a2c/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:57:39.957927 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4498953-f042-49c4-a3da-114f92744420 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:39.958333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4498953-f042-49c4-a3da-114f92744420 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:39.958610 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4498953-f042-49c4-a3da-114f92744420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:39.967139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-09293b17-e46c-4c3f-8299-685d9feadd03 None None] MFA Rules not processed for user `8d17f1d0577a41ed8859706073f79d77`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:39.969374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-09293b17-e46c-4c3f-8299-685d9feadd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:39.989656 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d4498953-f042-49c4-a3da-114f92744420 None None] MFA Rules not processed for user `654d1920610c4b1292739c5fca906260`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:39.991143 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d4498953-f042-49c4-a3da-114f92744420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:40.018256 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:40.076722 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:40.082259 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 805/1615] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:40.083328 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4498953-f042-49c4-a3da-114f92744420 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:40.083475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 811/1616] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Aug 30 11:57:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:40.113540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09293b17-e46c-4c3f-8299-685d9feadd03 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:40.171416 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4498953-f042-49c4-a3da-114f92744420 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:40.177070 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fd433-3f4c-4d7a-b49a-30f27a1fd792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:40.177917 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fd433-3f4c-4d7a-b49a-30f27a1fd792 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:40.178283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fd433-3f4c-4d7a-b49a-30f27a1fd792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:40.178624 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fd433-3f4c-4d7a-b49a-30f27a1fd792 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:40.179342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fd433-3f4c-4d7a-b49a-30f27a1fd792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:40.181379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fd433-3f4c-4d7a-b49a-30f27a1fd792 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:40.216959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09293b17-e46c-4c3f-8299-685d9feadd03 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:40.222241 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f445ad-e06c-4180-b02f-bbb5b61cfc3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:40.222969 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f445ad-e06c-4180-b02f-bbb5b61cfc3d service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:40.223272 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f445ad-e06c-4180-b02f-bbb5b61cfc3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:40.226736 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f445ad-e06c-4180-b02f-bbb5b61cfc3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:40.226890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 806/1617] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:57:40 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:40.226890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33977c18-cb9e-4007-82b2-fbbd7766df46 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:40.226890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33977c18-cb9e-4007-82b2-fbbd7766df46 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:40.226890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33977c18-cb9e-4007-82b2-fbbd7766df46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:40.236251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f445ad-e06c-4180-b02f-bbb5b61cfc3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:40.238940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f445ad-e06c-4180-b02f-bbb5b61cfc3d service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:40.250023 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 812/1618] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:57:40.251461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a6974-f8c5-4bcf-8cb6-6ea5bbb62035 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:40.251851 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a6974-f8c5-4bcf-8cb6-6ea5bbb62035 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:40.252080 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a6974-f8c5-4bcf-8cb6-6ea5bbb62035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:40.256738 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-33977c18-cb9e-4007-82b2-fbbd7766df46 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:40.258214 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-33977c18-cb9e-4007-82b2-fbbd7766df46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:40.287086 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cb3a6974-f8c5-4bcf-8cb6-6ea5bbb62035 None None] MFA Rules not processed for user `ce4eb9b498ee48a1828d47db4f835a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:40.288115 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cb3a6974-f8c5-4bcf-8cb6-6ea5bbb62035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:40.337483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 807/1619] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:40.338568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33977c18-cb9e-4007-82b2-fbbd7766df46 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:40.373727 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 813/1620] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:40.375401 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7857306-3eeb-4d99-accc-244349b30858 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:40.375748 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7857306-3eeb-4d99-accc-244349b30858 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:40.376078 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7857306-3eeb-4d99-accc-244349b30858 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:40.384404 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 814/1621] 10.222.0.27 () {54 vars in 962 bytes} [Tue Aug 30 11:57:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:57:40.385536 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7857306-3eeb-4d99-accc-244349b30858 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:40.405741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7857306-3eeb-4d99-accc-244349b30858 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:40.413941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050d17a-8b12-42e0-b07e-b8cea04a9e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:40.415002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050d17a-8b12-42e0-b07e-b8cea04a9e73 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:40.415844 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050d17a-8b12-42e0-b07e-b8cea04a9e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:40.416777 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050d17a-8b12-42e0-b07e-b8cea04a9e73 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:40.417609 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050d17a-8b12-42e0-b07e-b8cea04a9e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:40.420593 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050d17a-8b12-42e0-b07e-b8cea04a9e73 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:40.432921 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33977c18-cb9e-4007-82b2-fbbd7766df46 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:40.439761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364186bf-c54b-498d-af28-436302f58571 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:40.441365 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364186bf-c54b-498d-af28-436302f58571 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:40.441365 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364186bf-c54b-498d-af28-436302f58571 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:40.441776 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364186bf-c54b-498d-af28-436302f58571 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:40.454764 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 815/1622] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:57:40 2022] POST /identity/v3/users => generated 292 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:40.457296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050d17a-8b12-42e0-b07e-b8cea04a9e73 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:40.503553 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:40.515564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:40.544982 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050d17a-8b12-42e0-b07e-b8cea04a9e73 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:40.551606 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a26e7-30e7-4679-819e-3bb46a00f276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:40.552507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a26e7-30e7-4679-819e-3bb46a00f276 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:40.552888 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a26e7-30e7-4679-819e-3bb46a00f276 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:40.553838 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a26e7-30e7-4679-819e-3bb46a00f276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:40.569512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a26e7-30e7-4679-819e-3bb46a00f276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:40.571001 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364186bf-c54b-498d-af28-436302f58571 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:40.571927 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a26e7-30e7-4679-819e-3bb46a00f276 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:40.576695 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364186bf-c54b-498d-af28-436302f58571 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:40.589084 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 816/1623] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:57:40.592434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beebbe9-ee3a-4288-a430-e78788a2030e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:40.592896 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beebbe9-ee3a-4288-a430-e78788a2030e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:40.593630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beebbe9-ee3a-4288-a430-e78788a2030e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:40.618915 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0beebbe9-ee3a-4288-a430-e78788a2030e None None] MFA Rules not processed for user `8d17f1d0577a41ed8859706073f79d77`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:40.620276 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0beebbe9-ee3a-4288-a430-e78788a2030e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:40.627294 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 808/1624] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:57:40.628455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364186bf-c54b-498d-af28-436302f58571 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:40.639396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 817/1625] 10.222.0.27 () {58 vars in 1059 bytes} [Tue Aug 30 11:57:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:40.641038 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beebbe9-ee3a-4288-a430-e78788a2030e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:40.648154 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364186bf-c54b-498d-af28-436302f58571 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:40.657756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991dfed-b295-4e10-bb49-7744ee936577 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:40.659519 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991dfed-b295-4e10-bb49-7744ee936577 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:40.659994 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991dfed-b295-4e10-bb49-7744ee936577 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:40.660114 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991dfed-b295-4e10-bb49-7744ee936577 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:40.664898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beebbe9-ee3a-4288-a430-e78788a2030e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:40.672897 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991dfed-b295-4e10-bb49-7744ee936577 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:40.674841 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991dfed-b295-4e10-bb49-7744ee936577 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:40.676028 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf380c-8900-4216-b3d7-b6ef8ee372c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:40.676657 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf380c-8900-4216-b3d7-b6ef8ee372c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:40.676937 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf380c-8900-4216-b3d7-b6ef8ee372c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:40.677778 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf380c-8900-4216-b3d7-b6ef8ee372c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:40.677900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf380c-8900-4216-b3d7-b6ef8ee372c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:40.685590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 809/1626] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:57:40.686289 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991dfed-b295-4e10-bb49-7744ee936577 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:40.687331 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf380c-8900-4216-b3d7-b6ef8ee372c4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:40.699613 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991dfed-b295-4e10-bb49-7744ee936577 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:40.706225 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db439da8-c2a3-4d46-9772-d80bab3357cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:40.707062 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db439da8-c2a3-4d46-9772-d80bab3357cd service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:40.707335 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db439da8-c2a3-4d46-9772-d80bab3357cd service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:40.707636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db439da8-c2a3-4d46-9772-d80bab3357cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:40.714125 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 818/1627] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:40.715424 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf380c-8900-4216-b3d7-b6ef8ee372c4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:40.737198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf380c-8900-4216-b3d7-b6ef8ee372c4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:40.752563 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833fe7c-7f7f-4cc3-96f8-01808982ebb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:40.753446 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833fe7c-7f7f-4cc3-96f8-01808982ebb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:40.753744 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833fe7c-7f7f-4cc3-96f8-01808982ebb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:40.754013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833fe7c-7f7f-4cc3-96f8-01808982ebb5 admin admin] PATH_INFO: `/v3/projects/3e0c7bd28df241e48a21563460f3e5d5/users/4fe4161e467e479cb63d47b7b540c560/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:40.785229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833fe7c-7f7f-4cc3-96f8-01808982ebb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0c7bd28df241e48a21563460f3e5d5, user_id=4fe4161e467e479cb63d47b7b540c560, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:40.790950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833fe7c-7f7f-4cc3-96f8-01808982ebb5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:40.820690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 819/1628] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:57:40 2022] PUT /identity/v3/projects/3e0c7bd28df241e48a21563460f3e5d5/users/4fe4161e467e479cb63d47b7b540c560/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:57:40.823866 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db439da8-c2a3-4d46-9772-d80bab3357cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:40.825102 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833fe7c-7f7f-4cc3-96f8-01808982ebb5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:40.825853 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db439da8-c2a3-4d46-9772-d80bab3357cd service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:40.840478 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 810/1629] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:57:40.966206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833fe7c-7f7f-4cc3-96f8-01808982ebb5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:40.979691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfb4b1-9a8d-44b5-b82a-f9a38069cb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:40.980397 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfb4b1-9a8d-44b5-b82a-f9a38069cb5d admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:40.980680 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfb4b1-9a8d-44b5-b82a-f9a38069cb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:40.980991 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfb4b1-9a8d-44b5-b82a-f9a38069cb5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:40.981790 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfb4b1-9a8d-44b5-b82a-f9a38069cb5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:40.984287 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfb4b1-9a8d-44b5-b82a-f9a38069cb5d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:41.012359 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db439da8-c2a3-4d46-9772-d80bab3357cd service nova] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:41.012586 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 820/1630] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:41.031246 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db439da8-c2a3-4d46-9772-d80bab3357cd service nova] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:41.048057 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5696f-4188-42fc-ad2d-c7b61b276cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:41.049245 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5696f-4188-42fc-ad2d-c7b61b276cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:41.051147 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5696f-4188-42fc-ad2d-c7b61b276cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:41.052458 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5696f-4188-42fc-ad2d-c7b61b276cd6 admin admin] PATH_INFO: `/v3/projects/3e0c7bd28df241e48a21563460f3e5d5/users/4fe4161e467e479cb63d47b7b540c560/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:41.058732 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5696f-4188-42fc-ad2d-c7b61b276cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0c7bd28df241e48a21563460f3e5d5, user_id=4fe4161e467e479cb63d47b7b540c560, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:41.062596 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5696f-4188-42fc-ad2d-c7b61b276cd6 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:41.078557 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 811/1631] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:57:41 2022] PUT /identity/v3/projects/3e0c7bd28df241e48a21563460f3e5d5/users/4fe4161e467e479cb63d47b7b540c560/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:57:41.088588 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bebfa4-4b36-48a8-8936-7e2437065b41 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:41.088844 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bebfa4-4b36-48a8-8936-7e2437065b41 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:41.089124 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bebfa4-4b36-48a8-8936-7e2437065b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:41.141443 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-96bebfa4-4b36-48a8-8936-7e2437065b41 None None] MFA Rules not processed for user `4fe4161e467e479cb63d47b7b540c560`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:41.142998 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-96bebfa4-4b36-48a8-8936-7e2437065b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:41.239180 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315d92c-3005-4eea-8562-3533018a0b32 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:41.239686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315d92c-3005-4eea-8562-3533018a0b32 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:41.239815 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315d92c-3005-4eea-8562-3533018a0b32 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:41.241674 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 812/1632] 10.222.0.27 () {54 vars in 912 bytes} [Tue Aug 30 11:57:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:57:41.248977 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d570b1-9cbd-453f-b89f-dda09df8291d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:41.249261 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d570b1-9cbd-453f-b89f-dda09df8291d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:41.249535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d570b1-9cbd-453f-b89f-dda09df8291d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:41.289020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 821/1633] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:41.306298 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e3d570b1-9cbd-453f-b89f-dda09df8291d None None] MFA Rules not processed for user `8d17f1d0577a41ed8859706073f79d77`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:41.307568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e3d570b1-9cbd-453f-b89f-dda09df8291d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:41.480697 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 813/1634] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Aug 30 11:57:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:57:41.530956 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bebfa4-4b36-48a8-8936-7e2437065b41 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:41.589307 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:41.723072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bebfa4-4b36-48a8-8936-7e2437065b41 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:41.736213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addef9b-290d-441d-8623-93b0c73301d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:41.738771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addef9b-290d-441d-8623-93b0c73301d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:41.739054 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addef9b-290d-441d-8623-93b0c73301d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:41.741570 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addef9b-290d-441d-8623-93b0c73301d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:41.743110 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d570b1-9cbd-453f-b89f-dda09df8291d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:41.754489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d570b1-9cbd-453f-b89f-dda09df8291d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:41.762331 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addef9b-290d-441d-8623-93b0c73301d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:41.764313 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addef9b-290d-441d-8623-93b0c73301d2 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:41.767557 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2e1f0-67e7-4ca9-bc13-27fb0546d28c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:41.768008 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2e1f0-67e7-4ca9-bc13-27fb0546d28c service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:41.768462 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2e1f0-67e7-4ca9-bc13-27fb0546d28c service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:41.768725 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2e1f0-67e7-4ca9-bc13-27fb0546d28c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:41.776845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 822/1635] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:57:41.794037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2e1f0-67e7-4ca9-bc13-27fb0546d28c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:41.795537 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2e1f0-67e7-4ca9-bc13-27fb0546d28c service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:41.828438 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 814/1636] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:57:42.311574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addef9b-290d-441d-8623-93b0c73301d2 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:42.325989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addef9b-290d-441d-8623-93b0c73301d2 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:42.334343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0baa96-e77e-4014-9cee-25c5160dd78f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:42.335116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0baa96-e77e-4014-9cee-25c5160dd78f service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:42.335464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0baa96-e77e-4014-9cee-25c5160dd78f service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:42.335671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0baa96-e77e-4014-9cee-25c5160dd78f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:42.450766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0baa96-e77e-4014-9cee-25c5160dd78f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:42.453191 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0baa96-e77e-4014-9cee-25c5160dd78f service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:42.481078 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 823/1637] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:57:45.289568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2e1f0-67e7-4ca9-bc13-27fb0546d28c service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:45.343250 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:45.438644 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2e1f0-67e7-4ca9-bc13-27fb0546d28c service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:45.460542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959e5b0-515d-4407-96d2-76bb8a3cc809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:45.461348 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959e5b0-515d-4407-96d2-76bb8a3cc809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:45.461722 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959e5b0-515d-4407-96d2-76bb8a3cc809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:45.461999 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959e5b0-515d-4407-96d2-76bb8a3cc809 admin admin] PATH_INFO: `/v3/users/eaa19ceb39354acb9408a9c44652774d` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:45.463319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959e5b0-515d-4407-96d2-76bb8a3cc809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaa19ceb39354acb9408a9c44652774d)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:45.468083 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959e5b0-515d-4407-96d2-76bb8a3cc809 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:45.565982 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5959e5b0-515d-4407-96d2-76bb8a3cc809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaa19ceb39354acb9408a9c44652774d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:45.595308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5959e5b0-515d-4407-96d2-76bb8a3cc809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaa19ceb39354acb9408a9c44652774d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:45.615575 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5959e5b0-515d-4407-96d2-76bb8a3cc809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaa19ceb39354acb9408a9c44652774d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:45.616445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5959e5b0-515d-4407-96d2-76bb8a3cc809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaa19ceb39354acb9408a9c44652774d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:45.647658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5959e5b0-515d-4407-96d2-76bb8a3cc809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaa19ceb39354acb9408a9c44652774d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:45.665763 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 815/1638] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:57:45 2022] DELETE /identity/v3/users/eaa19ceb39354acb9408a9c44652774d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:57:45.667976 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe057c-d004-44fb-a739-1d21db3084a8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:45.668804 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe057c-d004-44fb-a739-1d21db3084a8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:45.669359 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe057c-d004-44fb-a739-1d21db3084a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:45.728793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4afe057c-d004-44fb-a739-1d21db3084a8 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:45.732007 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4afe057c-d004-44fb-a739-1d21db3084a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:45.947833 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 824/1639] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:45.996522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959e5b0-515d-4407-96d2-76bb8a3cc809 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:45.998564 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5959e5b0-515d-4407-96d2-76bb8a3cc809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:46.162754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959e5b0-515d-4407-96d2-76bb8a3cc809 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:46.173331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfce87-4f61-4d64-8554-47e55943f184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:46.173971 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfce87-4f61-4d64-8554-47e55943f184 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:46.174357 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfce87-4f61-4d64-8554-47e55943f184 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:46.174669 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfce87-4f61-4d64-8554-47e55943f184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:46.218854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfce87-4f61-4d64-8554-47e55943f184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:46.220404 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfce87-4f61-4d64-8554-47e55943f184 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:46.246389 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 816/1640] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:57:48.562626 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe057c-d004-44fb-a739-1d21db3084a8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:48.565181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4afe057c-d004-44fb-a739-1d21db3084a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:48.611294 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe057c-d004-44fb-a739-1d21db3084a8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:48.634696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7ec66-890e-4476-84ae-038570c56db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:48.635396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7ec66-890e-4476-84ae-038570c56db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:48.635685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7ec66-890e-4476-84ae-038570c56db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:48.635969 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7ec66-890e-4476-84ae-038570c56db9 admin admin] PATH_INFO: `/v3/projects/532ae2632ecb4f5ebefb4561b4472720` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:48.642278 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7ec66-890e-4476-84ae-038570c56db9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=532ae2632ecb4f5ebefb4561b4472720)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:48.649727 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7ec66-890e-4476-84ae-038570c56db9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:48.849172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-83f7ec66-890e-4476-84ae-038570c56db9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '532ae2632ecb4f5ebefb4561b4472720', 'request_id': 'req-83f7ec66-890e-4476-84ae-038570c56db9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:48.867690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-83f7ec66-890e-4476-84ae-038570c56db9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '532ae2632ecb4f5ebefb4561b4472720', 'request_id': 'req-83f7ec66-890e-4476-84ae-038570c56db9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:48.869974 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:48.885630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-83f7ec66-890e-4476-84ae-038570c56db9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '532ae2632ecb4f5ebefb4561b4472720', 'request_id': 'req-83f7ec66-890e-4476-84ae-038570c56db9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:48.914294 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-83f7ec66-890e-4476-84ae-038570c56db9 admin admin] The token cache is being invalidate because project 532ae2632ecb4f5ebefb4561b4472720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:57:48.914595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-83f7ec66-890e-4476-84ae-038570c56db9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:48.916324 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-83f7ec66-890e-4476-84ae-038570c56db9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:48.918747 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 825/1641] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:57:48 2022] DELETE /identity/v3/projects/532ae2632ecb4f5ebefb4561b4472720 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:57:48.925012 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72230fb3-e199-427a-b212-4220efa1cd18 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:48.928212 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72230fb3-e199-427a-b212-4220efa1cd18 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:48.928745 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72230fb3-e199-427a-b212-4220efa1cd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:48.966489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-72230fb3-e199-427a-b212-4220efa1cd18 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:48.968821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-72230fb3-e199-427a-b212-4220efa1cd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:49.076010 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:49.144897 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 817/1642] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:49.152975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95270495-fbfe-4061-bef3-25c5f894872d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:49.153266 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95270495-fbfe-4061-bef3-25c5f894872d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:49.153536 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95270495-fbfe-4061-bef3-25c5f894872d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:49.199622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72230fb3-e199-427a-b212-4220efa1cd18 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:49.201064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-72230fb3-e199-427a-b212-4220efa1cd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:49.202140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-95270495-fbfe-4061-bef3-25c5f894872d None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:49.203617 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-95270495-fbfe-4061-bef3-25c5f894872d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:49.218646 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 826/1643] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:49.219854 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95270495-fbfe-4061-bef3-25c5f894872d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:49.235044 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72230fb3-e199-427a-b212-4220efa1cd18 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:49.248772 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95270495-fbfe-4061-bef3-25c5f894872d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:49.253528 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99211624-51ff-4665-8456-2b19e199a9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:49.254443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99211624-51ff-4665-8456-2b19e199a9cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:49.254727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99211624-51ff-4665-8456-2b19e199a9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:49.254996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99211624-51ff-4665-8456-2b19e199a9cf admin admin] PATH_INFO: `/v3/users/654d1920610c4b1292739c5fca906260` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:49.257785 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99211624-51ff-4665-8456-2b19e199a9cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=654d1920610c4b1292739c5fca906260)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:49.259974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99211624-51ff-4665-8456-2b19e199a9cf admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:49.264557 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c6d3b-29dc-45fc-bda8-1dc54abde292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:49.266261 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c6d3b-29dc-45fc-bda8-1dc54abde292 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:49.267542 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c6d3b-29dc-45fc-bda8-1dc54abde292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:49.268452 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c6d3b-29dc-45fc-bda8-1dc54abde292 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:49.270372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c6d3b-29dc-45fc-bda8-1dc54abde292 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:57:49.270936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c6d3b-29dc-45fc-bda8-1dc54abde292 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:49.277045 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c6d3b-29dc-45fc-bda8-1dc54abde292 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:49.321713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 827/1644] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:57:49.327688 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c6d3b-29dc-45fc-bda8-1dc54abde292 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:49.354606 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c6d3b-29dc-45fc-bda8-1dc54abde292 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:49.370224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe8378-984e-4958-b281-5be9777aeb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:49.370965 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe8378-984e-4958-b281-5be9777aeb0b admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:49.371232 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe8378-984e-4958-b281-5be9777aeb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:49.371572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe8378-984e-4958-b281-5be9777aeb0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:49.386903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe8378-984e-4958-b281-5be9777aeb0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:49.395662 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe8378-984e-4958-b281-5be9777aeb0b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:49.426372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-99211624-51ff-4665-8456-2b19e199a9cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '654d1920610c4b1292739c5fca906260'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:49.455683 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 828/1645] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:57:49 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:49.459475 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-99211624-51ff-4665-8456-2b19e199a9cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '654d1920610c4b1292739c5fca906260'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:49.460011 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe8378-984e-4958-b281-5be9777aeb0b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:49.483401 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-99211624-51ff-4665-8456-2b19e199a9cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '654d1920610c4b1292739c5fca906260'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:49.484340 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-99211624-51ff-4665-8456-2b19e199a9cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '654d1920610c4b1292739c5fca906260'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:49.533491 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-99211624-51ff-4665-8456-2b19e199a9cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '654d1920610c4b1292739c5fca906260'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:49.551617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 818/1646] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:57:49 2022] DELETE /identity/v3/users/654d1920610c4b1292739c5fca906260 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:57:49.556027 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a5281-1733-470b-9ee3-100a6b5f9c05 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:49.556310 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a5281-1733-470b-9ee3-100a6b5f9c05 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:49.556585 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a5281-1733-470b-9ee3-100a6b5f9c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:49.617956 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-b50a5281-1733-470b-9ee3-100a6b5f9c05 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:49.619199 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b50a5281-1733-470b-9ee3-100a6b5f9c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:49.648135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe8378-984e-4958-b281-5be9777aeb0b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:49.792261 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 819/1647] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:49.808932 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c228022-384c-443f-893b-9efe571c70dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:49.809584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c228022-384c-443f-893b-9efe571c70dc admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:49.809865 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c228022-384c-443f-893b-9efe571c70dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:49.810140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c228022-384c-443f-893b-9efe571c70dc admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:49.810812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c228022-384c-443f-893b-9efe571c70dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:49.812769 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c228022-384c-443f-893b-9efe571c70dc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:49.865587 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 829/1648] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:57:49 2022] POST /identity/v3/users => generated 288 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:49.870311 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a5281-1733-470b-9ee3-100a6b5f9c05 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:49.874238 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b50a5281-1733-470b-9ee3-100a6b5f9c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:49.899173 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a5281-1733-470b-9ee3-100a6b5f9c05 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:49.911398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda4b29-b632-447a-8832-0142d9bd3616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:49.913459 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda4b29-b632-447a-8832-0142d9bd3616 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:49.914201 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda4b29-b632-447a-8832-0142d9bd3616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:49.916844 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda4b29-b632-447a-8832-0142d9bd3616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:49.924660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda4b29-b632-447a-8832-0142d9bd3616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:49.926688 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c228022-384c-443f-893b-9efe571c70dc admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:49.927797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda4b29-b632-447a-8832-0142d9bd3616 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:49.929051 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9c228022-384c-443f-893b-9efe571c70dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:49.965248 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 820/1649] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:49.966856 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda4b29-b632-447a-8832-0142d9bd3616 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:50.015323 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda4b29-b632-447a-8832-0142d9bd3616 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:50.023568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6941c-4106-4eb1-bc84-305dec5e8e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:50.024198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:50.025347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6941c-4106-4eb1-bc84-305dec5e8e50 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:50.025983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6941c-4106-4eb1-bc84-305dec5e8e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:50.026791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6941c-4106-4eb1-bc84-305dec5e8e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:50.027838 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6941c-4106-4eb1-bc84-305dec5e8e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:50.030104 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6941c-4106-4eb1-bc84-305dec5e8e50 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:50.048036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 821/1650] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:50.052952 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6941c-4106-4eb1-bc84-305dec5e8e50 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:50.060350 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c228022-384c-443f-893b-9efe571c70dc admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:50.068263 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6941c-4106-4eb1-bc84-305dec5e8e50 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:50.068561 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b8722-7fc0-4323-a6a8-cd5e9c76a47d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:50.069223 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b8722-7fc0-4323-a6a8-cd5e9c76a47d service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:50.069499 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b8722-7fc0-4323-a6a8-cd5e9c76a47d service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:50.069769 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b8722-7fc0-4323-a6a8-cd5e9c76a47d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:50.081979 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023ff07-0818-436a-93ff-d263095730f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:50.083998 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023ff07-0818-436a-93ff-d263095730f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:50.089327 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023ff07-0818-436a-93ff-d263095730f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:50.089842 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023ff07-0818-436a-93ff-d263095730f4 admin admin] PATH_INFO: `/v3/projects/3e0ee8b3d3134e378cfdade4e70ce0be/users/7d1ddf80494c4b2eb692a838c35d2622/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:50.099560 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b8722-7fc0-4323-a6a8-cd5e9c76a47d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:50.101965 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b8722-7fc0-4323-a6a8-cd5e9c76a47d service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:50.142556 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023ff07-0818-436a-93ff-d263095730f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0ee8b3d3134e378cfdade4e70ce0be, user_id=7d1ddf80494c4b2eb692a838c35d2622, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:50.146188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023ff07-0818-436a-93ff-d263095730f4 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:50.149739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 830/1651] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:57:50.190603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 822/1652] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:57:50 2022] PUT /identity/v3/projects/3e0ee8b3d3134e378cfdade4e70ce0be/users/7d1ddf80494c4b2eb692a838c35d2622/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:57:50.193005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bee83e-45b0-43f8-bb8b-4d9445b4c27e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:50.193297 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bee83e-45b0-43f8-bb8b-4d9445b4c27e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:50.193572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bee83e-45b0-43f8-bb8b-4d9445b4c27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:50.260516 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d0bee83e-45b0-43f8-bb8b-4d9445b4c27e None None] MFA Rules not processed for user `7d1ddf80494c4b2eb692a838c35d2622`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:50.261957 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d0bee83e-45b0-43f8-bb8b-4d9445b4c27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:50.427720 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 831/1653] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:50.432099 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023ff07-0818-436a-93ff-d263095730f4 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:50.458230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:50.568657 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023ff07-0818-436a-93ff-d263095730f4 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:50.577512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd326929-aba6-49f5-be5e-072da3c7ae1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:50.578315 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd326929-aba6-49f5-be5e-072da3c7ae1a admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:50.578726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd326929-aba6-49f5-be5e-072da3c7ae1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:50.579768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd326929-aba6-49f5-be5e-072da3c7ae1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:50.580906 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd326929-aba6-49f5-be5e-072da3c7ae1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:50.583327 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd326929-aba6-49f5-be5e-072da3c7ae1a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:50.634420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 823/1654] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:57:50 2022] POST /identity/v3/projects => generated 377 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:50.638341 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bee83e-45b0-43f8-bb8b-4d9445b4c27e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:50.661687 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bee83e-45b0-43f8-bb8b-4d9445b4c27e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:50.749351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f07fe6-cac6-4097-884b-f65a2ab78496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:50.750079 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f07fe6-cac6-4097-884b-f65a2ab78496 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:50.750416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f07fe6-cac6-4097-884b-f65a2ab78496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:50.750885 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f07fe6-cac6-4097-884b-f65a2ab78496 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:50.751749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f07fe6-cac6-4097-884b-f65a2ab78496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:50.754236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f07fe6-cac6-4097-884b-f65a2ab78496 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:50.784813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 832/1655] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:57:50 2022] POST /identity/v3/users => generated 295 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:50.789783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd326929-aba6-49f5-be5e-072da3c7ae1a admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:50.801044 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd326929-aba6-49f5-be5e-072da3c7ae1a admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:50.805848 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e1965-516c-4373-bfea-4170ad182e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:50.806468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e1965-516c-4373-bfea-4170ad182e05 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:50.806744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e1965-516c-4373-bfea-4170ad182e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:50.807068 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e1965-516c-4373-bfea-4170ad182e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:50.807757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e1965-516c-4373-bfea-4170ad182e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:50.809573 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e1965-516c-4373-bfea-4170ad182e05 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:50.824143 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 824/1656] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:57:50.828766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f07fe6-cac6-4097-884b-f65a2ab78496 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:50.844793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f07fe6-cac6-4097-884b-f65a2ab78496 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:50.850876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4fc01-35b8-4542-978e-d55150eaa727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:50.852054 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4fc01-35b8-4542-978e-d55150eaa727 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:50.853100 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4fc01-35b8-4542-978e-d55150eaa727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:50.853729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4fc01-35b8-4542-978e-d55150eaa727 admin admin] PATH_INFO: `/v3/projects/10bee923074d4c9ead770898c7045705/users/861b034a04c04233bb0620431fffdacc/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:50.879498 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4fc01-35b8-4542-978e-d55150eaa727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10bee923074d4c9ead770898c7045705, user_id=861b034a04c04233bb0620431fffdacc, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:50.882869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4fc01-35b8-4542-978e-d55150eaa727 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:50.922112 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 833/1657] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:57:50 2022] PUT /identity/v3/projects/10bee923074d4c9ead770898c7045705/users/861b034a04c04233bb0620431fffdacc/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:57:50.926278 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e1965-516c-4373-bfea-4170ad182e05 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:50.940116 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e1965-516c-4373-bfea-4170ad182e05 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:51.055743 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577dfedf-d4f6-4039-9765-533772524e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:51.056564 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dfedf-d4f6-4039-9765-533772524e5b admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:51.056848 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dfedf-d4f6-4039-9765-533772524e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:51.057122 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dfedf-d4f6-4039-9765-533772524e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:51.057768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577dfedf-d4f6-4039-9765-533772524e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:51.059421 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577dfedf-d4f6-4039-9765-533772524e5b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:51.074135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 825/1658] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:51.079703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4fc01-35b8-4542-978e-d55150eaa727 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:51.093923 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4fc01-35b8-4542-978e-d55150eaa727 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:51.104952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e964e4-6566-4e1a-90f1-dcee6390349e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:51.105703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e964e4-6566-4e1a-90f1-dcee6390349e admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:51.106019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e964e4-6566-4e1a-90f1-dcee6390349e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:51.106241 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e964e4-6566-4e1a-90f1-dcee6390349e admin admin] PATH_INFO: `/v3/projects/10bee923074d4c9ead770898c7045705/users/861b034a04c04233bb0620431fffdacc/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:51.109143 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e964e4-6566-4e1a-90f1-dcee6390349e admin admin] RBAC: Authorizing `identity:create_grant(project_id=10bee923074d4c9ead770898c7045705, user_id=861b034a04c04233bb0620431fffdacc, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:51.112740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e964e4-6566-4e1a-90f1-dcee6390349e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:51.140146 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 834/1659] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:57:51 2022] PUT /identity/v3/projects/10bee923074d4c9ead770898c7045705/users/861b034a04c04233bb0620431fffdacc/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:57:51.152723 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b74b5f-d252-4e21-832e-3478b8101f77 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:51.153177 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b74b5f-d252-4e21-832e-3478b8101f77 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:51.153521 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b74b5f-d252-4e21-832e-3478b8101f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:51.230740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-91b74b5f-d252-4e21-832e-3478b8101f77 None None] MFA Rules not processed for user `861b034a04c04233bb0620431fffdacc`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:51.234075 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-91b74b5f-d252-4e21-832e-3478b8101f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:51.419254 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 826/1660] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:51.455609 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e964e4-6566-4e1a-90f1-dcee6390349e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:51.458226 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-92e964e4-6566-4e1a-90f1-dcee6390349e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:51.571034 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:51.650831 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e964e4-6566-4e1a-90f1-dcee6390349e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:51.654505 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ab936-d6e3-480b-b010-413d34069c01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:51.655551 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ab936-d6e3-480b-b010-413d34069c01 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:51.655972 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ab936-d6e3-480b-b010-413d34069c01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:51.656547 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ab936-d6e3-480b-b010-413d34069c01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:51.851959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ab936-d6e3-480b-b010-413d34069c01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:51.857139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ab936-d6e3-480b-b010-413d34069c01 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:51.888624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 835/1661] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:57:51.967483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b74b5f-d252-4e21-832e-3478b8101f77 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:51.969009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-91b74b5f-d252-4e21-832e-3478b8101f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:51.975197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:52.105755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb54dc-e6b4-4304-bbf3-772e6f177b56 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:52.106629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb54dc-e6b4-4304-bbf3-772e6f177b56 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:52.106943 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb54dc-e6b4-4304-bbf3-772e6f177b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:52.165458 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b74b5f-d252-4e21-832e-3478b8101f77 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:52.185954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52250673-275b-4d24-b004-f72a22f3128f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:52.188078 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52250673-275b-4d24-b004-f72a22f3128f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:52.188425 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52250673-275b-4d24-b004-f72a22f3128f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:52.188837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52250673-275b-4d24-b004-f72a22f3128f admin admin] PATH_INFO: `/v3/users/ce4eb9b498ee48a1828d47db4f835a2c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:52.191411 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52250673-275b-4d24-b004-f72a22f3128f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce4eb9b498ee48a1828d47db4f835a2c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:52.193515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52250673-275b-4d24-b004-f72a22f3128f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:52.248040 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-89eb54dc-e6b4-4304-bbf3-772e6f177b56 None None] MFA Rules not processed for user `985216f4610e4da19d73c5d3a823a134`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:52.250418 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-89eb54dc-e6b4-4304-bbf3-772e6f177b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:52.371738 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-52250673-275b-4d24-b004-f72a22f3128f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce4eb9b498ee48a1828d47db4f835a2c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:52.393041 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-52250673-275b-4d24-b004-f72a22f3128f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce4eb9b498ee48a1828d47db4f835a2c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:52.413036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-52250673-275b-4d24-b004-f72a22f3128f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce4eb9b498ee48a1828d47db4f835a2c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:52.414091 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-52250673-275b-4d24-b004-f72a22f3128f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce4eb9b498ee48a1828d47db4f835a2c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:52.461815 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-52250673-275b-4d24-b004-f72a22f3128f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce4eb9b498ee48a1828d47db4f835a2c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:52.492812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 827/1662] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:57:51 2022] DELETE /identity/v3/users/ce4eb9b498ee48a1828d47db4f835a2c => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:57:52.499301 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc0c7c-4478-4333-a742-3ece8bf244b0 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:52.499582 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc0c7c-4478-4333-a742-3ece8bf244b0 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:52.499866 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc0c7c-4478-4333-a742-3ece8bf244b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:52.587286 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 836/1663] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:57:52.591395 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-4ebc0c7c-4478-4333-a742-3ece8bf244b0 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:52.592920 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4ebc0c7c-4478-4333-a742-3ece8bf244b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:52.598538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638d666-bd30-4c2b-a9b0-94d878a9f864 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:52.599781 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638d666-bd30-4c2b-a9b0-94d878a9f864 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:52.600957 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638d666-bd30-4c2b-a9b0-94d878a9f864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:52.659701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1638d666-bd30-4c2b-a9b0-94d878a9f864 None None] MFA Rules not processed for user `985216f4610e4da19d73c5d3a823a134`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:52.662326 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1638d666-bd30-4c2b-a9b0-94d878a9f864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:52.780378 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 828/1664] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:52.790141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc0c7c-4478-4333-a742-3ece8bf244b0 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:52.793743 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4ebc0c7c-4478-4333-a742-3ece8bf244b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:52.798379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 837/1665] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:57:52.811875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638d666-bd30-4c2b-a9b0-94d878a9f864 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:52.814087 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1638d666-bd30-4c2b-a9b0-94d878a9f864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:52.843256 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:52.887659 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:52.963413 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc0c7c-4478-4333-a742-3ece8bf244b0 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:52.973882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed08f9-e523-400d-bc47-7b0050da2ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:52.974534 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed08f9-e523-400d-bc47-7b0050da2ccb service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:52.974834 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed08f9-e523-400d-bc47-7b0050da2ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:52.976393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed08f9-e523-400d-bc47-7b0050da2ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:52.999839 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed08f9-e523-400d-bc47-7b0050da2ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:53.001607 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed08f9-e523-400d-bc47-7b0050da2ccb service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:53.022839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638d666-bd30-4c2b-a9b0-94d878a9f864 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:53.035858 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 829/1666] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:57:53.036842 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389865d-24df-45a0-af93-14dde69074f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:53.040057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389865d-24df-45a0-af93-14dde69074f8 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:53.040880 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389865d-24df-45a0-af93-14dde69074f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:53.041173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389865d-24df-45a0-af93-14dde69074f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:53.061188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389865d-24df-45a0-af93-14dde69074f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:53.063287 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389865d-24df-45a0-af93-14dde69074f8 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:53.090635 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 838/1667] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:57:53.318809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed08f9-e523-400d-bc47-7b0050da2ccb service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:53.320678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-16ed08f9-e523-400d-bc47-7b0050da2ccb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:53.351285 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed08f9-e523-400d-bc47-7b0050da2ccb service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:53.374991 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55372edc-38b7-4a45-8577-24c1b37aa465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:53.375739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55372edc-38b7-4a45-8577-24c1b37aa465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:53.376060 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55372edc-38b7-4a45-8577-24c1b37aa465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:53.376328 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55372edc-38b7-4a45-8577-24c1b37aa465 admin admin] PATH_INFO: `/v3/projects/48a9daa839e04fcb9189a753fa3df9db` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:53.383722 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55372edc-38b7-4a45-8577-24c1b37aa465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48a9daa839e04fcb9189a753fa3df9db)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:53.384785 dv-cinder-839768-2-smb devstack@keystone.service[81553]: WARNING py.warnings [None req-55372edc-38b7-4a45-8577-24c1b37aa465 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:57:53.384785 dv-cinder-839768-2-smb devstack@keystone.service[81553]: warnings.warn(msg) Aug 30 11:57:53.384785 dv-cinder-839768-2-smb devstack@keystone.service[81553]: Aug 30 11:57:53.398701 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55372edc-38b7-4a45-8577-24c1b37aa465 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:53.658222 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-55372edc-38b7-4a45-8577-24c1b37aa465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a9daa839e04fcb9189a753fa3df9db', 'request_id': 'req-55372edc-38b7-4a45-8577-24c1b37aa465'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:53.689857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-55372edc-38b7-4a45-8577-24c1b37aa465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a9daa839e04fcb9189a753fa3df9db', 'request_id': 'req-55372edc-38b7-4a45-8577-24c1b37aa465'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:53.698289 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-55372edc-38b7-4a45-8577-24c1b37aa465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a9daa839e04fcb9189a753fa3df9db', 'request_id': 'req-55372edc-38b7-4a45-8577-24c1b37aa465'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:53.732807 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-55372edc-38b7-4a45-8577-24c1b37aa465 admin admin] The token cache is being invalidate because project 48a9daa839e04fcb9189a753fa3df9db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:57:53.733546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-55372edc-38b7-4a45-8577-24c1b37aa465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:53.734436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-55372edc-38b7-4a45-8577-24c1b37aa465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:53.738215 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 830/1668] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:57:53 2022] DELETE /identity/v3/projects/48a9daa839e04fcb9189a753fa3df9db => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:57:53.742945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f29f2-07b8-41b5-b1c3-e78f54340c01 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:53.743711 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f29f2-07b8-41b5-b1c3-e78f54340c01 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:53.743994 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f29f2-07b8-41b5-b1c3-e78f54340c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:53.770840 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-903f29f2-07b8-41b5-b1c3-e78f54340c01 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:53.774371 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-903f29f2-07b8-41b5-b1c3-e78f54340c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:53.885501 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 839/1669] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:53.891150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d6ab7-a8ae-47f9-ad6d-fdf1b016d8ca None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:53.891458 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d6ab7-a8ae-47f9-ad6d-fdf1b016d8ca None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:53.891730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d6ab7-a8ae-47f9-ad6d-fdf1b016d8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:53.948032 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e82d6ab7-a8ae-47f9-ad6d-fdf1b016d8ca None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:53.949359 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e82d6ab7-a8ae-47f9-ad6d-fdf1b016d8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:53.968542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 831/1670] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:53.969797 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f29f2-07b8-41b5-b1c3-e78f54340c01 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:53.985046 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f29f2-07b8-41b5-b1c3-e78f54340c01 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:53.994390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8ef80-0b14-4b69-8d4e-00d4ee75c6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:53.995344 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8ef80-0b14-4b69-8d4e-00d4ee75c6bf admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:53.995746 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8ef80-0b14-4b69-8d4e-00d4ee75c6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:53.996090 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8ef80-0b14-4b69-8d4e-00d4ee75c6bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:53.997349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8ef80-0b14-4b69-8d4e-00d4ee75c6bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:57:53.997704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8ef80-0b14-4b69-8d4e-00d4ee75c6bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:54.000593 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8ef80-0b14-4b69-8d4e-00d4ee75c6bf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:54.023415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 840/1671] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:57:54.027636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d6ab7-a8ae-47f9-ad6d-fdf1b016d8ca None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:54.052928 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d6ab7-a8ae-47f9-ad6d-fdf1b016d8ca None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:54.064037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f679c6-a635-4be4-b6b3-191bdaf7e6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:54.067579 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f679c6-a635-4be4-b6b3-191bdaf7e6c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:54.068456 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f679c6-a635-4be4-b6b3-191bdaf7e6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:54.069088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f679c6-a635-4be4-b6b3-191bdaf7e6c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:54.070090 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f679c6-a635-4be4-b6b3-191bdaf7e6c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:54.076531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f679c6-a635-4be4-b6b3-191bdaf7e6c5 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:54.137762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ecc91-b4cc-489f-9ff6-d291eebafec3 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:54.138558 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ecc91-b4cc-489f-9ff6-d291eebafec3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:54.138955 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ecc91-b4cc-489f-9ff6-d291eebafec3 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:54.141061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 841/1672] 10.222.0.27 () {54 vars in 912 bytes} [Tue Aug 30 11:57:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:57:54.161530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3195e3-602d-464a-8e93-e331466d257a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:54.161912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3195e3-602d-464a-8e93-e331466d257a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:54.162263 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3195e3-602d-464a-8e93-e331466d257a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:54.178875 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 832/1673] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:57:54 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:54.180523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f679c6-a635-4be4-b6b3-191bdaf7e6c5 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:54.310708 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-fc3195e3-602d-464a-8e93-e331466d257a None None] MFA Rules not processed for user `f3be96d37b4e4dd889be755b004bfe52`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:54.320409 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fc3195e3-602d-464a-8e93-e331466d257a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:54.386028 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f679c6-a635-4be4-b6b3-191bdaf7e6c5 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:54.395906 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc66fe-6d7b-4802-9586-134d2ffd05be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:54.396571 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc66fe-6d7b-4802-9586-134d2ffd05be admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:54.396834 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc66fe-6d7b-4802-9586-134d2ffd05be admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:54.397160 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc66fe-6d7b-4802-9586-134d2ffd05be admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:54.397815 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc66fe-6d7b-4802-9586-134d2ffd05be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:54.399762 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc66fe-6d7b-4802-9586-134d2ffd05be admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:54.451411 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 833/1674] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:57:54 2022] POST /identity/v3/users => generated 294 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:54.456245 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc66fe-6d7b-4802-9586-134d2ffd05be admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:54.461071 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 842/1675] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Aug 30 11:57:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:57:54.476410 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3195e3-602d-464a-8e93-e331466d257a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:54.478285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fc3195e3-602d-464a-8e93-e331466d257a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:54.481546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc66fe-6d7b-4802-9586-134d2ffd05be admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:54.495426 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcbae4-7c3e-43f4-b850-cd3eda2cd987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:54.496144 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcbae4-7c3e-43f4-b850-cd3eda2cd987 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:54.496521 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcbae4-7c3e-43f4-b850-cd3eda2cd987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:54.498345 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcbae4-7c3e-43f4-b850-cd3eda2cd987 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:54.499482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcbae4-7c3e-43f4-b850-cd3eda2cd987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:54.501219 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcbae4-7c3e-43f4-b850-cd3eda2cd987 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:54.504448 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:54.511610 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3195e3-602d-464a-8e93-e331466d257a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:54.522767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b0ea1-90e2-4cc1-9253-c01de730030a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:54.525279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b0ea1-90e2-4cc1-9253-c01de730030a service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:54.525567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b0ea1-90e2-4cc1-9253-c01de730030a service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:54.525831 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b0ea1-90e2-4cc1-9253-c01de730030a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:54.530952 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 834/1676] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:54.533557 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcbae4-7c3e-43f4-b850-cd3eda2cd987 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:54.554059 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b0ea1-90e2-4cc1-9253-c01de730030a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:54.561372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b0ea1-90e2-4cc1-9253-c01de730030a service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:54.568967 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcbae4-7c3e-43f4-b850-cd3eda2cd987 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:54.588453 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945ee79-6735-41c5-a94f-50d917122fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:54.589243 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945ee79-6735-41c5-a94f-50d917122fdd admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:54.589532 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945ee79-6735-41c5-a94f-50d917122fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:54.589857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945ee79-6735-41c5-a94f-50d917122fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:54.590547 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945ee79-6735-41c5-a94f-50d917122fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:54.591409 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 843/1677] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:57:54.593580 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945ee79-6735-41c5-a94f-50d917122fdd admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:54.612638 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b0ea1-90e2-4cc1-9253-c01de730030a service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:54.615085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 835/1678] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:54.627265 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b0ea1-90e2-4cc1-9253-c01de730030a service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:54.632214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dae1af-64fd-43ad-adc5-0a4a0f756111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:54.633929 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dae1af-64fd-43ad-adc5-0a4a0f756111 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:54.634380 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dae1af-64fd-43ad-adc5-0a4a0f756111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:54.634662 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dae1af-64fd-43ad-adc5-0a4a0f756111 admin admin] PATH_INFO: `/v3/projects/bf3a0228aa2c49ac90823517d001e8dc/users/bfd4a181cbc541a6adba60eb7956b12d/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:54.638093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:54.672449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dae1af-64fd-43ad-adc5-0a4a0f756111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf3a0228aa2c49ac90823517d001e8dc, user_id=bfd4a181cbc541a6adba60eb7956b12d, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:54.676901 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dae1af-64fd-43ad-adc5-0a4a0f756111 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:54.707302 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 844/1679] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:57:54 2022] PUT /identity/v3/projects/bf3a0228aa2c49ac90823517d001e8dc/users/bfd4a181cbc541a6adba60eb7956b12d/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:57:54.721436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1c60d-3084-4115-aa0b-bb60a5798535 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:54.721825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1c60d-3084-4115-aa0b-bb60a5798535 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:54.721983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1c60d-3084-4115-aa0b-bb60a5798535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:54.799137 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-ade1c60d-3084-4115-aa0b-bb60a5798535 None None] MFA Rules not processed for user `bfd4a181cbc541a6adba60eb7956b12d`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:54.800778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ade1c60d-3084-4115-aa0b-bb60a5798535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:54.990183 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 836/1680] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:54.995182 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dae1af-64fd-43ad-adc5-0a4a0f756111 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:55.012262 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1c60d-3084-4115-aa0b-bb60a5798535 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:55.013828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ade1c60d-3084-4115-aa0b-bb60a5798535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:55.165480 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dae1af-64fd-43ad-adc5-0a4a0f756111 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:55.186758 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8626fd-2c6e-40e3-ba67-e007a1cfa7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:55.188100 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8626fd-2c6e-40e3-ba67-e007a1cfa7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:55.188100 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8626fd-2c6e-40e3-ba67-e007a1cfa7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:55.188230 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8626fd-2c6e-40e3-ba67-e007a1cfa7c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:55.188804 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8626fd-2c6e-40e3-ba67-e007a1cfa7c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:55.193668 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8626fd-2c6e-40e3-ba67-e007a1cfa7c7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:55.199844 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1c60d-3084-4115-aa0b-bb60a5798535 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:55.234656 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a23a1f-157c-4109-8182-b33fb759edc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:55.239988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a23a1f-157c-4109-8182-b33fb759edc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:55.240341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a23a1f-157c-4109-8182-b33fb759edc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:55.240564 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a23a1f-157c-4109-8182-b33fb759edc2 admin admin] PATH_INFO: `/v3/projects/12cab1ed65884379bdbc88121c4437a2` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:55.243612 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a23a1f-157c-4109-8182-b33fb759edc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12cab1ed65884379bdbc88121c4437a2)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:55.249149 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a23a1f-157c-4109-8182-b33fb759edc2 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:55.292301 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 845/1681] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:57:54 2022] POST /identity/v3/projects => generated 387 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:55.296337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8626fd-2c6e-40e3-ba67-e007a1cfa7c7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:55.394371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-45a23a1f-157c-4109-8182-b33fb759edc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12cab1ed65884379bdbc88121c4437a2', 'request_id': 'req-45a23a1f-157c-4109-8182-b33fb759edc2'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:55.418520 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-45a23a1f-157c-4109-8182-b33fb759edc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12cab1ed65884379bdbc88121c4437a2', 'request_id': 'req-45a23a1f-157c-4109-8182-b33fb759edc2'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:55.457556 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-45a23a1f-157c-4109-8182-b33fb759edc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12cab1ed65884379bdbc88121c4437a2', 'request_id': 'req-45a23a1f-157c-4109-8182-b33fb759edc2'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:55.492121 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8626fd-2c6e-40e3-ba67-e007a1cfa7c7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:55.510236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-45a23a1f-157c-4109-8182-b33fb759edc2 admin admin] The token cache is being invalidate because project 12cab1ed65884379bdbc88121c4437a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:57:55.511247 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-45a23a1f-157c-4109-8182-b33fb759edc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:55.511634 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-45a23a1f-157c-4109-8182-b33fb759edc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:57:55.514964 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 837/1682] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:57:55 2022] DELETE /identity/v3/projects/12cab1ed65884379bdbc88121c4437a2 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:57:55.515941 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a23a1f-157c-4109-8182-b33fb759edc2 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:55.517428 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-45a23a1f-157c-4109-8182-b33fb759edc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:55.530344 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:55.622362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a23a1f-157c-4109-8182-b33fb759edc2 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:55.627701 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddee40-760a-479d-b1c4-31ab798cd7ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:55.628379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddee40-760a-479d-b1c4-31ab798cd7ac service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:55.628701 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddee40-760a-479d-b1c4-31ab798cd7ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:55.628988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddee40-760a-479d-b1c4-31ab798cd7ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:55.630902 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e9ddee40-760a-479d-b1c4-31ab798cd7ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:55.673853 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1b573-4ebb-4e8a-ac6e-5dbd5fd78057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:55.674746 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1b573-4ebb-4e8a-ac6e-5dbd5fd78057 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:55.675027 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1b573-4ebb-4e8a-ac6e-5dbd5fd78057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:55.675302 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1b573-4ebb-4e8a-ac6e-5dbd5fd78057 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:55.677391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1b573-4ebb-4e8a-ac6e-5dbd5fd78057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:55.689667 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1b573-4ebb-4e8a-ac6e-5dbd5fd78057 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:55.752697 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 846/1683] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:57:55 2022] POST /identity/v3/users => generated 294 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:57:55.752697 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5f04d-4478-4f51-aa26-82ee1a77834e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:55.752697 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5f04d-4478-4f51-aa26-82ee1a77834e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:55.752697 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5f04d-4478-4f51-aa26-82ee1a77834e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:55.786215 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:55.803095 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d5e5f04d-4478-4f51-aa26-82ee1a77834e None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:55.804369 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d5e5f04d-4478-4f51-aa26-82ee1a77834e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:55.846903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 847/1684] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:55.847951 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5f04d-4478-4f51-aa26-82ee1a77834e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:55.857257 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d5e5f04d-4478-4f51-aa26-82ee1a77834e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:55.892433 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddee40-760a-479d-b1c4-31ab798cd7ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:55.896716 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddee40-760a-479d-b1c4-31ab798cd7ac service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:55.910822 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5f04d-4478-4f51-aa26-82ee1a77834e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:55.921729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c27cc-afbb-4701-8cf2-701fd2440d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:55.922374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c27cc-afbb-4701-8cf2-701fd2440d6d admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:55.922660 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c27cc-afbb-4701-8cf2-701fd2440d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:55.923061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c27cc-afbb-4701-8cf2-701fd2440d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:55.923601 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c27cc-afbb-4701-8cf2-701fd2440d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:55.925517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c27cc-afbb-4701-8cf2-701fd2440d6d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:55.950658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 838/1685] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:57:55.957128 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 848/1686] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:55.970107 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c27cc-afbb-4701-8cf2-701fd2440d6d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:55.972820 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3d3c27cc-afbb-4701-8cf2-701fd2440d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:55.974210 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e13ce2-6899-4c59-84a5-074d7db54986 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:55.974497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e13ce2-6899-4c59-84a5-074d7db54986 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:55.974772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e13ce2-6899-4c59-84a5-074d7db54986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:56.071873 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-24e13ce2-6899-4c59-84a5-074d7db54986 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:56.078116 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-24e13ce2-6899-4c59-84a5-074d7db54986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:56.114084 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 839/1687] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:56.115315 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e13ce2-6899-4c59-84a5-074d7db54986 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:56.147991 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e13ce2-6899-4c59-84a5-074d7db54986 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:56.175737 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b728d13-7a7e-44ed-9350-9aa2d44be208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:56.176457 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b728d13-7a7e-44ed-9350-9aa2d44be208 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:56.176742 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b728d13-7a7e-44ed-9350-9aa2d44be208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:56.177012 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b728d13-7a7e-44ed-9350-9aa2d44be208 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:56.177665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b728d13-7a7e-44ed-9350-9aa2d44be208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:56.186685 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b728d13-7a7e-44ed-9350-9aa2d44be208 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:56.209970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 840/1688] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:56.212135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ccaa1-d981-4aec-96b7-5f072e5d012e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:56.212906 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ccaa1-d981-4aec-96b7-5f072e5d012e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:56.213326 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ccaa1-d981-4aec-96b7-5f072e5d012e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:56.257023 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c27cc-afbb-4701-8cf2-701fd2440d6d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:56.263143 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-cc5ccaa1-d981-4aec-96b7-5f072e5d012e None None] MFA Rules not processed for user `985216f4610e4da19d73c5d3a823a134`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:56.266724 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-cc5ccaa1-d981-4aec-96b7-5f072e5d012e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:56.273956 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9f3ca-26e8-44aa-9618-6cffd098b437 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9efd2ac7fc4a42558e8dc48c408ce525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:56.275013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9f3ca-26e8-44aa-9618-6cffd098b437 service placement] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:56.275512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9f3ca-26e8-44aa-9618-6cffd098b437 service placement] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:56.275989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9f3ca-26e8-44aa-9618-6cffd098b437 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:56.285664 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9db9f3ca-26e8-44aa-9618-6cffd098b437 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:56.309711 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9f3ca-26e8-44aa-9618-6cffd098b437 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:56.311324 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9f3ca-26e8-44aa-9618-6cffd098b437 service placement] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:56.334930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 849/1689] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:57:56.335915 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9f3ca-26e8-44aa-9618-6cffd098b437 service placement] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:56.360518 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9f3ca-26e8-44aa-9618-6cffd098b437 service placement] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:56.371335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499fd9f-d355-4341-b584-be5cfad86a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:56.372726 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499fd9f-d355-4341-b584-be5cfad86a07 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:56.373147 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499fd9f-d355-4341-b584-be5cfad86a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:56.373558 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499fd9f-d355-4341-b584-be5cfad86a07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:56.374628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499fd9f-d355-4341-b584-be5cfad86a07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:57:56.375130 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499fd9f-d355-4341-b584-be5cfad86a07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:56.385734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499fd9f-d355-4341-b584-be5cfad86a07 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:56.406006 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 850/1690] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:57:56.407981 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499fd9f-d355-4341-b584-be5cfad86a07 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:56.425067 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499fd9f-d355-4341-b584-be5cfad86a07 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:56.433993 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfd959-486d-4d49-9e48-41261cd23fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:56.434896 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfd959-486d-4d49-9e48-41261cd23fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:56.435301 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfd959-486d-4d49-9e48-41261cd23fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:56.435997 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfd959-486d-4d49-9e48-41261cd23fb8 admin admin] PATH_INFO: `/v3/projects/fcf246cb3b434cb38689764793dcb2cc/users/ee8ac8613fd64909b0d2d9684f22d729/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:56.461809 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfd959-486d-4d49-9e48-41261cd23fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf246cb3b434cb38689764793dcb2cc, user_id=ee8ac8613fd64909b0d2d9684f22d729, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:56.465963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfd959-486d-4d49-9e48-41261cd23fb8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:56.471513 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 841/1691] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:56.473800 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ccaa1-d981-4aec-96b7-5f072e5d012e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:56.510333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ccaa1-d981-4aec-96b7-5f072e5d012e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:56.514668 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 851/1692] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:57:56 2022] PUT /identity/v3/projects/fcf246cb3b434cb38689764793dcb2cc/users/ee8ac8613fd64909b0d2d9684f22d729/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:57:56.528080 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893eaa3-7a78-478d-bb27-f6a01c3a1ab0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:56.528798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893eaa3-7a78-478d-bb27-f6a01c3a1ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:56.528798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893eaa3-7a78-478d-bb27-f6a01c3a1ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:56.609954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e893eaa3-7a78-478d-bb27-f6a01c3a1ab0 None None] MFA Rules not processed for user `ee8ac8613fd64909b0d2d9684f22d729`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:56.616065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e893eaa3-7a78-478d-bb27-f6a01c3a1ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:56.686021 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:56.746139 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2398c-23b0-453f-bb65-0e6b094d4f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:56.746778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2398c-23b0-453f-bb65-0e6b094d4f81 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:56.747060 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2398c-23b0-453f-bb65-0e6b094d4f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:56.747334 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2398c-23b0-453f-bb65-0e6b094d4f81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:56.747998 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2398c-23b0-453f-bb65-0e6b094d4f81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:56.749955 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2398c-23b0-453f-bb65-0e6b094d4f81 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:56.845315 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 842/1693] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:57:56 2022] POST /identity/v3/projects => generated 373 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:56.846499 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2398c-23b0-453f-bb65-0e6b094d4f81 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:56.858354 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 852/1694] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:56.862651 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893eaa3-7a78-478d-bb27-f6a01c3a1ab0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:56.929821 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893eaa3-7a78-478d-bb27-f6a01c3a1ab0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:57.026327 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2398c-23b0-453f-bb65-0e6b094d4f81 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:57.032132 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ab158-6758-4263-8119-033df0342b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:57.033231 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ab158-6758-4263-8119-033df0342b9e admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:57.033906 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ab158-6758-4263-8119-033df0342b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:57.034451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ab158-6758-4263-8119-033df0342b9e admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:57.035515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ab158-6758-4263-8119-033df0342b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:57.037857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ab158-6758-4263-8119-033df0342b9e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:57.048586 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:57.079815 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 843/1695] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:57:56 2022] POST /identity/v3/users => generated 287 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:57.085547 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ab158-6758-4263-8119-033df0342b9e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:57.145515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ab158-6758-4263-8119-033df0342b9e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:57.168784 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc1cdc-9476-4904-b70b-0459aaaf7880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:57.169872 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc1cdc-9476-4904-b70b-0459aaaf7880 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:57.171166 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c08196-ccb8-43db-8152-d6caa89e7d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:57.174113 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc1cdc-9476-4904-b70b-0459aaaf7880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:57.174721 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc1cdc-9476-4904-b70b-0459aaaf7880 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:57.176258 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc1cdc-9476-4904-b70b-0459aaaf7880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:57.180032 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c08196-ccb8-43db-8152-d6caa89e7d0e admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:57.180032 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c08196-ccb8-43db-8152-d6caa89e7d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:57.182331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c08196-ccb8-43db-8152-d6caa89e7d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:57.184789 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc1cdc-9476-4904-b70b-0459aaaf7880 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:57.186815 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c08196-ccb8-43db-8152-d6caa89e7d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:57.194558 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c08196-ccb8-43db-8152-d6caa89e7d0e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:57.267922 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 844/1696] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:57.269766 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628928a0-eef6-4c50-b284-b28f3b330a8b None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:57.270954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628928a0-eef6-4c50-b284-b28f3b330a8b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:57.270954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628928a0-eef6-4c50-b284-b28f3b330a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:57.283875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 853/1697] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:57:56 2022] POST /identity/v3/projects => generated 387 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:57.285838 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc1cdc-9476-4904-b70b-0459aaaf7880 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:57.333840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-628928a0-eef6-4c50-b284-b28f3b330a8b None None] MFA Rules not processed for user `4086920bf3624371a3d0444d592feb47`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:57.335628 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-628928a0-eef6-4c50-b284-b28f3b330a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:57.485069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc1cdc-9476-4904-b70b-0459aaaf7880 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:57.494600 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62077f1-56fb-4721-aaae-9db48ea74120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:57.495892 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62077f1-56fb-4721-aaae-9db48ea74120 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:57.496176 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62077f1-56fb-4721-aaae-9db48ea74120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:57.496450 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62077f1-56fb-4721-aaae-9db48ea74120 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:57.497003 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 845/1698] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:57.498051 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628928a0-eef6-4c50-b284-b28f3b330a8b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:57.510725 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62077f1-56fb-4721-aaae-9db48ea74120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:57.514448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62077f1-56fb-4721-aaae-9db48ea74120 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:57.528505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628928a0-eef6-4c50-b284-b28f3b330a8b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:57.541406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4e805-f55c-42a2-a6da-a1efd2f34a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:57.542210 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4e805-f55c-42a2-a6da-a1efd2f34a4c admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:57.542724 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4e805-f55c-42a2-a6da-a1efd2f34a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:57.543087 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4e805-f55c-42a2-a6da-a1efd2f34a4c admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:57.543863 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4e805-f55c-42a2-a6da-a1efd2f34a4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:57.546398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4e805-f55c-42a2-a6da-a1efd2f34a4c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:57.553854 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 854/1699] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:57.555484 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abe8d0-87fe-4825-844f-2498b5b04f70 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:57.555775 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abe8d0-87fe-4825-844f-2498b5b04f70 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:57.556057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abe8d0-87fe-4825-844f-2498b5b04f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:57.594934 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c1abe8d0-87fe-4825-844f-2498b5b04f70 None None] MFA Rules not processed for user `4086920bf3624371a3d0444d592feb47`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:57.596799 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c1abe8d0-87fe-4825-844f-2498b5b04f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:57.609885 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 846/1700] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:57:57 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:57:57.609885 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4e805-f55c-42a2-a6da-a1efd2f34a4c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:57.613230 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 855/1701] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:57.619472 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abe8d0-87fe-4825-844f-2498b5b04f70 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:57.638107 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abe8d0-87fe-4825-844f-2498b5b04f70 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:57.643268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4e805-f55c-42a2-a6da-a1efd2f34a4c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:57.657911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2601f-e983-46c3-9a3e-90787bfc6039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:57.658076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b899fda-59a8-4295-9279-9a07ccb97990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:57.659152 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2601f-e983-46c3-9a3e-90787bfc6039 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:57.659658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2601f-e983-46c3-9a3e-90787bfc6039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:57.660324 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2601f-e983-46c3-9a3e-90787bfc6039 admin admin] PATH_INFO: `/v3/projects/847f15585a90420daa65392772d42bc5/users/be032d4ec3de45cab3699d741d9fbdf6/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:57.660678 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b899fda-59a8-4295-9279-9a07ccb97990 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:57.661011 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b899fda-59a8-4295-9279-9a07ccb97990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:57.662826 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b899fda-59a8-4295-9279-9a07ccb97990 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:57.665089 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b899fda-59a8-4295-9279-9a07ccb97990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:57.671489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b899fda-59a8-4295-9279-9a07ccb97990 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:57.703016 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e2601f-e983-46c3-9a3e-90787bfc6039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=847f15585a90420daa65392772d42bc5, user_id=be032d4ec3de45cab3699d741d9fbdf6, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:57.703216 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 856/1702] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:57.706606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e2601f-e983-46c3-9a3e-90787bfc6039 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:57.707463 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b899fda-59a8-4295-9279-9a07ccb97990 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:57.712764 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2b899fda-59a8-4295-9279-9a07ccb97990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:57.718878 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:57.751173 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 847/1703] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:57:57 2022] PUT /identity/v3/projects/847f15585a90420daa65392772d42bc5/users/be032d4ec3de45cab3699d741d9fbdf6/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:57:57.752456 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2601f-e983-46c3-9a3e-90787bfc6039 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:57.898609 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2601f-e983-46c3-9a3e-90787bfc6039 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:57.912596 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fa294-0136-43ee-a156-391da841366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:57.914921 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fa294-0136-43ee-a156-391da841366a admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:57.915263 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fa294-0136-43ee-a156-391da841366a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:57.915528 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fa294-0136-43ee-a156-391da841366a admin admin] PATH_INFO: `/v3/projects/9f5a8db97d3049cdbab0468a14828702/users/b3df582d843a4a46a64de81acd837536/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:57.959608 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fa294-0136-43ee-a156-391da841366a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f5a8db97d3049cdbab0468a14828702, user_id=b3df582d843a4a46a64de81acd837536, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:57.964892 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fa294-0136-43ee-a156-391da841366a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:57.995627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 848/1704] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:57:57 2022] PUT /identity/v3/projects/9f5a8db97d3049cdbab0468a14828702/users/b3df582d843a4a46a64de81acd837536/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:57:57.996996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69863305-a0ab-468e-9a90-f5805ee1cadc None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:57.997285 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69863305-a0ab-468e-9a90-f5805ee1cadc None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:57.997559 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69863305-a0ab-468e-9a90-f5805ee1cadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:58.083038 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-69863305-a0ab-468e-9a90-f5805ee1cadc None None] MFA Rules not processed for user `be032d4ec3de45cab3699d741d9fbdf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:58.084314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-69863305-a0ab-468e-9a90-f5805ee1cadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:58.088264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b899fda-59a8-4295-9279-9a07ccb97990 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:58.289334 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:58.374329 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 849/1705] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:58.376544 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319a22d-76f2-468f-a23e-33c8405a2597 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:58.378334 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319a22d-76f2-468f-a23e-33c8405a2597 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:58.378662 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319a22d-76f2-468f-a23e-33c8405a2597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:58.418231 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9574b7f-1f1d-410e-a4b4-39118fb138da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:58.422928 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9574b7f-1f1d-410e-a4b4-39118fb138da service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:58.429328 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9574b7f-1f1d-410e-a4b4-39118fb138da service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:58.430180 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9574b7f-1f1d-410e-a4b4-39118fb138da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:58.494224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-4319a22d-76f2-468f-a23e-33c8405a2597 None None] MFA Rules not processed for user `588d11e6ed3b4eda8c74e782669a63af`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:58.511950 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4319a22d-76f2-468f-a23e-33c8405a2597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:58.674056 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9574b7f-1f1d-410e-a4b4-39118fb138da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:58.675905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9574b7f-1f1d-410e-a4b4-39118fb138da service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:58.715807 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 857/1706] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 1012 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:57:58.718118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9574b7f-1f1d-410e-a4b4-39118fb138da service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:58.828459 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:57:58.855170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 850/1707] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:58.863635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319a22d-76f2-468f-a23e-33c8405a2597 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:58.866225 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4319a22d-76f2-468f-a23e-33c8405a2597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:58.927534 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319a22d-76f2-468f-a23e-33c8405a2597 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:58.953297 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a4c3c-4a8d-465b-b554-bc8bd09345aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:58.954112 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a4c3c-4a8d-465b-b554-bc8bd09345aa service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:58.954227 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a4c3c-4a8d-465b-b554-bc8bd09345aa service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:58.954478 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a4c3c-4a8d-465b-b554-bc8bd09345aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:58.993388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a4c3c-4a8d-465b-b554-bc8bd09345aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:59.001645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a4c3c-4a8d-465b-b554-bc8bd09345aa service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:59.012946 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9574b7f-1f1d-410e-a4b4-39118fb138da service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:59.031654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 851/1708] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:57:59.067539 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68532c25-7233-4f27-809e-10ce7fdfde7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:59.069688 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68532c25-7233-4f27-809e-10ce7fdfde7f admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:59.071098 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68532c25-7233-4f27-809e-10ce7fdfde7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:59.077309 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68532c25-7233-4f27-809e-10ce7fdfde7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:59.083614 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68532c25-7233-4f27-809e-10ce7fdfde7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:59.089090 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68532c25-7233-4f27-809e-10ce7fdfde7f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:59.132591 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a4c3c-4a8d-465b-b554-bc8bd09345aa service nova] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:59.154267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 858/1709] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:57:59.155196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68532c25-7233-4f27-809e-10ce7fdfde7f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:59.180472 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a4c3c-4a8d-465b-b554-bc8bd09345aa service nova] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:59.201281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68532c25-7233-4f27-809e-10ce7fdfde7f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:57:59.204957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47536cf6-f7e9-4993-aedf-31e6ef0b51d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:59.206314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47536cf6-f7e9-4993-aedf-31e6ef0b51d4 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:59.206604 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47536cf6-f7e9-4993-aedf-31e6ef0b51d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:59.206884 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47536cf6-f7e9-4993-aedf-31e6ef0b51d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:59.243312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6abbeb-e7c4-486c-8cd8-380c721b18a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:57:59.244089 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6abbeb-e7c4-486c-8cd8-380c721b18a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:59.244395 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6abbeb-e7c4-486c-8cd8-380c721b18a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:59.244725 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6abbeb-e7c4-486c-8cd8-380c721b18a0 admin admin] PATH_INFO: `/v3/projects/9f5a8db97d3049cdbab0468a14828702/users/b3df582d843a4a46a64de81acd837536/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:59.272275 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6abbeb-e7c4-486c-8cd8-380c721b18a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f5a8db97d3049cdbab0468a14828702, user_id=b3df582d843a4a46a64de81acd837536, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:59.276881 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47536cf6-f7e9-4993-aedf-31e6ef0b51d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:57:59.277779 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47536cf6-f7e9-4993-aedf-31e6ef0b51d4 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:59.280121 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6abbeb-e7c4-486c-8cd8-380c721b18a0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:57:59.356385 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 852/1710] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:57:59.369121 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 859/1711] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:57:59 2022] PUT /identity/v3/projects/9f5a8db97d3049cdbab0468a14828702/users/b3df582d843a4a46a64de81acd837536/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:57:59.380033 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a069f2a-bf4c-414f-a05f-868152354f8a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:59.380965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a069f2a-bf4c-414f-a05f-868152354f8a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:59.382621 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a069f2a-bf4c-414f-a05f-868152354f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:59.531275 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-4a069f2a-bf4c-414f-a05f-868152354f8a None None] MFA Rules not processed for user `b3df582d843a4a46a64de81acd837536`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:59.535054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4a069f2a-bf4c-414f-a05f-868152354f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:59.810624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a47ce-f886-4e21-967e-35a80bf453b9 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:59.811558 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a47ce-f886-4e21-967e-35a80bf453b9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:59.812768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a47ce-f886-4e21-967e-35a80bf453b9 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:59.815691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 860/1712] 10.222.0.27 () {54 vars in 912 bytes} [Tue Aug 30 11:57:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 11:57:59.821340 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133bed9-1ee5-48da-87c8-2e67b5dd176c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:57:59.821792 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133bed9-1ee5-48da-87c8-2e67b5dd176c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:57:59.822249 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133bed9-1ee5-48da-87c8-2e67b5dd176c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:57:59.863586 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 853/1713] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:57:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:57:59.870727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a069f2a-bf4c-414f-a05f-868152354f8a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:57:59.916732 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b133bed9-1ee5-48da-87c8-2e67b5dd176c None None] MFA Rules not processed for user `f3be96d37b4e4dd889be755b004bfe52`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:57:59.922058 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b133bed9-1ee5-48da-87c8-2e67b5dd176c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:57:59.992624 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a069f2a-bf4c-414f-a05f-868152354f8a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:00.007139 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c565a-47b2-4a19-a49a-dbd3cd8ba7f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:00.008083 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c565a-47b2-4a19-a49a-dbd3cd8ba7f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:00.008565 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c565a-47b2-4a19-a49a-dbd3cd8ba7f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:00.009035 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c565a-47b2-4a19-a49a-dbd3cd8ba7f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:00.025861 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c565a-47b2-4a19-a49a-dbd3cd8ba7f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:00.027904 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c565a-47b2-4a19-a49a-dbd3cd8ba7f6 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:00.042440 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 854/1714] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:57:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:00.180233 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 861/1715] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Aug 30 11:57:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 30 11:58:00.231615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c565a-47b2-4a19-a49a-dbd3cd8ba7f6 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:00.232524 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-016c565a-47b2-4a19-a49a-dbd3cd8ba7f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:00.260900 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c565a-47b2-4a19-a49a-dbd3cd8ba7f6 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:00.275077 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629f2b6-e6a5-458d-a6ea-5fd4e28b7b0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:00.277043 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629f2b6-e6a5-458d-a6ea-5fd4e28b7b0f service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:00.277459 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629f2b6-e6a5-458d-a6ea-5fd4e28b7b0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:00.280986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629f2b6-e6a5-458d-a6ea-5fd4e28b7b0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:00.313693 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629f2b6-e6a5-458d-a6ea-5fd4e28b7b0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:00.323199 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629f2b6-e6a5-458d-a6ea-5fd4e28b7b0f service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:00.356823 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 855/1716] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:00.818276 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133bed9-1ee5-48da-87c8-2e67b5dd176c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:00.836482 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:01.123037 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133bed9-1ee5-48da-87c8-2e67b5dd176c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:01.145188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f63b6d-7a47-442e-846c-d29c31a0587a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:01.146130 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f63b6d-7a47-442e-846c-d29c31a0587a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:01.146656 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f63b6d-7a47-442e-846c-d29c31a0587a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:01.147125 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f63b6d-7a47-442e-846c-d29c31a0587a admin admin] PATH_INFO: `/v3/users/be032d4ec3de45cab3699d741d9fbdf6` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:01.149473 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f63b6d-7a47-442e-846c-d29c31a0587a admin admin] RBAC: Authorizing `identity:delete_user(user_id=be032d4ec3de45cab3699d741d9fbdf6)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:01.150761 dv-cinder-839768-2-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-f1f63b6d-7a47-442e-846c-d29c31a0587a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 11:58:01.150761 dv-cinder-839768-2-smb devstack@keystone.service[81554]: warnings.warn(msg) Aug 30 11:58:01.150761 dv-cinder-839768-2-smb devstack@keystone.service[81554]: Aug 30 11:58:01.153380 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f63b6d-7a47-442e-846c-d29c31a0587a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:01.206412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594dd0a-4cdf-4646-875b-2cea7610878d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:01.206958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594dd0a-4cdf-4646-875b-2cea7610878d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:01.206958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594dd0a-4cdf-4646-875b-2cea7610878d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:01.316718 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-4594dd0a-4cdf-4646-875b-2cea7610878d None None] MFA Rules not processed for user `e9a57b9a59f84e16ac1e34d557d63a65`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:01.319012 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f1f63b6d-7a47-442e-846c-d29c31a0587a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be032d4ec3de45cab3699d741d9fbdf6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:01.321388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4594dd0a-4cdf-4646-875b-2cea7610878d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:01.346377 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f1f63b6d-7a47-442e-846c-d29c31a0587a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be032d4ec3de45cab3699d741d9fbdf6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:01.362737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f1f63b6d-7a47-442e-846c-d29c31a0587a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be032d4ec3de45cab3699d741d9fbdf6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:01.381443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:01.422735 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 856/1717] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:01.472531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f1f63b6d-7a47-442e-846c-d29c31a0587a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be032d4ec3de45cab3699d741d9fbdf6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:01.476082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f1f63b6d-7a47-442e-846c-d29c31a0587a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be032d4ec3de45cab3699d741d9fbdf6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:01.496294 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 862/1718] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:00 2022] DELETE /identity/v3/users/be032d4ec3de45cab3699d741d9fbdf6 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:01.501231 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae444a7-8113-4dac-a5b3-e186360cbed9 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:01.501512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae444a7-8113-4dac-a5b3-e186360cbed9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:01.502156 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae444a7-8113-4dac-a5b3-e186360cbed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:01.541228 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-5ae444a7-8113-4dac-a5b3-e186360cbed9 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:01.544031 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5ae444a7-8113-4dac-a5b3-e186360cbed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:01.566772 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ea0c6-f855-4b9b-b32a-46e96f0a4ae3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:01.567307 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ea0c6-f855-4b9b-b32a-46e96f0a4ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:01.567764 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ea0c6-f855-4b9b-b32a-46e96f0a4ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:01.775235 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-543ea0c6-f855-4b9b-b32a-46e96f0a4ae3 None None] MFA Rules not processed for user `58c86110ce97463e9b3d53691ae3e12c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:01.776502 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-543ea0c6-f855-4b9b-b32a-46e96f0a4ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:01.877818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 857/1719] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:01.880370 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae444a7-8113-4dac-a5b3-e186360cbed9 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:01.887608 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5ae444a7-8113-4dac-a5b3-e186360cbed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:01.995300 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:02.027247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 863/1720] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Aug 30 11:58:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:02.028726 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ea0c6-f855-4b9b-b32a-46e96f0a4ae3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:02.032334 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-543ea0c6-f855-4b9b-b32a-46e96f0a4ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:02.227549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae444a7-8113-4dac-a5b3-e186360cbed9 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:02.230927 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ea0c6-f855-4b9b-b32a-46e96f0a4ae3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:02.240576 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0f40b-f383-4288-9ed0-676bdcd668e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:02.241401 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0f40b-f383-4288-9ed0-676bdcd668e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:02.241609 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0f40b-f383-4288-9ed0-676bdcd668e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:02.241883 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0f40b-f383-4288-9ed0-676bdcd668e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:02.257341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c673f-0d0a-4847-a34e-45f35d5488e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:02.257963 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c673f-0d0a-4847-a34e-45f35d5488e4 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:02.258236 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c673f-0d0a-4847-a34e-45f35d5488e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:02.258499 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c673f-0d0a-4847-a34e-45f35d5488e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:02.261864 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bc2c673f-0d0a-4847-a34e-45f35d5488e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:02.270317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e0f40b-f383-4288-9ed0-676bdcd668e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:02.276184 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e0f40b-f383-4288-9ed0-676bdcd668e5 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:02.299123 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 864/1721] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:02.302723 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0f40b-f383-4288-9ed0-676bdcd668e5 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:02.305818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-67e0f40b-f383-4288-9ed0-676bdcd668e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:02.444858 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c673f-0d0a-4847-a34e-45f35d5488e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:02.446472 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c673f-0d0a-4847-a34e-45f35d5488e4 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:02.462723 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 858/1722] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:02.464951 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c673f-0d0a-4847-a34e-45f35d5488e4 service nova] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:02.466961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bc2c673f-0d0a-4847-a34e-45f35d5488e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:02.506583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:02.541637 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0f40b-f383-4288-9ed0-676bdcd668e5 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:02.547889 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984221de-ee98-4c01-b329-b51fe6755dab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:02.548760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984221de-ee98-4c01-b329-b51fe6755dab service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:02.549176 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984221de-ee98-4c01-b329-b51fe6755dab service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:02.550725 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984221de-ee98-4c01-b329-b51fe6755dab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:02.554408 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-984221de-ee98-4c01-b329-b51fe6755dab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:02.667646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c673f-0d0a-4847-a34e-45f35d5488e4 service nova] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:02.691462 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151cc30-1e46-4ce2-832f-05572fb3b4ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d27bfb8c0b64763b7db7cffa5f230f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:02.693421 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151cc30-1e46-4ce2-832f-05572fb3b4ce service swift] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:02.696047 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151cc30-1e46-4ce2-832f-05572fb3b4ce service swift] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:02.696408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151cc30-1e46-4ce2-832f-05572fb3b4ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:02.727817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151cc30-1e46-4ce2-832f-05572fb3b4ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:02.732664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151cc30-1e46-4ce2-832f-05572fb3b4ce service swift] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:02.755394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 859/1723] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Aug 30 11:58:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 11:58:02.828681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984221de-ee98-4c01-b329-b51fe6755dab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:02.834923 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984221de-ee98-4c01-b329-b51fe6755dab service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:02.876512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 865/1724] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:04.902396 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d580b79-8e67-4ac8-a550-fe812125e5c3 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:04.903118 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d580b79-8e67-4ac8-a550-fe812125e5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:04.903118 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d580b79-8e67-4ac8-a550-fe812125e5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:04.932802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-9d580b79-8e67-4ac8-a550-fe812125e5c3 None None] MFA Rules not processed for user `f3be96d37b4e4dd889be755b004bfe52`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:04.935499 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9d580b79-8e67-4ac8-a550-fe812125e5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:04.945849 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 860/1725] 10.222.0.45 () {58 vars in 1015 bytes} [Tue Aug 30 11:58:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:05.025403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984221de-ee98-4c01-b329-b51fe6755dab service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:05.040223 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984221de-ee98-4c01-b329-b51fe6755dab service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:05.070276 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11189c5f-c35a-4cc6-8385-5bf32220bbd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:05.072166 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11189c5f-c35a-4cc6-8385-5bf32220bbd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:05.077729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11189c5f-c35a-4cc6-8385-5bf32220bbd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:05.078233 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11189c5f-c35a-4cc6-8385-5bf32220bbd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:05.134901 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11189c5f-c35a-4cc6-8385-5bf32220bbd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:05.136710 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11189c5f-c35a-4cc6-8385-5bf32220bbd3 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:05.168145 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 866/1726] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:05.844905 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d580b79-8e67-4ac8-a550-fe812125e5c3 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:05.846713 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9d580b79-8e67-4ac8-a550-fe812125e5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:05.889898 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d580b79-8e67-4ac8-a550-fe812125e5c3 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:05.908520 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93975d-d1ca-452d-9f73-4fa15c2d3c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:05.909314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93975d-d1ca-452d-9f73-4fa15c2d3c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:05.911080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93975d-d1ca-452d-9f73-4fa15c2d3c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:05.911782 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93975d-d1ca-452d-9f73-4fa15c2d3c56 admin admin] PATH_INFO: `/v3/projects/847f15585a90420daa65392772d42bc5` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:05.922654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93975d-d1ca-452d-9f73-4fa15c2d3c56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=847f15585a90420daa65392772d42bc5)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:05.930047 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93975d-d1ca-452d-9f73-4fa15c2d3c56 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:06.088816 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fb93975d-d1ca-452d-9f73-4fa15c2d3c56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847f15585a90420daa65392772d42bc5', 'request_id': 'req-fb93975d-d1ca-452d-9f73-4fa15c2d3c56'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:06.116330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fb93975d-d1ca-452d-9f73-4fa15c2d3c56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847f15585a90420daa65392772d42bc5', 'request_id': 'req-fb93975d-d1ca-452d-9f73-4fa15c2d3c56'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:06.151996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fb93975d-d1ca-452d-9f73-4fa15c2d3c56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847f15585a90420daa65392772d42bc5', 'request_id': 'req-fb93975d-d1ca-452d-9f73-4fa15c2d3c56'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:06.188557 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fb93975d-d1ca-452d-9f73-4fa15c2d3c56 admin admin] The token cache is being invalidate because project 847f15585a90420daa65392772d42bc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:06.189349 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fb93975d-d1ca-452d-9f73-4fa15c2d3c56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:06.190380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fb93975d-d1ca-452d-9f73-4fa15c2d3c56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:06.193248 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 861/1727] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:05 2022] DELETE /identity/v3/projects/847f15585a90420daa65392772d42bc5 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:06.199299 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a4ba5-2980-4aab-97b1-bc1ddc306c2a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:06.200520 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a4ba5-2980-4aab-97b1-bc1ddc306c2a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:06.201440 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a4ba5-2980-4aab-97b1-bc1ddc306c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:06.257162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b21a4ba5-2980-4aab-97b1-bc1ddc306c2a None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:06.262841 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b21a4ba5-2980-4aab-97b1-bc1ddc306c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:06.372340 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:06.455846 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 867/1728] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:06.458395 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a39fdc-46ab-4cc5-a6c0-44637e28613e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:06.458688 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a39fdc-46ab-4cc5-a6c0-44637e28613e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:06.458960 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a39fdc-46ab-4cc5-a6c0-44637e28613e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:06.516954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-31a39fdc-46ab-4cc5-a6c0-44637e28613e None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:06.526040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-31a39fdc-46ab-4cc5-a6c0-44637e28613e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:06.559547 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 862/1729] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:06.560827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a4ba5-2980-4aab-97b1-bc1ddc306c2a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:06.573573 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a4ba5-2980-4aab-97b1-bc1ddc306c2a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:06.588282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3614f-eb41-414d-9188-618f8622384d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:06.589543 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3614f-eb41-414d-9188-618f8622384d admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:06.589543 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3614f-eb41-414d-9188-618f8622384d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:06.591324 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3614f-eb41-414d-9188-618f8622384d admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:06.595777 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3614f-eb41-414d-9188-618f8622384d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:06.596236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3614f-eb41-414d-9188-618f8622384d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:06.607385 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3614f-eb41-414d-9188-618f8622384d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:06.663674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 868/1730] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:06.668042 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a39fdc-46ab-4cc5-a6c0-44637e28613e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:06.703122 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a39fdc-46ab-4cc5-a6c0-44637e28613e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:06.714761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297e835-bf42-403b-a7dd-2070d505a284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:06.715436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297e835-bf42-403b-a7dd-2070d505a284 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:06.715720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297e835-bf42-403b-a7dd-2070d505a284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:06.716003 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297e835-bf42-403b-a7dd-2070d505a284 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:06.716626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297e835-bf42-403b-a7dd-2070d505a284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:06.718779 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297e835-bf42-403b-a7dd-2070d505a284 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:06.791383 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 863/1731] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:06 2022] POST /identity/v3/projects => generated 363 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:06.796222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3614f-eb41-414d-9188-618f8622384d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:06.814800 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3614f-eb41-414d-9188-618f8622384d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:07.029957 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f3be1-1632-4529-bc77-4d4d4e732df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:07.030781 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f3be1-1632-4529-bc77-4d4d4e732df1 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:07.031058 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f3be1-1632-4529-bc77-4d4d4e732df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:07.031341 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f3be1-1632-4529-bc77-4d4d4e732df1 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:07.032155 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f3be1-1632-4529-bc77-4d4d4e732df1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:07.034919 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f3be1-1632-4529-bc77-4d4d4e732df1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:07.164055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 869/1732] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:06 2022] POST /identity/v3/users => generated 282 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:07.165366 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297e835-bf42-403b-a7dd-2070d505a284 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:07.186709 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297e835-bf42-403b-a7dd-2070d505a284 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:07.199787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d53e2-45f6-4ff8-a38d-326bb3d9deef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:07.200588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d53e2-45f6-4ff8-a38d-326bb3d9deef admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:07.201167 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d53e2-45f6-4ff8-a38d-326bb3d9deef admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:07.201648 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d53e2-45f6-4ff8-a38d-326bb3d9deef admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:07.202637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d53e2-45f6-4ff8-a38d-326bb3d9deef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:07.207213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d53e2-45f6-4ff8-a38d-326bb3d9deef admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:07.246843 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f3be1-1632-4529-bc77-4d4d4e732df1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:07.256849 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 864/1733] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:07.261259 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f3be1-1632-4529-bc77-4d4d4e732df1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:07.284179 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24572769-b8a5-473a-ab58-b2e0254d57e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:07.285070 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24572769-b8a5-473a-ab58-b2e0254d57e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:07.285452 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24572769-b8a5-473a-ab58-b2e0254d57e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:07.285828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24572769-b8a5-473a-ab58-b2e0254d57e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:07.288125 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24572769-b8a5-473a-ab58-b2e0254d57e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:07.292004 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24572769-b8a5-473a-ab58-b2e0254d57e7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:07.330311 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 870/1734] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:07.347153 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d53e2-45f6-4ff8-a38d-326bb3d9deef admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:07.360348 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d53e2-45f6-4ff8-a38d-326bb3d9deef admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:07.366319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1671c3-2944-4847-a155-180ec8600c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:07.375073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1671c3-2944-4847-a155-180ec8600c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:07.375764 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1671c3-2944-4847-a155-180ec8600c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:07.376049 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1671c3-2944-4847-a155-180ec8600c8c admin admin] PATH_INFO: `/v3/projects/035b2d197a284c1e8c8ab46ec7dfa4bc/users/9bc9300cac6d46d281ba38fa7623d4cb/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:07.406153 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1671c3-2944-4847-a155-180ec8600c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=035b2d197a284c1e8c8ab46ec7dfa4bc, user_id=9bc9300cac6d46d281ba38fa7623d4cb, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:07.419066 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1671c3-2944-4847-a155-180ec8600c8c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:07.429340 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:07.467780 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 865/1735] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:07 2022] PUT /identity/v3/projects/035b2d197a284c1e8c8ab46ec7dfa4bc/users/9bc9300cac6d46d281ba38fa7623d4cb/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:07.470082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e14567-b9d0-4aa8-b2e9-5be1c2f7164c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:07.470716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e14567-b9d0-4aa8-b2e9-5be1c2f7164c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:07.471064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e14567-b9d0-4aa8-b2e9-5be1c2f7164c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:07.583988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-76e14567-b9d0-4aa8-b2e9-5be1c2f7164c None None] MFA Rules not processed for user `9bc9300cac6d46d281ba38fa7623d4cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:07.594071 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-76e14567-b9d0-4aa8-b2e9-5be1c2f7164c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:07.901680 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 871/1736] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:07.907345 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1671c3-2944-4847-a155-180ec8600c8c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:08.106907 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1671c3-2944-4847-a155-180ec8600c8c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:08.141025 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd788d-155b-43ef-a690-15c87238d160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:08.141977 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd788d-155b-43ef-a690-15c87238d160 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:08.142683 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd788d-155b-43ef-a690-15c87238d160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:08.143171 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd788d-155b-43ef-a690-15c87238d160 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:08.144056 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd788d-155b-43ef-a690-15c87238d160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:08.146745 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd788d-155b-43ef-a690-15c87238d160 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:08.257872 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e14567-b9d0-4aa8-b2e9-5be1c2f7164c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:08.258389 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 866/1737] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:07 2022] POST /identity/v3/projects => generated 365 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:08.285623 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e14567-b9d0-4aa8-b2e9-5be1c2f7164c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:08.406632 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:08.477274 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b5502-154c-47c3-aaeb-db2544a8b1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:08.478271 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b5502-154c-47c3-aaeb-db2544a8b1fc admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:08.478756 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b5502-154c-47c3-aaeb-db2544a8b1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:08.479201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b5502-154c-47c3-aaeb-db2544a8b1fc admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:08.480101 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b5502-154c-47c3-aaeb-db2544a8b1fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:08.484173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b5502-154c-47c3-aaeb-db2544a8b1fc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:08.567610 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 872/1738] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:08 2022] POST /identity/v3/users => generated 289 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:08.570464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd788d-155b-43ef-a690-15c87238d160 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:08.587726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd788d-155b-43ef-a690-15c87238d160 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:08.605421 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d32974-d2e0-48c6-8f76-59b5c8401ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:08.606710 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d32974-d2e0-48c6-8f76-59b5c8401ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:08.609257 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d32974-d2e0-48c6-8f76-59b5c8401ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:08.609707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d32974-d2e0-48c6-8f76-59b5c8401ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:08.621585 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d32974-d2e0-48c6-8f76-59b5c8401ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:08.626561 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d32974-d2e0-48c6-8f76-59b5c8401ac7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:08.652138 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b5502-154c-47c3-aaeb-db2544a8b1fc admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:08.659452 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 867/1739] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:08.676205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b5502-154c-47c3-aaeb-db2544a8b1fc admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:08.696592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f353a0-8634-451e-9a25-6aa55e42c094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:08.697842 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f353a0-8634-451e-9a25-6aa55e42c094 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:08.698198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f353a0-8634-451e-9a25-6aa55e42c094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:08.698482 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f353a0-8634-451e-9a25-6aa55e42c094 admin admin] PATH_INFO: `/v3/projects/c127ad9adbd245438fa823d3fdf92074/users/7385b7477b684a4dbb1b081643a0908d/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:08.786895 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f353a0-8634-451e-9a25-6aa55e42c094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c127ad9adbd245438fa823d3fdf92074, user_id=7385b7477b684a4dbb1b081643a0908d, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:08.790938 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f353a0-8634-451e-9a25-6aa55e42c094 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:08.822649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 873/1740] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:08 2022] PUT /identity/v3/projects/c127ad9adbd245438fa823d3fdf92074/users/7385b7477b684a4dbb1b081643a0908d/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:08.826767 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d32974-d2e0-48c6-8f76-59b5c8401ac7 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:08.881666 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d32974-d2e0-48c6-8f76-59b5c8401ac7 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:09.116091 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b399f5-f966-4ea8-bbae-bd59faa2937c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:09.117722 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b399f5-f966-4ea8-bbae-bd59faa2937c admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:09.118207 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b399f5-f966-4ea8-bbae-bd59faa2937c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:09.133450 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b399f5-f966-4ea8-bbae-bd59faa2937c admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:09.138931 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b399f5-f966-4ea8-bbae-bd59faa2937c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:09.143136 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b399f5-f966-4ea8-bbae-bd59faa2937c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:09.182411 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 868/1741] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:09.183665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f353a0-8634-451e-9a25-6aa55e42c094 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:09.201296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f353a0-8634-451e-9a25-6aa55e42c094 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:09.215016 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4de306-169d-432b-90a6-063f632b3ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:09.218328 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4de306-169d-432b-90a6-063f632b3ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:09.219295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4de306-169d-432b-90a6-063f632b3ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:09.220613 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4de306-169d-432b-90a6-063f632b3ff6 admin admin] PATH_INFO: `/v3/projects/c127ad9adbd245438fa823d3fdf92074/users/7385b7477b684a4dbb1b081643a0908d/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:09.226281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4de306-169d-432b-90a6-063f632b3ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c127ad9adbd245438fa823d3fdf92074, user_id=7385b7477b684a4dbb1b081643a0908d, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:09.232822 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4de306-169d-432b-90a6-063f632b3ff6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:09.279179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b399f5-f966-4ea8-bbae-bd59faa2937c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:09.286950 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-35b399f5-f966-4ea8-bbae-bd59faa2937c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:09.292026 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 874/1742] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:09 2022] PUT /identity/v3/projects/c127ad9adbd245438fa823d3fdf92074/users/7385b7477b684a4dbb1b081643a0908d/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:09.296043 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7db38c-13bc-4d0f-ad9b-72842848267e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:09.296581 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7db38c-13bc-4d0f-ad9b-72842848267e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:09.298578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7db38c-13bc-4d0f-ad9b-72842848267e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:09.421862 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7d7db38c-13bc-4d0f-ad9b-72842848267e None None] MFA Rules not processed for user `7385b7477b684a4dbb1b081643a0908d`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:09.436527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7d7db38c-13bc-4d0f-ad9b-72842848267e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:09.446782 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b399f5-f966-4ea8-bbae-bd59faa2937c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:09.499304 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:09.586992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfb1f9-e31f-41b7-9d81-fe157b07dff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:09.587939 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfb1f9-e31f-41b7-9d81-fe157b07dff9 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:09.588344 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfb1f9-e31f-41b7-9d81-fe157b07dff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:09.588756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfb1f9-e31f-41b7-9d81-fe157b07dff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:09.590736 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 875/1743] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:09.592135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-14bfb1f9-e31f-41b7-9d81-fe157b07dff9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:09.633771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7db38c-13bc-4d0f-ad9b-72842848267e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:09.636038 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7d7db38c-13bc-4d0f-ad9b-72842848267e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:09.659919 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7db38c-13bc-4d0f-ad9b-72842848267e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:09.674007 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b84e99-c760-4664-bdb9-1ab9cdd993dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:09.675547 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b84e99-c760-4664-bdb9-1ab9cdd993dc service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:09.676956 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b84e99-c760-4664-bdb9-1ab9cdd993dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:09.678201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b84e99-c760-4664-bdb9-1ab9cdd993dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:09.703636 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b84e99-c760-4664-bdb9-1ab9cdd993dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:09.707576 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b84e99-c760-4664-bdb9-1ab9cdd993dc service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:09.732314 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 876/1744] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:09.735223 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb87b26-9d4d-43c2-b48e-b48c6acc42d6 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:09.735594 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb87b26-9d4d-43c2-b48e-b48c6acc42d6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:09.736170 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb87b26-9d4d-43c2-b48e-b48c6acc42d6 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:09.738446 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 877/1745] 10.222.0.27 () {54 vars in 921 bytes} [Tue Aug 30 11:58:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:58:09.766188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb9ee3-6746-47e5-959c-2f5a7a1c474f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:09.766845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb9ee3-6746-47e5-959c-2f5a7a1c474f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:09.767282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb9ee3-6746-47e5-959c-2f5a7a1c474f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:09.816536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfb1f9-e31f-41b7-9d81-fe157b07dff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:09.820437 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfb1f9-e31f-41b7-9d81-fe157b07dff9 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:09.824310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-15cb9ee3-6746-47e5-959c-2f5a7a1c474f None None] MFA Rules not processed for user `8d17f1d0577a41ed8859706073f79d77`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:09.828157 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-15cb9ee3-6746-47e5-959c-2f5a7a1c474f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:09.860551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 869/1746] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:10.020042 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:10.071666 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 878/1747] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Aug 30 11:58:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:10.150310 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfb1f9-e31f-41b7-9d81-fe157b07dff9 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:10.152338 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-14bfb1f9-e31f-41b7-9d81-fe157b07dff9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:10.194013 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfb1f9-e31f-41b7-9d81-fe157b07dff9 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:10.225159 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b30c2-99d4-48e5-8077-7ce5918e1247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:10.225159 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b30c2-99d4-48e5-8077-7ce5918e1247 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:10.225159 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b30c2-99d4-48e5-8077-7ce5918e1247 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:10.225159 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b30c2-99d4-48e5-8077-7ce5918e1247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:10.268537 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b30c2-99d4-48e5-8077-7ce5918e1247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:10.275148 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b30c2-99d4-48e5-8077-7ce5918e1247 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:10.288140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb9ee3-6746-47e5-959c-2f5a7a1c474f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:10.309131 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb9ee3-6746-47e5-959c-2f5a7a1c474f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:10.317752 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 870/1748] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:10.330446 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b11537-5343-4d3e-a31e-9a91177b3200 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:10.332094 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b11537-5343-4d3e-a31e-9a91177b3200 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:10.334305 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b11537-5343-4d3e-a31e-9a91177b3200 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:10.338034 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b11537-5343-4d3e-a31e-9a91177b3200 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:10.596901 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b11537-5343-4d3e-a31e-9a91177b3200 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:10.596901 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b11537-5343-4d3e-a31e-9a91177b3200 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:10.645924 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 879/1749] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:10.850509 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c582172-fc95-496c-98f6-e8d8de6cb1fe None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:10.851140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c582172-fc95-496c-98f6-e8d8de6cb1fe None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:10.852409 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c582172-fc95-496c-98f6-e8d8de6cb1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:10.898925 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2c582172-fc95-496c-98f6-e8d8de6cb1fe None None] MFA Rules not processed for user `e9a57b9a59f84e16ac1e34d557d63a65`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:10.916313 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2c582172-fc95-496c-98f6-e8d8de6cb1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:11.074712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 871/1750] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:12.484374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2ee48-e162-42db-99ee-e0cc5d31cb3e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:12.485291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2ee48-e162-42db-99ee-e0cc5d31cb3e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:12.485782 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2ee48-e162-42db-99ee-e0cc5d31cb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:12.552887 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a5c2ee48-e162-42db-99ee-e0cc5d31cb3e None None] MFA Rules not processed for user `588d11e6ed3b4eda8c74e782669a63af`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:12.565562 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a5c2ee48-e162-42db-99ee-e0cc5d31cb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:12.772364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 880/1751] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:13.825496 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c582172-fc95-496c-98f6-e8d8de6cb1fe None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:13.827051 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2c582172-fc95-496c-98f6-e8d8de6cb1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:14.000708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c582172-fc95-496c-98f6-e8d8de6cb1fe None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:14.008443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0584e-c70f-49d5-8826-558014cd4bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:14.009801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0584e-c70f-49d5-8826-558014cd4bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:14.010290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0584e-c70f-49d5-8826-558014cd4bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:14.010769 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0584e-c70f-49d5-8826-558014cd4bb8 admin admin] PATH_INFO: `/v3/users/bfd4a181cbc541a6adba60eb7956b12d` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:14.013019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0584e-c70f-49d5-8826-558014cd4bb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfd4a181cbc541a6adba60eb7956b12d)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:14.015921 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0584e-c70f-49d5-8826-558014cd4bb8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:14.050451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:14.165138 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-dff0584e-c70f-49d5-8826-558014cd4bb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfd4a181cbc541a6adba60eb7956b12d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:14.174358 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-dff0584e-c70f-49d5-8826-558014cd4bb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfd4a181cbc541a6adba60eb7956b12d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:14.192599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-dff0584e-c70f-49d5-8826-558014cd4bb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfd4a181cbc541a6adba60eb7956b12d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:14.195855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-dff0584e-c70f-49d5-8826-558014cd4bb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfd4a181cbc541a6adba60eb7956b12d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:14.252446 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-dff0584e-c70f-49d5-8826-558014cd4bb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfd4a181cbc541a6adba60eb7956b12d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:14.281377 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11acb10-4c64-4f95-9857-0c3cb2497202 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:14.282303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11acb10-4c64-4f95-9857-0c3cb2497202 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:14.282805 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11acb10-4c64-4f95-9857-0c3cb2497202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:14.286579 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 872/1752] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:13 2022] DELETE /identity/v3/users/bfd4a181cbc541a6adba60eb7956b12d => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:14.321999 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f11acb10-4c64-4f95-9857-0c3cb2497202 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:14.323592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f11acb10-4c64-4f95-9857-0c3cb2497202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:14.337086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1dfe8f-4f77-462b-9fe7-2a4ec0fe0897 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:14.339612 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1dfe8f-4f77-462b-9fe7-2a4ec0fe0897 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:14.343182 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1dfe8f-4f77-462b-9fe7-2a4ec0fe0897 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:14.345617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 873/1753] 10.222.0.27 () {54 vars in 921 bytes} [Tue Aug 30 11:58:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:58:14.366113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2c63d-16f2-41f7-bd78-7b337b72d56f None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:14.366641 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2c63d-16f2-41f7-bd78-7b337b72d56f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:14.367076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2c63d-16f2-41f7-bd78-7b337b72d56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:14.408757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-33a2c63d-16f2-41f7-bd78-7b337b72d56f None None] MFA Rules not processed for user `8d17f1d0577a41ed8859706073f79d77`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:14.419351 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-33a2c63d-16f2-41f7-bd78-7b337b72d56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:14.482918 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 881/1754] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:14.490583 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11acb10-4c64-4f95-9857-0c3cb2497202 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:14.492451 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f11acb10-4c64-4f95-9857-0c3cb2497202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:14.547426 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:14.662186 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11acb10-4c64-4f95-9857-0c3cb2497202 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:14.674950 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 874/1755] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Aug 30 11:58:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:14.680116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e00da5-3d3a-4bbe-8deb-6a49a722ae4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:14.680758 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e00da5-3d3a-4bbe-8deb-6a49a722ae4b service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:14.681041 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e00da5-3d3a-4bbe-8deb-6a49a722ae4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:14.681313 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e00da5-3d3a-4bbe-8deb-6a49a722ae4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:14.696450 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e00da5-3d3a-4bbe-8deb-6a49a722ae4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:14.697984 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e00da5-3d3a-4bbe-8deb-6a49a722ae4b service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:14.729885 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 882/1756] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:15.302321 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2c63d-16f2-41f7-bd78-7b337b72d56f None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:15.305532 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-33a2c63d-16f2-41f7-bd78-7b337b72d56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:15.345312 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2c63d-16f2-41f7-bd78-7b337b72d56f None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:15.357024 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8e531-8240-41cf-9bdd-d62cef03043e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:15.359729 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8e531-8240-41cf-9bdd-d62cef03043e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:15.360297 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8e531-8240-41cf-9bdd-d62cef03043e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:15.361812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8e531-8240-41cf-9bdd-d62cef03043e admin admin] PATH_INFO: `/v3/users/9bc9300cac6d46d281ba38fa7623d4cb` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:15.364906 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8e531-8240-41cf-9bdd-d62cef03043e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bc9300cac6d46d281ba38fa7623d4cb)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:15.370916 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8e531-8240-41cf-9bdd-d62cef03043e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:15.418407 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e00da5-3d3a-4bbe-8deb-6a49a722ae4b service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:15.421308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-45e00da5-3d3a-4bbe-8deb-6a49a722ae4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:15.478030 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e00da5-3d3a-4bbe-8deb-6a49a722ae4b service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:15.496500 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823898f5-9010-4fe3-a3e2-82a1b9367cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:15.497430 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823898f5-9010-4fe3-a3e2-82a1b9367cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:15.497851 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823898f5-9010-4fe3-a3e2-82a1b9367cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:15.498412 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823898f5-9010-4fe3-a3e2-82a1b9367cf0 admin admin] PATH_INFO: `/v3/projects/bf3a0228aa2c49ac90823517d001e8dc` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:15.504216 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823898f5-9010-4fe3-a3e2-82a1b9367cf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf3a0228aa2c49ac90823517d001e8dc)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:15.508572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823898f5-9010-4fe3-a3e2-82a1b9367cf0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:15.579838 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-14a8e531-8240-41cf-9bdd-d62cef03043e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bc9300cac6d46d281ba38fa7623d4cb'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:15.601351 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-14a8e531-8240-41cf-9bdd-d62cef03043e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bc9300cac6d46d281ba38fa7623d4cb'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:15.620481 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-14a8e531-8240-41cf-9bdd-d62cef03043e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bc9300cac6d46d281ba38fa7623d4cb'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:15.621814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-14a8e531-8240-41cf-9bdd-d62cef03043e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bc9300cac6d46d281ba38fa7623d4cb'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:15.639493 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:15.658537 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-14a8e531-8240-41cf-9bdd-d62cef03043e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bc9300cac6d46d281ba38fa7623d4cb'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:15.675420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 875/1757] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:15 2022] DELETE /identity/v3/users/9bc9300cac6d46d281ba38fa7623d4cb => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:15.679489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-823898f5-9010-4fe3-a3e2-82a1b9367cf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf3a0228aa2c49ac90823517d001e8dc', 'request_id': 'req-823898f5-9010-4fe3-a3e2-82a1b9367cf0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:15.695627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7886d2e-0547-4473-8b18-8216ef0f3e44 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:15.698297 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7886d2e-0547-4473-8b18-8216ef0f3e44 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:15.700161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7886d2e-0547-4473-8b18-8216ef0f3e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:15.705253 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-823898f5-9010-4fe3-a3e2-82a1b9367cf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf3a0228aa2c49ac90823517d001e8dc', 'request_id': 'req-823898f5-9010-4fe3-a3e2-82a1b9367cf0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:15.726163 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-823898f5-9010-4fe3-a3e2-82a1b9367cf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf3a0228aa2c49ac90823517d001e8dc', 'request_id': 'req-823898f5-9010-4fe3-a3e2-82a1b9367cf0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:15.757280 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-823898f5-9010-4fe3-a3e2-82a1b9367cf0 admin admin] The token cache is being invalidate because project bf3a0228aa2c49ac90823517d001e8dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:15.759721 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-823898f5-9010-4fe3-a3e2-82a1b9367cf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:15.761797 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-823898f5-9010-4fe3-a3e2-82a1b9367cf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:15.765754 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 883/1758] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:15 2022] DELETE /identity/v3/projects/bf3a0228aa2c49ac90823517d001e8dc => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:15.770650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823898f5-9010-4fe3-a3e2-82a1b9367cf0 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:15.775732 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-823898f5-9010-4fe3-a3e2-82a1b9367cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:15.792213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-c7886d2e-0547-4473-8b18-8216ef0f3e44 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:15.800009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c7886d2e-0547-4473-8b18-8216ef0f3e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:15.924098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 876/1759] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:15.937180 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7886d2e-0547-4473-8b18-8216ef0f3e44 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:15.940349 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c7886d2e-0547-4473-8b18-8216ef0f3e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:15.996403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823898f5-9010-4fe3-a3e2-82a1b9367cf0 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:16.013514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb58118-edaf-4a66-89bd-30ec4eaf9557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:16.014100 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb58118-edaf-4a66-89bd-30ec4eaf9557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:16.014380 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb58118-edaf-4a66-89bd-30ec4eaf9557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:16.014651 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb58118-edaf-4a66-89bd-30ec4eaf9557 admin admin] PATH_INFO: `/v3/users/ee8ac8613fd64909b0d2d9684f22d729` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:16.016219 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb58118-edaf-4a66-89bd-30ec4eaf9557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee8ac8613fd64909b0d2d9684f22d729)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:16.022563 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb58118-edaf-4a66-89bd-30ec4eaf9557 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:16.105007 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7886d2e-0547-4473-8b18-8216ef0f3e44 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:16.111553 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac9c5b-3650-42a4-b32e-70c9adec8b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:16.112501 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac9c5b-3650-42a4-b32e-70c9adec8b81 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:16.112886 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac9c5b-3650-42a4-b32e-70c9adec8b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:16.113354 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac9c5b-3650-42a4-b32e-70c9adec8b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:16.131683 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac9c5b-3650-42a4-b32e-70c9adec8b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:16.134345 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac9c5b-3650-42a4-b32e-70c9adec8b81 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:16.193324 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 877/1760] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:16.204911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dcb58118-edaf-4a66-89bd-30ec4eaf9557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee8ac8613fd64909b0d2d9684f22d729'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:16.222086 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dcb58118-edaf-4a66-89bd-30ec4eaf9557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee8ac8613fd64909b0d2d9684f22d729'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:16.229588 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:16.245741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dcb58118-edaf-4a66-89bd-30ec4eaf9557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee8ac8613fd64909b0d2d9684f22d729'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:16.269585 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dcb58118-edaf-4a66-89bd-30ec4eaf9557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee8ac8613fd64909b0d2d9684f22d729'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:16.271777 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dcb58118-edaf-4a66-89bd-30ec4eaf9557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee8ac8613fd64909b0d2d9684f22d729'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:16.287669 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 884/1761] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:15 2022] DELETE /identity/v3/users/ee8ac8613fd64909b0d2d9684f22d729 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:16.584050 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac9c5b-3650-42a4-b32e-70c9adec8b81 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:16.585846 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-96ac9c5b-3650-42a4-b32e-70c9adec8b81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:16.612475 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac9c5b-3650-42a4-b32e-70c9adec8b81 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:16.794708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead42307-41ae-4869-8839-67f7d7d3e1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:16.795383 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead42307-41ae-4869-8839-67f7d7d3e1de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:16.796542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead42307-41ae-4869-8839-67f7d7d3e1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:16.796542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead42307-41ae-4869-8839-67f7d7d3e1de admin admin] PATH_INFO: `/v3/users/7d1ddf80494c4b2eb692a838c35d2622` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:16.797769 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead42307-41ae-4869-8839-67f7d7d3e1de admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d1ddf80494c4b2eb692a838c35d2622)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:16.806215 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead42307-41ae-4869-8839-67f7d7d3e1de admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:16.916423 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb58118-edaf-4a66-89bd-30ec4eaf9557 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:16.918166 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dcb58118-edaf-4a66-89bd-30ec4eaf9557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:16.929696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:16.961653 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ead42307-41ae-4869-8839-67f7d7d3e1de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d1ddf80494c4b2eb692a838c35d2622'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:16.982388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ead42307-41ae-4869-8839-67f7d7d3e1de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d1ddf80494c4b2eb692a838c35d2622'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:17.003243 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ead42307-41ae-4869-8839-67f7d7d3e1de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d1ddf80494c4b2eb692a838c35d2622'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:17.004671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ead42307-41ae-4869-8839-67f7d7d3e1de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d1ddf80494c4b2eb692a838c35d2622'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:17.052130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ead42307-41ae-4869-8839-67f7d7d3e1de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d1ddf80494c4b2eb692a838c35d2622'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:17.090993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 878/1762] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:16 2022] DELETE /identity/v3/users/7d1ddf80494c4b2eb692a838c35d2622 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:17.095636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dd524-a898-4a16-839c-72b0487fe35f None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:17.100216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dd524-a898-4a16-839c-72b0487fe35f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:17.101266 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dd524-a898-4a16-839c-72b0487fe35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:17.197905 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f39dd524-a898-4a16-839c-72b0487fe35f None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:17.207814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f39dd524-a898-4a16-839c-72b0487fe35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:17.251139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb58118-edaf-4a66-89bd-30ec4eaf9557 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:17.383555 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae91011-ba53-4906-b8c2-c7189467e49b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:17.385764 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae91011-ba53-4906-b8c2-c7189467e49b service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:17.386670 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae91011-ba53-4906-b8c2-c7189467e49b service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:17.391135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae91011-ba53-4906-b8c2-c7189467e49b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:17.396712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dae91011-ba53-4906-b8c2-c7189467e49b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:17.420029 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae91011-ba53-4906-b8c2-c7189467e49b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:17.422869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae91011-ba53-4906-b8c2-c7189467e49b service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:17.437856 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 885/1763] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:17.440659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae91011-ba53-4906-b8c2-c7189467e49b service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:17.445225 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 879/1764] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:17.445225 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39dd524-a898-4a16-839c-72b0487fe35f None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:17.445225 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f39dd524-a898-4a16-839c-72b0487fe35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:17.448834 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dae91011-ba53-4906-b8c2-c7189467e49b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:17.460281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39dd524-a898-4a16-839c-72b0487fe35f None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:17.465980 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae91011-ba53-4906-b8c2-c7189467e49b service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:17.470805 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e64b4-b787-4dae-9712-9f0100e9e941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:17.471491 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e64b4-b787-4dae-9712-9f0100e9e941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:17.471774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e64b4-b787-4dae-9712-9f0100e9e941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:17.472269 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e64b4-b787-4dae-9712-9f0100e9e941 admin admin] PATH_INFO: `/v3/projects/035b2d197a284c1e8c8ab46ec7dfa4bc` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:17.473386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e64b4-b787-4dae-9712-9f0100e9e941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=035b2d197a284c1e8c8ab46ec7dfa4bc)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:17.474293 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575a611-3145-46a5-8987-204c3aa211d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:17.475031 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575a611-3145-46a5-8987-204c3aa211d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:17.475311 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e64b4-b787-4dae-9712-9f0100e9e941 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:17.475521 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575a611-3145-46a5-8987-204c3aa211d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:17.475885 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575a611-3145-46a5-8987-204c3aa211d5 admin admin] PATH_INFO: `/v3/projects/fcf246cb3b434cb38689764793dcb2cc` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:17.477254 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575a611-3145-46a5-8987-204c3aa211d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcf246cb3b434cb38689764793dcb2cc)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:17.479249 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575a611-3145-46a5-8987-204c3aa211d5 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:17.545940 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9575a611-3145-46a5-8987-204c3aa211d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcf246cb3b434cb38689764793dcb2cc', 'request_id': 'req-9575a611-3145-46a5-8987-204c3aa211d5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:17.551955 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-351e64b4-b787-4dae-9712-9f0100e9e941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '035b2d197a284c1e8c8ab46ec7dfa4bc', 'request_id': 'req-351e64b4-b787-4dae-9712-9f0100e9e941'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:17.564582 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9575a611-3145-46a5-8987-204c3aa211d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcf246cb3b434cb38689764793dcb2cc', 'request_id': 'req-9575a611-3145-46a5-8987-204c3aa211d5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:17.566870 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-351e64b4-b787-4dae-9712-9f0100e9e941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '035b2d197a284c1e8c8ab46ec7dfa4bc', 'request_id': 'req-351e64b4-b787-4dae-9712-9f0100e9e941'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:17.568376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:17.577147 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-351e64b4-b787-4dae-9712-9f0100e9e941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '035b2d197a284c1e8c8ab46ec7dfa4bc', 'request_id': 'req-351e64b4-b787-4dae-9712-9f0100e9e941'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:17.577341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9575a611-3145-46a5-8987-204c3aa211d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcf246cb3b434cb38689764793dcb2cc', 'request_id': 'req-9575a611-3145-46a5-8987-204c3aa211d5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:17.614737 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9575a611-3145-46a5-8987-204c3aa211d5 admin admin] The token cache is being invalidate because project fcf246cb3b434cb38689764793dcb2cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:17.615790 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9575a611-3145-46a5-8987-204c3aa211d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:17.617243 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9575a611-3145-46a5-8987-204c3aa211d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:17.622950 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 880/1765] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:17 2022] DELETE /identity/v3/projects/fcf246cb3b434cb38689764793dcb2cc => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:17.622950 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575a611-3145-46a5-8987-204c3aa211d5 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:17.624042 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9575a611-3145-46a5-8987-204c3aa211d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:17.644654 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-351e64b4-b787-4dae-9712-9f0100e9e941 admin admin] The token cache is being invalidate because project 035b2d197a284c1e8c8ab46ec7dfa4bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:17.644973 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-351e64b4-b787-4dae-9712-9f0100e9e941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:17.654111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-351e64b4-b787-4dae-9712-9f0100e9e941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:17.660282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 886/1766] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:17 2022] DELETE /identity/v3/projects/035b2d197a284c1e8c8ab46ec7dfa4bc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:17.663986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e64b4-b787-4dae-9712-9f0100e9e941 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:17.667886 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-351e64b4-b787-4dae-9712-9f0100e9e941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:17.720750 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:17.761902 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575a611-3145-46a5-8987-204c3aa211d5 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:17.801480 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e64b4-b787-4dae-9712-9f0100e9e941 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:17.808290 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7245471-8af5-41d2-9efe-802171588912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:17.808741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7245471-8af5-41d2-9efe-802171588912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:17.809347 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7245471-8af5-41d2-9efe-802171588912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:17.809785 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7245471-8af5-41d2-9efe-802171588912 admin admin] PATH_INFO: `/v3/users/b3df582d843a4a46a64de81acd837536` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:17.811212 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7245471-8af5-41d2-9efe-802171588912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3df582d843a4a46a64de81acd837536)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:17.814268 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7245471-8af5-41d2-9efe-802171588912 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:17.868659 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439708eb-49d4-4120-abe7-dac31d6e6508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:17.869943 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439708eb-49d4-4120-abe7-dac31d6e6508 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:17.871395 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439708eb-49d4-4120-abe7-dac31d6e6508 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:17.871916 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439708eb-49d4-4120-abe7-dac31d6e6508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:17.875422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-439708eb-49d4-4120-abe7-dac31d6e6508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:17.884800 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f7245471-8af5-41d2-9efe-802171588912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3df582d843a4a46a64de81acd837536'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:17.894126 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439708eb-49d4-4120-abe7-dac31d6e6508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:17.896151 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439708eb-49d4-4120-abe7-dac31d6e6508 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:17.900109 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f7245471-8af5-41d2-9efe-802171588912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3df582d843a4a46a64de81acd837536'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:17.910854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 881/1767] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:17.911967 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439708eb-49d4-4120-abe7-dac31d6e6508 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:17.912978 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-439708eb-49d4-4120-abe7-dac31d6e6508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:17.927183 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f7245471-8af5-41d2-9efe-802171588912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3df582d843a4a46a64de81acd837536'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:17.930612 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439708eb-49d4-4120-abe7-dac31d6e6508 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:17.935802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40784c-37d1-4dbe-96b2-448752a8052b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:17.936560 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40784c-37d1-4dbe-96b2-448752a8052b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:17.936949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40784c-37d1-4dbe-96b2-448752a8052b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:17.937317 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40784c-37d1-4dbe-96b2-448752a8052b admin admin] PATH_INFO: `/v3/users/7385b7477b684a4dbb1b081643a0908d` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:17.940302 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40784c-37d1-4dbe-96b2-448752a8052b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7385b7477b684a4dbb1b081643a0908d)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:17.942421 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40784c-37d1-4dbe-96b2-448752a8052b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:17.969434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f7245471-8af5-41d2-9efe-802171588912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3df582d843a4a46a64de81acd837536'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:17.970477 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f7245471-8af5-41d2-9efe-802171588912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3df582d843a4a46a64de81acd837536'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:17.984313 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 887/1768] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:17 2022] DELETE /identity/v3/users/b3df582d843a4a46a64de81acd837536 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:18.040327 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4b40784c-37d1-4dbe-96b2-448752a8052b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7385b7477b684a4dbb1b081643a0908d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.052344 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4b40784c-37d1-4dbe-96b2-448752a8052b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7385b7477b684a4dbb1b081643a0908d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.070068 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4b40784c-37d1-4dbe-96b2-448752a8052b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7385b7477b684a4dbb1b081643a0908d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.070784 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4b40784c-37d1-4dbe-96b2-448752a8052b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7385b7477b684a4dbb1b081643a0908d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.090075 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4b40784c-37d1-4dbe-96b2-448752a8052b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7385b7477b684a4dbb1b081643a0908d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.100988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 882/1769] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:17 2022] DELETE /identity/v3/users/7385b7477b684a4dbb1b081643a0908d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:18.341657 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7245471-8af5-41d2-9efe-802171588912 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:18.344156 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f7245471-8af5-41d2-9efe-802171588912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:18.423681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40784c-37d1-4dbe-96b2-448752a8052b admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:18.425492 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4b40784c-37d1-4dbe-96b2-448752a8052b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:18.450508 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7245471-8af5-41d2-9efe-802171588912 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:18.459919 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:18.540155 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd57dbb-2e90-407d-a571-be397fadcbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:18.542357 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd57dbb-2e90-407d-a571-be397fadcbe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:18.542649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd57dbb-2e90-407d-a571-be397fadcbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:18.542930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd57dbb-2e90-407d-a571-be397fadcbe6 admin admin] PATH_INFO: `/v3/projects/3e0ee8b3d3134e378cfdade4e70ce0be` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:18.544334 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd57dbb-2e90-407d-a571-be397fadcbe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e0ee8b3d3134e378cfdade4e70ce0be)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:18.555122 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd57dbb-2e90-407d-a571-be397fadcbe6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:18.564821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40784c-37d1-4dbe-96b2-448752a8052b admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:18.575672 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee70f9-ce85-44e6-b62c-12e7903718eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:18.576413 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee70f9-ce85-44e6-b62c-12e7903718eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:18.576769 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee70f9-ce85-44e6-b62c-12e7903718eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:18.577115 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee70f9-ce85-44e6-b62c-12e7903718eb admin admin] PATH_INFO: `/v3/projects/9f5a8db97d3049cdbab0468a14828702` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:18.578459 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee70f9-ce85-44e6-b62c-12e7903718eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f5a8db97d3049cdbab0468a14828702)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:18.580961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee70f9-ce85-44e6-b62c-12e7903718eb admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:18.601822 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:18.621158 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ccd57dbb-2e90-407d-a571-be397fadcbe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e0ee8b3d3134e378cfdade4e70ce0be', 'request_id': 'req-ccd57dbb-2e90-407d-a571-be397fadcbe6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.630240 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ccd57dbb-2e90-407d-a571-be397fadcbe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e0ee8b3d3134e378cfdade4e70ce0be', 'request_id': 'req-ccd57dbb-2e90-407d-a571-be397fadcbe6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.637678 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ccd57dbb-2e90-407d-a571-be397fadcbe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e0ee8b3d3134e378cfdade4e70ce0be', 'request_id': 'req-ccd57dbb-2e90-407d-a571-be397fadcbe6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.647315 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-70ee70f9-ce85-44e6-b62c-12e7903718eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f5a8db97d3049cdbab0468a14828702', 'request_id': 'req-70ee70f9-ce85-44e6-b62c-12e7903718eb'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.655803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-70ee70f9-ce85-44e6-b62c-12e7903718eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f5a8db97d3049cdbab0468a14828702', 'request_id': 'req-70ee70f9-ce85-44e6-b62c-12e7903718eb'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.660182 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ccd57dbb-2e90-407d-a571-be397fadcbe6 admin admin] The token cache is being invalidate because project 3e0ee8b3d3134e378cfdade4e70ce0be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:18.660470 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ccd57dbb-2e90-407d-a571-be397fadcbe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.661325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ccd57dbb-2e90-407d-a571-be397fadcbe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.664173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 888/1770] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:18 2022] DELETE /identity/v3/projects/3e0ee8b3d3134e378cfdade4e70ce0be => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:18.664848 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd57dbb-2e90-407d-a571-be397fadcbe6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:18.665923 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-70ee70f9-ce85-44e6-b62c-12e7903718eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f5a8db97d3049cdbab0468a14828702', 'request_id': 'req-70ee70f9-ce85-44e6-b62c-12e7903718eb'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.666167 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ccd57dbb-2e90-407d-a571-be397fadcbe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:18.680669 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-70ee70f9-ce85-44e6-b62c-12e7903718eb admin admin] The token cache is being invalidate because project 9f5a8db97d3049cdbab0468a14828702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:18.681010 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-70ee70f9-ce85-44e6-b62c-12e7903718eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.681548 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-70ee70f9-ce85-44e6-b62c-12e7903718eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.683067 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 883/1771] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:18 2022] DELETE /identity/v3/projects/9f5a8db97d3049cdbab0468a14828702 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:18.683875 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee70f9-ce85-44e6-b62c-12e7903718eb admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:18.685475 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-70ee70f9-ce85-44e6-b62c-12e7903718eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:18.749539 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd57dbb-2e90-407d-a571-be397fadcbe6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:18.782094 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee70f9-ce85-44e6-b62c-12e7903718eb admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:18.786947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e998a8-c7eb-4da6-bea8-d9234db868f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:18.787627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e998a8-c7eb-4da6-bea8-d9234db868f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:18.787905 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e998a8-c7eb-4da6-bea8-d9234db868f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:18.788172 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e998a8-c7eb-4da6-bea8-d9234db868f9 admin admin] PATH_INFO: `/v3/users/861b034a04c04233bb0620431fffdacc` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:18.790148 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e998a8-c7eb-4da6-bea8-d9234db868f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=861b034a04c04233bb0620431fffdacc)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:18.792159 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e998a8-c7eb-4da6-bea8-d9234db868f9 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:18.801878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:18.818260 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78aef0-651d-421a-9b1e-6628b03d444c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:18.818970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78aef0-651d-421a-9b1e-6628b03d444c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:18.819306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78aef0-651d-421a-9b1e-6628b03d444c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:18.819617 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78aef0-651d-421a-9b1e-6628b03d444c admin admin] PATH_INFO: `/v3/projects/c127ad9adbd245438fa823d3fdf92074` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:18.820739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78aef0-651d-421a-9b1e-6628b03d444c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c127ad9adbd245438fa823d3fdf92074)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:18.822800 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78aef0-651d-421a-9b1e-6628b03d444c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:18.851293 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-40e998a8-c7eb-4da6-bea8-d9234db868f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '861b034a04c04233bb0620431fffdacc'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.859894 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-40e998a8-c7eb-4da6-bea8-d9234db868f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '861b034a04c04233bb0620431fffdacc'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.869844 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-40e998a8-c7eb-4da6-bea8-d9234db868f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '861b034a04c04233bb0620431fffdacc'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.870366 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-40e998a8-c7eb-4da6-bea8-d9234db868f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '861b034a04c04233bb0620431fffdacc'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.886036 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3f78aef0-651d-421a-9b1e-6628b03d444c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c127ad9adbd245438fa823d3fdf92074', 'request_id': 'req-3f78aef0-651d-421a-9b1e-6628b03d444c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.888769 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-40e998a8-c7eb-4da6-bea8-d9234db868f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '861b034a04c04233bb0620431fffdacc'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.895013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3f78aef0-651d-421a-9b1e-6628b03d444c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c127ad9adbd245438fa823d3fdf92074', 'request_id': 'req-3f78aef0-651d-421a-9b1e-6628b03d444c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.895626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 884/1772] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:18 2022] DELETE /identity/v3/users/861b034a04c04233bb0620431fffdacc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:18.897217 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d9cb3-9c95-4ff5-91b6-aa4186bd0ea3 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:18.897612 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d9cb3-9c95-4ff5-91b6-aa4186bd0ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:18.897882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d9cb3-9c95-4ff5-91b6-aa4186bd0ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:18.914820 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3f78aef0-651d-421a-9b1e-6628b03d444c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c127ad9adbd245438fa823d3fdf92074', 'request_id': 'req-3f78aef0-651d-421a-9b1e-6628b03d444c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.919876 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f91d9cb3-9c95-4ff5-91b6-aa4186bd0ea3 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:18.921133 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f91d9cb3-9c95-4ff5-91b6-aa4186bd0ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:18.929475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3f78aef0-651d-421a-9b1e-6628b03d444c admin admin] The token cache is being invalidate because project c127ad9adbd245438fa823d3fdf92074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:18.929475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3f78aef0-651d-421a-9b1e-6628b03d444c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.930055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3f78aef0-651d-421a-9b1e-6628b03d444c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:18.932079 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 889/1773] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:18 2022] DELETE /identity/v3/projects/c127ad9adbd245438fa823d3fdf92074 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:18.937609 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fc636-2348-4ad7-a595-a55a977a49d0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:18.937969 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fc636-2348-4ad7-a595-a55a977a49d0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:18.938753 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fc636-2348-4ad7-a595-a55a977a49d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:18.938919 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:18.962124 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5d7fc636-2348-4ad7-a595-a55a977a49d0 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:18.963339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5d7fc636-2348-4ad7-a595-a55a977a49d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:19.026925 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 885/1774] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:19.039436 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 890/1775] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:19.039743 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007b73e-2036-408b-9082-736f056a47e9 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:19.039743 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007b73e-2036-408b-9082-736f056a47e9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:19.039743 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007b73e-2036-408b-9082-736f056a47e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:19.044308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2318e-e29e-4364-b043-30fdc7a648bc None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:19.044654 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2318e-e29e-4364-b043-30fdc7a648bc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:19.045082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2318e-e29e-4364-b043-30fdc7a648bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:19.065052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-7007b73e-2036-408b-9082-736f056a47e9 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:19.066554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7007b73e-2036-408b-9082-736f056a47e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:19.068066 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b4b2318e-e29e-4364-b043-30fdc7a648bc None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:19.069354 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b4b2318e-e29e-4364-b043-30fdc7a648bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:19.076345 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 886/1776] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:19.080483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007b73e-2036-408b-9082-736f056a47e9 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:19.083068 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 891/1777] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:19.083068 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2318e-e29e-4364-b043-30fdc7a648bc None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:19.091200 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007b73e-2036-408b-9082-736f056a47e9 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:19.092387 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2318e-e29e-4364-b043-30fdc7a648bc None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:19.096449 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f4891-7c5a-4380-99aa-5407dec67cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:19.097144 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f4891-7c5a-4380-99aa-5407dec67cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:19.097494 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f4891-7c5a-4380-99aa-5407dec67cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:19.097839 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f4891-7c5a-4380-99aa-5407dec67cb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:19.097930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782a3a8-5b16-409d-b9dc-28ac4f41d695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:19.098622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f4891-7c5a-4380-99aa-5407dec67cb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:19.098730 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782a3a8-5b16-409d-b9dc-28ac4f41d695 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:19.099026 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782a3a8-5b16-409d-b9dc-28ac4f41d695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:19.099121 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f4891-7c5a-4380-99aa-5407dec67cb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:19.099436 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782a3a8-5b16-409d-b9dc-28ac4f41d695 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:19.100143 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782a3a8-5b16-409d-b9dc-28ac4f41d695 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:19.100502 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782a3a8-5b16-409d-b9dc-28ac4f41d695 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:19.101695 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f4891-7c5a-4380-99aa-5407dec67cb5 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:19.107387 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782a3a8-5b16-409d-b9dc-28ac4f41d695 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:19.119825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 887/1778] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:19.121793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 892/1779] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:19.127548 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f4891-7c5a-4380-99aa-5407dec67cb5 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:19.127693 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782a3a8-5b16-409d-b9dc-28ac4f41d695 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:19.138089 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782a3a8-5b16-409d-b9dc-28ac4f41d695 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:19.144978 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f4891-7c5a-4380-99aa-5407dec67cb5 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:19.150470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03903e9-4fc7-4dc6-bd7e-b3db5039a966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:19.150590 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a617b-7719-4f1f-bf98-df3580fc97c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:19.151234 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a617b-7719-4f1f-bf98-df3580fc97c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:19.151345 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03903e9-4fc7-4dc6-bd7e-b3db5039a966 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:19.151551 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a617b-7719-4f1f-bf98-df3580fc97c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:19.151854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03903e9-4fc7-4dc6-bd7e-b3db5039a966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:19.151970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a617b-7719-4f1f-bf98-df3580fc97c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:19.152125 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03903e9-4fc7-4dc6-bd7e-b3db5039a966 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:19.152696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a617b-7719-4f1f-bf98-df3580fc97c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:19.152787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03903e9-4fc7-4dc6-bd7e-b3db5039a966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:19.154612 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a617b-7719-4f1f-bf98-df3580fc97c3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:19.154732 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03903e9-4fc7-4dc6-bd7e-b3db5039a966 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:19.204827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 893/1780] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:19 2022] POST /identity/v3/projects => generated 399 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:19.206694 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 888/1781] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:19 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:19.217208 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a617b-7719-4f1f-bf98-df3580fc97c3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:19.219658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03903e9-4fc7-4dc6-bd7e-b3db5039a966 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:19.286894 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:19.327772 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a617b-7719-4f1f-bf98-df3580fc97c3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:19.362807 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03903e9-4fc7-4dc6-bd7e-b3db5039a966 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:19.368190 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c752c-4a49-42c8-b2b9-321ddb6babae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:19.368813 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c752c-4a49-42c8-b2b9-321ddb6babae admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:19.369096 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c752c-4a49-42c8-b2b9-321ddb6babae admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:19.369371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c752c-4a49-42c8-b2b9-321ddb6babae admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:19.379883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c752c-4a49-42c8-b2b9-321ddb6babae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:19.382022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c752c-4a49-42c8-b2b9-321ddb6babae admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:19.400716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c56feb-b376-4f26-9b13-d19b7e31a334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:19.401680 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c56feb-b376-4f26-9b13-d19b7e31a334 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:19.402035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c56feb-b376-4f26-9b13-d19b7e31a334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:19.402368 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c56feb-b376-4f26-9b13-d19b7e31a334 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:19.403084 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c56feb-b376-4f26-9b13-d19b7e31a334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:19.405522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c56feb-b376-4f26-9b13-d19b7e31a334 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:19.408029 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 889/1782] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:19 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:19.408962 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c752c-4a49-42c8-b2b9-321ddb6babae admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:19.411453 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e69c752c-4a49-42c8-b2b9-321ddb6babae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:19.424479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c752c-4a49-42c8-b2b9-321ddb6babae admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:19.432021 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 894/1783] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:19 2022] POST /identity/v3/users => generated 300 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:19.432153 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f94201-4355-4ea2-9911-edc0faa688d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:19.432279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c56feb-b376-4f26-9b13-d19b7e31a334 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:19.432363 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f94201-4355-4ea2-9911-edc0faa688d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:19.432363 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f94201-4355-4ea2-9911-edc0faa688d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:19.432363 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f94201-4355-4ea2-9911-edc0faa688d5 admin admin] PATH_INFO: `/v3/projects/10bee923074d4c9ead770898c7045705` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:19.432363 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f94201-4355-4ea2-9911-edc0faa688d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10bee923074d4c9ead770898c7045705)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:19.433608 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f94201-4355-4ea2-9911-edc0faa688d5 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:19.439820 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c56feb-b376-4f26-9b13-d19b7e31a334 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:19.444758 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267448ab-bf36-4719-a860-33e05db242e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:19.445375 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267448ab-bf36-4719-a860-33e05db242e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:19.445697 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267448ab-bf36-4719-a860-33e05db242e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:19.445887 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267448ab-bf36-4719-a860-33e05db242e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:19.446588 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267448ab-bf36-4719-a860-33e05db242e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:19.448219 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267448ab-bf36-4719-a860-33e05db242e8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:19.458599 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 895/1784] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:19.459914 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267448ab-bf36-4719-a860-33e05db242e8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:19.469259 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267448ab-bf36-4719-a860-33e05db242e8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:19.482156 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b8f94201-4355-4ea2-9911-edc0faa688d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10bee923074d4c9ead770898c7045705', 'request_id': 'req-b8f94201-4355-4ea2-9911-edc0faa688d5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:19.489361 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b8f94201-4355-4ea2-9911-edc0faa688d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10bee923074d4c9ead770898c7045705', 'request_id': 'req-b8f94201-4355-4ea2-9911-edc0faa688d5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:19.495509 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:19.499074 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b8f94201-4355-4ea2-9911-edc0faa688d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10bee923074d4c9ead770898c7045705', 'request_id': 'req-b8f94201-4355-4ea2-9911-edc0faa688d5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:19.523403 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b8f94201-4355-4ea2-9911-edc0faa688d5 admin admin] The token cache is being invalidate because project 10bee923074d4c9ead770898c7045705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:19.523631 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b8f94201-4355-4ea2-9911-edc0faa688d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:19.524610 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b8f94201-4355-4ea2-9911-edc0faa688d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:19.529552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 890/1785] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:19 2022] DELETE /identity/v3/projects/10bee923074d4c9ead770898c7045705 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:19.529552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f94201-4355-4ea2-9911-edc0faa688d5 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:19.530974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b8f94201-4355-4ea2-9911-edc0faa688d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:19.537351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52e579-3134-42d3-a474-d4195dc345ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:19.537981 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52e579-3134-42d3-a474-d4195dc345ab admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:19.538258 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52e579-3134-42d3-a474-d4195dc345ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:19.538531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52e579-3134-42d3-a474-d4195dc345ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:19.539178 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52e579-3134-42d3-a474-d4195dc345ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:19.540939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52e579-3134-42d3-a474-d4195dc345ab admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:19.547383 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f94201-4355-4ea2-9911-edc0faa688d5 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:19.552413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 896/1786] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:19.553765 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc334fbf-0859-49d8-88ef-5d29da353eb9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:19.554142 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc334fbf-0859-49d8-88ef-5d29da353eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:19.554441 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc334fbf-0859-49d8-88ef-5d29da353eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:19.554927 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39916311-2483-43e2-8512-7872617c5f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:19.556051 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39916311-2483-43e2-8512-7872617c5f83 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:19.556456 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39916311-2483-43e2-8512-7872617c5f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:19.556869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39916311-2483-43e2-8512-7872617c5f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:19.557783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39916311-2483-43e2-8512-7872617c5f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:19.560445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39916311-2483-43e2-8512-7872617c5f83 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:19.578978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cc334fbf-0859-49d8-88ef-5d29da353eb9 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:19.580289 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cc334fbf-0859-49d8-88ef-5d29da353eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:19.584199 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 891/1787] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:19.585436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39916311-2483-43e2-8512-7872617c5f83 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:19.590596 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-39916311-2483-43e2-8512-7872617c5f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:19.594381 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 897/1788] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:19.595621 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc334fbf-0859-49d8-88ef-5d29da353eb9 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:19.611455 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc334fbf-0859-49d8-88ef-5d29da353eb9 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:19.616458 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22579b43-f03d-4889-a281-9c9753bf0720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:19.616810 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22579b43-f03d-4889-a281-9c9753bf0720 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:19.617090 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22579b43-f03d-4889-a281-9c9753bf0720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:19.617529 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22579b43-f03d-4889-a281-9c9753bf0720 admin admin] PATH_INFO: `/v3/projects/f8e735b794a04da8b45a9660126df3c9/users/68c511b32e5f4200bab684d3dd72d04c/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:19.621659 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39916311-2483-43e2-8512-7872617c5f83 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:19.630332 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c2f6d-2590-47bf-8d75-15aeb3b12d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:19.631773 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c2f6d-2590-47bf-8d75-15aeb3b12d13 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:19.632257 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c2f6d-2590-47bf-8d75-15aeb3b12d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:19.632711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c2f6d-2590-47bf-8d75-15aeb3b12d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:19.637240 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22579b43-f03d-4889-a281-9c9753bf0720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8e735b794a04da8b45a9660126df3c9, user_id=68c511b32e5f4200bab684d3dd72d04c, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:19.640414 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c2f6d-2590-47bf-8d75-15aeb3b12d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:19.640725 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22579b43-f03d-4889-a281-9c9753bf0720 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:19.645661 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c2f6d-2590-47bf-8d75-15aeb3b12d13 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:19.659519 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 898/1789] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:19 2022] PUT /identity/v3/projects/f8e735b794a04da8b45a9660126df3c9/users/68c511b32e5f4200bab684d3dd72d04c/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:19.662109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 892/1790] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:19.664824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22279131-522a-4b4a-8f03-2c90da0b4293 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:19.665882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c2f6d-2590-47bf-8d75-15aeb3b12d13 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:19.666890 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22279131-522a-4b4a-8f03-2c90da0b4293 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:19.667312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22279131-522a-4b4a-8f03-2c90da0b4293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:19.682877 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c2f6d-2590-47bf-8d75-15aeb3b12d13 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:19.692121 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-22279131-522a-4b4a-8f03-2c90da0b4293 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:19.693510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-22279131-522a-4b4a-8f03-2c90da0b4293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:19.728320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:19.757972 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697afd02-7ec6-465c-91da-2ad842e46d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:19.758723 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697afd02-7ec6-465c-91da-2ad842e46d36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:19.759006 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697afd02-7ec6-465c-91da-2ad842e46d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:19.759311 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697afd02-7ec6-465c-91da-2ad842e46d36 admin admin] PATH_INFO: `/v3/projects/1c6f274ca4db4698bfe7c24e88c93c3f/users/0d2763404ef64f6c942d556acda5cca5/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:19.783140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 899/1791] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:19.784874 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07925d5-0b89-4b4b-9f74-3c7febb0258e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:19.785275 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07925d5-0b89-4b4b-9f74-3c7febb0258e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:19.785646 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07925d5-0b89-4b4b-9f74-3c7febb0258e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:19.788909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697afd02-7ec6-465c-91da-2ad842e46d36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6f274ca4db4698bfe7c24e88c93c3f, user_id=0d2763404ef64f6c942d556acda5cca5, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:19.796463 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697afd02-7ec6-465c-91da-2ad842e46d36 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:19.817165 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 893/1792] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:19 2022] PUT /identity/v3/projects/1c6f274ca4db4698bfe7c24e88c93c3f/users/0d2763404ef64f6c942d556acda5cca5/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:19.827263 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697afd02-7ec6-465c-91da-2ad842e46d36 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:19.833418 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f07925d5-0b89-4b4b-9f74-3c7febb0258e None None] MFA Rules not processed for user `68c511b32e5f4200bab684d3dd72d04c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:19.834766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f07925d5-0b89-4b4b-9f74-3c7febb0258e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:19.897670 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697afd02-7ec6-465c-91da-2ad842e46d36 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:19.903077 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6013a-f8d7-4415-a4c6-915218ac93de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:19.903796 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6013a-f8d7-4415-a4c6-915218ac93de admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:19.904078 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6013a-f8d7-4415-a4c6-915218ac93de admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:19.904346 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6013a-f8d7-4415-a4c6-915218ac93de admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:19.905042 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6013a-f8d7-4415-a4c6-915218ac93de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:19.905348 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6013a-f8d7-4415-a4c6-915218ac93de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:19.907851 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6013a-f8d7-4415-a4c6-915218ac93de admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:19.925599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 894/1793] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:19.927162 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22e397-2118-49d8-9551-2b58e5d18d94 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:19.927479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22e397-2118-49d8-9551-2b58e5d18d94 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:19.927756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22e397-2118-49d8-9551-2b58e5d18d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:19.955965 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 900/1794] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:19.968065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07925d5-0b89-4b4b-9f74-3c7febb0258e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:19.988268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-fa22e397-2118-49d8-9551-2b58e5d18d94 None None] MFA Rules not processed for user `0d2763404ef64f6c942d556acda5cca5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:19.989716 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-fa22e397-2118-49d8-9551-2b58e5d18d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:19.991630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07925d5-0b89-4b4b-9f74-3c7febb0258e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:19.998243 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c46b4-40fe-43cc-a331-46edec9c182d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:19.999236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c46b4-40fe-43cc-a331-46edec9c182d admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:19.999453 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c46b4-40fe-43cc-a331-46edec9c182d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:19.999819 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c46b4-40fe-43cc-a331-46edec9c182d admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:20.000685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c46b4-40fe-43cc-a331-46edec9c182d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:20.003388 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c46b4-40fe-43cc-a331-46edec9c182d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:20.032440 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:20.048971 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 901/1795] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:19 2022] POST /identity/v3/projects => generated 367 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:20.048971 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c46b4-40fe-43cc-a331-46edec9c182d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:20.124765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 895/1796] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:19 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:20.128388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22e397-2118-49d8-9551-2b58e5d18d94 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:20.153561 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22e397-2118-49d8-9551-2b58e5d18d94 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:20.164986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b9cf2-03cf-436e-bee8-4466ab939ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:20.165897 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b9cf2-03cf-436e-bee8-4466ab939ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:20.166335 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b9cf2-03cf-436e-bee8-4466ab939ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:20.166622 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c46b4-40fe-43cc-a331-46edec9c182d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:20.167057 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b9cf2-03cf-436e-bee8-4466ab939ba0 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:20.167936 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b9cf2-03cf-436e-bee8-4466ab939ba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:20.170295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b9cf2-03cf-436e-bee8-4466ab939ba0 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:20.172019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054ba37-067a-44e1-aa02-98c399c8f01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:20.173093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054ba37-067a-44e1-aa02-98c399c8f01d admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:20.173470 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054ba37-067a-44e1-aa02-98c399c8f01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:20.173813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054ba37-067a-44e1-aa02-98c399c8f01d admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:20.174617 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054ba37-067a-44e1-aa02-98c399c8f01d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:20.176861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054ba37-067a-44e1-aa02-98c399c8f01d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:20.206937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 896/1797] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:20 2022] POST /identity/v3/users => generated 284 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:20.208306 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b9cf2-03cf-436e-bee8-4466ab939ba0 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:20.220042 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 902/1798] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:20 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:20.224862 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054ba37-067a-44e1-aa02-98c399c8f01d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:20.238742 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b9cf2-03cf-436e-bee8-4466ab939ba0 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:20.277427 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:20.336673 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541dff73-f383-4d40-9ab3-d01aedc81783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:20.337324 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dff73-f383-4d40-9ab3-d01aedc81783 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:20.337759 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dff73-f383-4d40-9ab3-d01aedc81783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:20.338092 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dff73-f383-4d40-9ab3-d01aedc81783 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:20.338805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541dff73-f383-4d40-9ab3-d01aedc81783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:20.342400 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541dff73-f383-4d40-9ab3-d01aedc81783 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:20.354860 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054ba37-067a-44e1-aa02-98c399c8f01d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:20.361993 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6c6e2-282f-469e-8f22-8003f3bf84c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:20.362657 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6c6e2-282f-469e-8f22-8003f3bf84c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:20.363012 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6c6e2-282f-469e-8f22-8003f3bf84c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:20.363612 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6c6e2-282f-469e-8f22-8003f3bf84c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:20.364718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6c6e2-282f-469e-8f22-8003f3bf84c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:20.366712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6c6e2-282f-469e-8f22-8003f3bf84c4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:20.381543 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 897/1799] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:20 2022] POST /identity/v3/projects => generated 401 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:20.382696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541dff73-f383-4d40-9ab3-d01aedc81783 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:20.395882 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 903/1800] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:20.396797 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6c6e2-282f-469e-8f22-8003f3bf84c4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:20.418182 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6c6e2-282f-469e-8f22-8003f3bf84c4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:20.496756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541dff73-f383-4d40-9ab3-d01aedc81783 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:20.507394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee69388-b878-4c71-973a-dbd32f07be04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:20.508022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee69388-b878-4c71-973a-dbd32f07be04 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:20.508470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee69388-b878-4c71-973a-dbd32f07be04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:20.508799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee69388-b878-4c71-973a-dbd32f07be04 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:20.509811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee69388-b878-4c71-973a-dbd32f07be04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:20.511860 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee69388-b878-4c71-973a-dbd32f07be04 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:20.536519 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c157e6-fd53-461f-bd36-74fbe660a301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:20.537473 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c157e6-fd53-461f-bd36-74fbe660a301 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:20.537923 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c157e6-fd53-461f-bd36-74fbe660a301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:20.538199 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c157e6-fd53-461f-bd36-74fbe660a301 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:20.538843 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c157e6-fd53-461f-bd36-74fbe660a301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:20.541175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c157e6-fd53-461f-bd36-74fbe660a301 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:20.557737 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 898/1801] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:20 2022] POST /identity/v3/users => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:20.558688 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee69388-b878-4c71-973a-dbd32f07be04 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:20.571095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee69388-b878-4c71-973a-dbd32f07be04 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:20.576702 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 904/1802] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:20 2022] POST /identity/v3/users => generated 307 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:20.576702 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c157e6-fd53-461f-bd36-74fbe660a301 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:20.576988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee65a6-4c1f-49a5-8943-91b901e143fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:20.577122 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee65a6-4c1f-49a5-8943-91b901e143fc admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:20.577905 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee65a6-4c1f-49a5-8943-91b901e143fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:20.578220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee65a6-4c1f-49a5-8943-91b901e143fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:20.579007 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee65a6-4c1f-49a5-8943-91b901e143fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:20.581099 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee65a6-4c1f-49a5-8943-91b901e143fc admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:20.593746 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c157e6-fd53-461f-bd36-74fbe660a301 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:20.594291 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 899/1803] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:20.595132 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee65a6-4c1f-49a5-8943-91b901e143fc admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:20.599823 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757e8a1-5ae1-4297-91f9-e69d91302894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:20.600453 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757e8a1-5ae1-4297-91f9-e69d91302894 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:20.600736 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757e8a1-5ae1-4297-91f9-e69d91302894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:20.601012 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757e8a1-5ae1-4297-91f9-e69d91302894 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:20.601919 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757e8a1-5ae1-4297-91f9-e69d91302894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:20.603509 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757e8a1-5ae1-4297-91f9-e69d91302894 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:20.607124 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee65a6-4c1f-49a5-8943-91b901e143fc admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:20.612698 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252a073-3f6b-4f6c-bdc9-89d0e5534091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:20.613387 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252a073-3f6b-4f6c-bdc9-89d0e5534091 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:20.613566 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252a073-3f6b-4f6c-bdc9-89d0e5534091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:20.613839 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252a073-3f6b-4f6c-bdc9-89d0e5534091 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:20.614479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252a073-3f6b-4f6c-bdc9-89d0e5534091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:20.616209 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252a073-3f6b-4f6c-bdc9-89d0e5534091 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:20.617326 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 905/1804] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:20.618253 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757e8a1-5ae1-4297-91f9-e69d91302894 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:20.631973 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 900/1805] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:20.632193 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757e8a1-5ae1-4297-91f9-e69d91302894 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:20.632301 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252a073-3f6b-4f6c-bdc9-89d0e5534091 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:20.637649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bd9e1-f525-4f63-9dec-ce1b4a9e9550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:20.638513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bd9e1-f525-4f63-9dec-ce1b4a9e9550 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:20.638884 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bd9e1-f525-4f63-9dec-ce1b4a9e9550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:20.639248 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bd9e1-f525-4f63-9dec-ce1b4a9e9550 admin admin] PATH_INFO: `/v3/projects/bdc3c35ac74e463d9066acca75cce54d/users/d6caea1ed4b14fa59855a466947d20d5/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:20.639878 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252a073-3f6b-4f6c-bdc9-89d0e5534091 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:20.646867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165bb68-70d6-4a96-9339-9047c0e074b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:20.647599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165bb68-70d6-4a96-9339-9047c0e074b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:20.647881 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165bb68-70d6-4a96-9339-9047c0e074b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:20.648152 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165bb68-70d6-4a96-9339-9047c0e074b8 admin admin] PATH_INFO: `/v3/projects/8e1f5d254108400982a4ae154b901700/users/c0f5577b55224b2eb9decfd291728da1/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:20.651838 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:20.660821 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bd9e1-f525-4f63-9dec-ce1b4a9e9550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdc3c35ac74e463d9066acca75cce54d, user_id=d6caea1ed4b14fa59855a466947d20d5, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:20.664009 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bd9e1-f525-4f63-9dec-ce1b4a9e9550 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:20.666734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165bb68-70d6-4a96-9339-9047c0e074b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1f5d254108400982a4ae154b901700, user_id=c0f5577b55224b2eb9decfd291728da1, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:20.671684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165bb68-70d6-4a96-9339-9047c0e074b8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:20.681248 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 906/1806] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:20 2022] PUT /identity/v3/projects/bdc3c35ac74e463d9066acca75cce54d/users/d6caea1ed4b14fa59855a466947d20d5/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:20.689149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bd9e1-f525-4f63-9dec-ce1b4a9e9550 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:20.689891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 901/1807] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:20 2022] PUT /identity/v3/projects/8e1f5d254108400982a4ae154b901700/users/c0f5577b55224b2eb9decfd291728da1/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:20.693770 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef0dd9-cbea-4564-bd15-033aff97e946 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:20.694060 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef0dd9-cbea-4564-bd15-033aff97e946 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:20.694335 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef0dd9-cbea-4564-bd15-033aff97e946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:20.725321 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d0ef0dd9-cbea-4564-bd15-033aff97e946 None None] MFA Rules not processed for user `d6caea1ed4b14fa59855a466947d20d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:20.726562 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d0ef0dd9-cbea-4564-bd15-033aff97e946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:20.760777 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bd9e1-f525-4f63-9dec-ce1b4a9e9550 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:20.780959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:20.799849 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 902/1808] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:20.804287 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef0dd9-cbea-4564-bd15-033aff97e946 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:20.834440 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0db09-f9a2-4717-80eb-573960fa167e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:20.835118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0db09-f9a2-4717-80eb-573960fa167e admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:20.835420 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0db09-f9a2-4717-80eb-573960fa167e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:20.835698 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0db09-f9a2-4717-80eb-573960fa167e admin admin] PATH_INFO: `/v3/projects/f1e3a5d887664b1bb90b95a1dda1db92/users/44a0a0d706114181b3957d173d6b5ec4/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:20.849850 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0db09-f9a2-4717-80eb-573960fa167e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1e3a5d887664b1bb90b95a1dda1db92, user_id=44a0a0d706114181b3957d173d6b5ec4, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:20.852542 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0db09-f9a2-4717-80eb-573960fa167e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:20.866818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 907/1809] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:20 2022] PUT /identity/v3/projects/f1e3a5d887664b1bb90b95a1dda1db92/users/44a0a0d706114181b3957d173d6b5ec4/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:20.867583 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0db09-f9a2-4717-80eb-573960fa167e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:20.884037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef0dd9-cbea-4564-bd15-033aff97e946 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:20.932984 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0db09-f9a2-4717-80eb-573960fa167e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:20.938054 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b5e9b-8795-4d2c-82e5-55a5bd345c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:20.939427 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b5e9b-8795-4d2c-82e5-55a5bd345c7a admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:20.939846 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b5e9b-8795-4d2c-82e5-55a5bd345c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:20.940269 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b5e9b-8795-4d2c-82e5-55a5bd345c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:20.941062 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b5e9b-8795-4d2c-82e5-55a5bd345c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:20.943144 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b5e9b-8795-4d2c-82e5-55a5bd345c7a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:20.977414 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 908/1810] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:20 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:20.979038 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b5e9b-8795-4d2c-82e5-55a5bd345c7a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:21.018860 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562c7ab-5dce-4b23-a5cd-3ecc0ce3ff7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:21.020397 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562c7ab-5dce-4b23-a5cd-3ecc0ce3ff7b admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:21.020717 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562c7ab-5dce-4b23-a5cd-3ecc0ce3ff7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:21.020999 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562c7ab-5dce-4b23-a5cd-3ecc0ce3ff7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:21.022067 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562c7ab-5dce-4b23-a5cd-3ecc0ce3ff7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:21.023639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562c7ab-5dce-4b23-a5cd-3ecc0ce3ff7b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:21.044676 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 903/1811] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:21.045528 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562c7ab-5dce-4b23-a5cd-3ecc0ce3ff7b admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:21.067169 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562c7ab-5dce-4b23-a5cd-3ecc0ce3ff7b admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:21.096186 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b5e9b-8795-4d2c-82e5-55a5bd345c7a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:21.096474 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:21.112163 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fafde7-051b-4fe0-b89c-196760d66f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:21.112813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fafde7-051b-4fe0-b89c-196760d66f46 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:21.113097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fafde7-051b-4fe0-b89c-196760d66f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:21.113371 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fafde7-051b-4fe0-b89c-196760d66f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:21.114026 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fafde7-051b-4fe0-b89c-196760d66f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:21.120968 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fafde7-051b-4fe0-b89c-196760d66f46 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:21.162672 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 909/1812] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:21.172299 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fafde7-051b-4fe0-b89c-196760d66f46 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:21.194975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fafde7-051b-4fe0-b89c-196760d66f46 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:21.205870 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf10ff-0420-4f23-a8ec-feaf982449c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:21.206579 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf10ff-0420-4f23-a8ec-feaf982449c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:21.206858 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf10ff-0420-4f23-a8ec-feaf982449c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:21.207134 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf10ff-0420-4f23-a8ec-feaf982449c2 admin admin] PATH_INFO: `/v3/projects/8e1f5d254108400982a4ae154b901700/users/c0f5577b55224b2eb9decfd291728da1/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:21.212981 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf10ff-0420-4f23-a8ec-feaf982449c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1f5d254108400982a4ae154b901700, user_id=c0f5577b55224b2eb9decfd291728da1, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:21.216592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf10ff-0420-4f23-a8ec-feaf982449c2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:21.228618 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e0a06-900f-48b6-b42a-f5e12b53351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:21.229427 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e0a06-900f-48b6-b42a-f5e12b53351b admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:21.229427 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e0a06-900f-48b6-b42a-f5e12b53351b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:21.229707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e0a06-900f-48b6-b42a-f5e12b53351b admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:21.231999 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e0a06-900f-48b6-b42a-f5e12b53351b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:21.237768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e0a06-900f-48b6-b42a-f5e12b53351b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:21.248256 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 910/1813] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:21 2022] PUT /identity/v3/projects/8e1f5d254108400982a4ae154b901700/users/c0f5577b55224b2eb9decfd291728da1/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:21.249477 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf10ff-0420-4f23-a8ec-feaf982449c2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:21.271868 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:21.281457 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 904/1814] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:21 2022] POST /identity/v3/users => generated 291 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:21.286037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8b2e2-5754-4487-90ea-f617ba2c6195 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:21.286325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8b2e2-5754-4487-90ea-f617ba2c6195 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:21.287604 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8b2e2-5754-4487-90ea-f617ba2c6195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:21.369054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-75e8b2e2-5754-4487-90ea-f617ba2c6195 None None] MFA Rules not processed for user `c0f5577b55224b2eb9decfd291728da1`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:21.370333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-75e8b2e2-5754-4487-90ea-f617ba2c6195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:21.408805 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf10ff-0420-4f23-a8ec-feaf982449c2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:21.418375 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0394a7-479b-415b-8dbf-6df982800f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:21.419598 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0394a7-479b-415b-8dbf-6df982800f26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:21.419598 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0394a7-479b-415b-8dbf-6df982800f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:21.419779 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0394a7-479b-415b-8dbf-6df982800f26 admin admin] PATH_INFO: `/v3/projects/f1e3a5d887664b1bb90b95a1dda1db92/users/44a0a0d706114181b3957d173d6b5ec4/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:21.421729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0394a7-479b-415b-8dbf-6df982800f26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1e3a5d887664b1bb90b95a1dda1db92, user_id=44a0a0d706114181b3957d173d6b5ec4, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:21.425367 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0394a7-479b-415b-8dbf-6df982800f26 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:21.462433 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 911/1815] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:21 2022] PUT /identity/v3/projects/f1e3a5d887664b1bb90b95a1dda1db92/users/44a0a0d706114181b3957d173d6b5ec4/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:21.463546 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0394a7-479b-415b-8dbf-6df982800f26 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:21.518735 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 905/1816] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:21.521939 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd56df-495c-4172-b11f-0691b975e474 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:21.521939 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd56df-495c-4172-b11f-0691b975e474 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:21.522143 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd56df-495c-4172-b11f-0691b975e474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:21.584035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0394a7-479b-415b-8dbf-6df982800f26 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:21.589470 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366e6fd-7c5d-49ad-abd2-52e30eb667ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:21.590148 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366e6fd-7c5d-49ad-abd2-52e30eb667ae admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:21.590428 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366e6fd-7c5d-49ad-abd2-52e30eb667ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:21.590695 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366e6fd-7c5d-49ad-abd2-52e30eb667ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:21.591571 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366e6fd-7c5d-49ad-abd2-52e30eb667ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:21.594117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366e6fd-7c5d-49ad-abd2-52e30eb667ae admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:21.603229 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-37dd56df-495c-4172-b11f-0691b975e474 None None] MFA Rules not processed for user `44a0a0d706114181b3957d173d6b5ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:21.606099 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-37dd56df-495c-4172-b11f-0691b975e474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:21.626725 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 912/1817] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:21.627615 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366e6fd-7c5d-49ad-abd2-52e30eb667ae admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:21.629458 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0366e6fd-7c5d-49ad-abd2-52e30eb667ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:21.755385 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366e6fd-7c5d-49ad-abd2-52e30eb667ae admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:21.760923 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 906/1818] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:21 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:21.762987 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd56df-495c-4172-b11f-0691b975e474 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:21.768606 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616a0a2-ff70-4d42-9a0f-a820b86aedac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:21.769551 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616a0a2-ff70-4d42-9a0f-a820b86aedac service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:21.770058 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616a0a2-ff70-4d42-9a0f-a820b86aedac service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:21.771824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616a0a2-ff70-4d42-9a0f-a820b86aedac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:21.792053 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd56df-495c-4172-b11f-0691b975e474 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:21.806057 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbaaebe-51d5-4864-9023-aabaa373f34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:21.807453 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaaebe-51d5-4864-9023-aabaa373f34c admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:21.807992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaaebe-51d5-4864-9023-aabaa373f34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:21.808450 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaaebe-51d5-4864-9023-aabaa373f34c admin admin] PATH_INFO: `/v3/projects/5f3a6a0107094b429ba541cd5c738eff/users/63eb3ce3999a41ad85512fe5f1bc4566/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:21.826545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbaaebe-51d5-4864-9023-aabaa373f34c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3a6a0107094b429ba541cd5c738eff, user_id=63eb3ce3999a41ad85512fe5f1bc4566, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:21.845802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbaaebe-51d5-4864-9023-aabaa373f34c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:21.853922 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:21.867969 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:21.880699 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 907/1819] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:21 2022] PUT /identity/v3/projects/5f3a6a0107094b429ba541cd5c738eff/users/63eb3ce3999a41ad85512fe5f1bc4566/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:21.884740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbaaebe-51d5-4864-9023-aabaa373f34c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:21.890074 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616a0a2-ff70-4d42-9a0f-a820b86aedac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:21.893424 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616a0a2-ff70-4d42-9a0f-a820b86aedac service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:21.908304 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 913/1820] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:21.909176 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616a0a2-ff70-4d42-9a0f-a820b86aedac service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:21.911312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4616a0a2-ff70-4d42-9a0f-a820b86aedac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:21.923773 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616a0a2-ff70-4d42-9a0f-a820b86aedac service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:22.012988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089b633-9354-43f8-8669-ed3256ed4fdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:22.013681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089b633-9354-43f8-8669-ed3256ed4fdb service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:22.015184 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089b633-9354-43f8-8669-ed3256ed4fdb service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:22.015184 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089b633-9354-43f8-8669-ed3256ed4fdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:22.067906 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbaaebe-51d5-4864-9023-aabaa373f34c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:22.081197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b284678-b8fe-4e1d-a21e-aaf7c3c8c5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:22.081838 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b284678-b8fe-4e1d-a21e-aaf7c3c8c5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:22.082113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b284678-b8fe-4e1d-a21e-aaf7c3c8c5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:22.082384 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b284678-b8fe-4e1d-a21e-aaf7c3c8c5f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:22.083063 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b284678-b8fe-4e1d-a21e-aaf7c3c8c5f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:22.084772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b284678-b8fe-4e1d-a21e-aaf7c3c8c5f3 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:22.101841 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 908/1821] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:22.103952 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b284678-b8fe-4e1d-a21e-aaf7c3c8c5f3 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:22.130549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b284678-b8fe-4e1d-a21e-aaf7c3c8c5f3 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:22.145226 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089b633-9354-43f8-8669-ed3256ed4fdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:22.146628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089b633-9354-43f8-8669-ed3256ed4fdb service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:22.148621 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feee363-1c8c-4086-8c97-10152c94856a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:22.150838 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feee363-1c8c-4086-8c97-10152c94856a admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:22.151122 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feee363-1c8c-4086-8c97-10152c94856a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:22.151415 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feee363-1c8c-4086-8c97-10152c94856a admin admin] PATH_INFO: `/v3/projects/5f3a6a0107094b429ba541cd5c738eff/users/63eb3ce3999a41ad85512fe5f1bc4566/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:22.157942 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feee363-1c8c-4086-8c97-10152c94856a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3a6a0107094b429ba541cd5c738eff, user_id=63eb3ce3999a41ad85512fe5f1bc4566, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:22.169551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feee363-1c8c-4086-8c97-10152c94856a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:22.194650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 914/1822] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:21 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:22.206392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 909/1823] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:22 2022] PUT /identity/v3/projects/5f3a6a0107094b429ba541cd5c738eff/users/63eb3ce3999a41ad85512fe5f1bc4566/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:22.223091 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cb967-8d2e-46d3-8bd3-841e4ab01002 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:22.223906 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cb967-8d2e-46d3-8bd3-841e4ab01002 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:22.224296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cb967-8d2e-46d3-8bd3-841e4ab01002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:22.277094 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feee363-1c8c-4086-8c97-10152c94856a admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:22.332852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-809cb967-8d2e-46d3-8bd3-841e4ab01002 None None] MFA Rules not processed for user `63eb3ce3999a41ad85512fe5f1bc4566`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:22.334194 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-809cb967-8d2e-46d3-8bd3-841e4ab01002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:22.420670 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feee363-1c8c-4086-8c97-10152c94856a admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:22.425561 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d6c94-e273-4198-93ab-338ad13e7b5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:22.426269 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d6c94-e273-4198-93ab-338ad13e7b5e service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:22.426544 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d6c94-e273-4198-93ab-338ad13e7b5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:22.426861 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d6c94-e273-4198-93ab-338ad13e7b5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:22.462531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 915/1824] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:22.463416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cb967-8d2e-46d3-8bd3-841e4ab01002 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:22.484689 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cb967-8d2e-46d3-8bd3-841e4ab01002 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:22.503062 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0ed6a-eee7-424e-a71a-8ee13eca53fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:22.504201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0ed6a-eee7-424e-a71a-8ee13eca53fb service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:22.504554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0ed6a-eee7-424e-a71a-8ee13eca53fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:22.504890 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0ed6a-eee7-424e-a71a-8ee13eca53fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:22.541661 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d6c94-e273-4198-93ab-338ad13e7b5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:22.543828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d6c94-e273-4198-93ab-338ad13e7b5e service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:22.546902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:22.578591 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 910/1825] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:58:22.598577 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0ed6a-eee7-424e-a71a-8ee13eca53fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:22.600076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0ed6a-eee7-424e-a71a-8ee13eca53fb service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:22.607131 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d6c94-e273-4198-93ab-338ad13e7b5e service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:22.621384 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d6c94-e273-4198-93ab-338ad13e7b5e service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:22.623923 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 916/1826] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:22 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:22.631285 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b62d7e-c452-4712-9e78-2aa06045f746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:22.631584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b62d7e-c452-4712-9e78-2aa06045f746 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:22.632741 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b62d7e-c452-4712-9e78-2aa06045f746 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:22.632741 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b62d7e-c452-4712-9e78-2aa06045f746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:22.645714 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b62d7e-c452-4712-9e78-2aa06045f746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:22.664109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b62d7e-c452-4712-9e78-2aa06045f746 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:22.690538 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 911/1827] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:22.791225 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0ed6a-eee7-424e-a71a-8ee13eca53fb service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:22.810930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0ed6a-eee7-424e-a71a-8ee13eca53fb service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:22.816076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72866702-b957-4be5-8c2e-1c0508c5a880 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:22.817499 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72866702-b957-4be5-8c2e-1c0508c5a880 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:22.818039 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72866702-b957-4be5-8c2e-1c0508c5a880 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:22.818323 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72866702-b957-4be5-8c2e-1c0508c5a880 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:22.953601 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72866702-b957-4be5-8c2e-1c0508c5a880 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:22.955648 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72866702-b957-4be5-8c2e-1c0508c5a880 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:22.984138 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 917/1828] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:23.557046 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335f3c6-96c0-4196-8091-1a893b7221a4 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:23.558051 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335f3c6-96c0-4196-8091-1a893b7221a4 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:23.558468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335f3c6-96c0-4196-8091-1a893b7221a4 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:23.560344 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 912/1829] 10.222.0.27 () {54 vars in 921 bytes} [Tue Aug 30 11:58:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:58:23.619475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec942d-0dc4-4b21-9bb6-ee522873769b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:23.620047 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec942d-0dc4-4b21-9bb6-ee522873769b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:23.620047 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec942d-0dc4-4b21-9bb6-ee522873769b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:23.654428 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-42ec942d-0dc4-4b21-9bb6-ee522873769b None None] MFA Rules not processed for user `8d17f1d0577a41ed8859706073f79d77`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:23.655596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-42ec942d-0dc4-4b21-9bb6-ee522873769b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:23.773297 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 918/1830] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Aug 30 11:58:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:23.789472 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335f3c6-96c0-4196-8091-1a893b7221a4 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:23.837403 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:23.898530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec942d-0dc4-4b21-9bb6-ee522873769b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:23.900378 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-42ec942d-0dc4-4b21-9bb6-ee522873769b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:23.918569 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec942d-0dc4-4b21-9bb6-ee522873769b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:23.946467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96801a27-c8e2-4db4-9c21-b22bb12b6243 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:23.947177 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96801a27-c8e2-4db4-9c21-b22bb12b6243 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:23.947614 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96801a27-c8e2-4db4-9c21-b22bb12b6243 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:23.947766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96801a27-c8e2-4db4-9c21-b22bb12b6243 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:23.962778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335f3c6-96c0-4196-8091-1a893b7221a4 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:23.968878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96801a27-c8e2-4db4-9c21-b22bb12b6243 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:23.972245 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96801a27-c8e2-4db4-9c21-b22bb12b6243 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:23.996795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dc248-d4a4-410b-ab9e-67b4d11c93ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:23.997483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dc248-d4a4-410b-ab9e-67b4d11c93ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:23.997839 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dc248-d4a4-410b-ab9e-67b4d11c93ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:23.998118 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dc248-d4a4-410b-ab9e-67b4d11c93ce admin admin] PATH_INFO: `/v3/users/68c511b32e5f4200bab684d3dd72d04c` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:24.000074 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4dc248-d4a4-410b-ab9e-67b4d11c93ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=68c511b32e5f4200bab684d3dd72d04c)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:24.002760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4dc248-d4a4-410b-ab9e-67b4d11c93ce admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:24.006605 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 919/1831] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:24.083077 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0d4dc248-d4a4-410b-ab9e-67b4d11c93ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68c511b32e5f4200bab684d3dd72d04c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:24.093361 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0d4dc248-d4a4-410b-ab9e-67b4d11c93ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68c511b32e5f4200bab684d3dd72d04c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:24.111740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0d4dc248-d4a4-410b-ab9e-67b4d11c93ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68c511b32e5f4200bab684d3dd72d04c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:24.112063 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0d4dc248-d4a4-410b-ab9e-67b4d11c93ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68c511b32e5f4200bab684d3dd72d04c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:24.131784 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0d4dc248-d4a4-410b-ab9e-67b4d11c93ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68c511b32e5f4200bab684d3dd72d04c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:24.142978 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 913/1832] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:23 2022] DELETE /identity/v3/users/68c511b32e5f4200bab684d3dd72d04c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:24.148741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d9b0c-bcef-4079-8992-8341d32a3a7e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:24.148917 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d9b0c-bcef-4079-8992-8341d32a3a7e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:24.149328 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d9b0c-bcef-4079-8992-8341d32a3a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:24.179351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9e3d9b0c-bcef-4079-8992-8341d32a3a7e None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:24.180845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9e3d9b0c-bcef-4079-8992-8341d32a3a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:24.285343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:24.337719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 920/1833] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:24.379249 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dc248-d4a4-410b-ab9e-67b4d11c93ce admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:24.382803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0d4dc248-d4a4-410b-ab9e-67b4d11c93ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:24.479852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d9b0c-bcef-4079-8992-8341d32a3a7e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:24.481278 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9e3d9b0c-bcef-4079-8992-8341d32a3a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:24.499560 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d9b0c-bcef-4079-8992-8341d32a3a7e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:24.511769 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e38f8-98fc-430d-8be4-3e1971ac6a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:24.513778 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e38f8-98fc-430d-8be4-3e1971ac6a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:24.514083 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e38f8-98fc-430d-8be4-3e1971ac6a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:24.514357 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e38f8-98fc-430d-8be4-3e1971ac6a63 admin admin] PATH_INFO: `/v3/users/107da08535dc40e88cf882051d29d0c4` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:24.517348 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e38f8-98fc-430d-8be4-3e1971ac6a63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=107da08535dc40e88cf882051d29d0c4)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:24.523419 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e38f8-98fc-430d-8be4-3e1971ac6a63 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:24.525108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dc248-d4a4-410b-ab9e-67b4d11c93ce admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:24.528933 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a24aa3-70e3-4272-a60c-98f97fcadc47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:24.529563 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a24aa3-70e3-4272-a60c-98f97fcadc47 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:24.529904 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a24aa3-70e3-4272-a60c-98f97fcadc47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:24.530179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a24aa3-70e3-4272-a60c-98f97fcadc47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:24.541900 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a24aa3-70e3-4272-a60c-98f97fcadc47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:24.543890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a24aa3-70e3-4272-a60c-98f97fcadc47 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:24.577742 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 914/1834] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:24.676242 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3e0e38f8-98fc-430d-8be4-3e1971ac6a63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '107da08535dc40e88cf882051d29d0c4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:24.705960 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3e0e38f8-98fc-430d-8be4-3e1971ac6a63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '107da08535dc40e88cf882051d29d0c4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:24.737672 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3e0e38f8-98fc-430d-8be4-3e1971ac6a63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '107da08535dc40e88cf882051d29d0c4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:24.774445 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3e0e38f8-98fc-430d-8be4-3e1971ac6a63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '107da08535dc40e88cf882051d29d0c4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:24.776616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3e0e38f8-98fc-430d-8be4-3e1971ac6a63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '107da08535dc40e88cf882051d29d0c4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:24.805195 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 921/1835] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:24 2022] DELETE /identity/v3/users/107da08535dc40e88cf882051d29d0c4 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:24.807027 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf58c17-db30-4129-967c-4c7cd02a1261 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:24.807478 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf58c17-db30-4129-967c-4c7cd02a1261 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:24.807950 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf58c17-db30-4129-967c-4c7cd02a1261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:24.855707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2bf58c17-db30-4129-967c-4c7cd02a1261 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:24.857063 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2bf58c17-db30-4129-967c-4c7cd02a1261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:24.999952 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:25.133891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 915/1836] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:25.184328 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e38f8-98fc-430d-8be4-3e1971ac6a63 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:25.186348 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3e0e38f8-98fc-430d-8be4-3e1971ac6a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:25.322485 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e38f8-98fc-430d-8be4-3e1971ac6a63 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:25.327798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d7a8c-f57a-4677-9148-15c990fbc30b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:25.328436 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d7a8c-f57a-4677-9148-15c990fbc30b service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:25.329165 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d7a8c-f57a-4677-9148-15c990fbc30b service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:25.329501 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d7a8c-f57a-4677-9148-15c990fbc30b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:25.343904 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d7a8c-f57a-4677-9148-15c990fbc30b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:25.348535 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d7a8c-f57a-4677-9148-15c990fbc30b service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:25.364826 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 922/1837] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:25.742128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf58c17-db30-4129-967c-4c7cd02a1261 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:25.744655 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2bf58c17-db30-4129-967c-4c7cd02a1261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:25.762234 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf58c17-db30-4129-967c-4c7cd02a1261 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:25.781729 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52a76f-d8fd-41ca-9c42-5ec7178527ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:25.782567 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52a76f-d8fd-41ca-9c42-5ec7178527ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:25.782947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52a76f-d8fd-41ca-9c42-5ec7178527ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:25.783221 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52a76f-d8fd-41ca-9c42-5ec7178527ae admin admin] PATH_INFO: `/v3/projects/f8e735b794a04da8b45a9660126df3c9` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:25.785212 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52a76f-d8fd-41ca-9c42-5ec7178527ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8e735b794a04da8b45a9660126df3c9)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:25.790429 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52a76f-d8fd-41ca-9c42-5ec7178527ae admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:25.860831 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-df52a76f-d8fd-41ca-9c42-5ec7178527ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8e735b794a04da8b45a9660126df3c9', 'request_id': 'req-df52a76f-d8fd-41ca-9c42-5ec7178527ae'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:25.875077 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-df52a76f-d8fd-41ca-9c42-5ec7178527ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8e735b794a04da8b45a9660126df3c9', 'request_id': 'req-df52a76f-d8fd-41ca-9c42-5ec7178527ae'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:25.890201 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-df52a76f-d8fd-41ca-9c42-5ec7178527ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8e735b794a04da8b45a9660126df3c9', 'request_id': 'req-df52a76f-d8fd-41ca-9c42-5ec7178527ae'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:25.910588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-df52a76f-d8fd-41ca-9c42-5ec7178527ae admin admin] The token cache is being invalidate because project f8e735b794a04da8b45a9660126df3c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:25.910880 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-df52a76f-d8fd-41ca-9c42-5ec7178527ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:25.911556 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-df52a76f-d8fd-41ca-9c42-5ec7178527ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:25.913258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 916/1838] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:25 2022] DELETE /identity/v3/projects/f8e735b794a04da8b45a9660126df3c9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:25.917261 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d7a8c-f57a-4677-9148-15c990fbc30b service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:25.928318 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d7a8c-f57a-4677-9148-15c990fbc30b service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:25.992401 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:25.999283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3eb89b-021d-4127-84d9-07a3929c8d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:26.000325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3eb89b-021d-4127-84d9-07a3929c8d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:26.000969 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3eb89b-021d-4127-84d9-07a3929c8d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:26.001764 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3eb89b-021d-4127-84d9-07a3929c8d1a admin admin] PATH_INFO: `/v3/users/c0f5577b55224b2eb9decfd291728da1` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:26.002982 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3eb89b-021d-4127-84d9-07a3929c8d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f5577b55224b2eb9decfd291728da1)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:26.005139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3eb89b-021d-4127-84d9-07a3929c8d1a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:26.065138 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52a76f-d8fd-41ca-9c42-5ec7178527ae admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:26.066675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-df52a76f-d8fd-41ca-9c42-5ec7178527ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:26.080403 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52a76f-d8fd-41ca-9c42-5ec7178527ae admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:26.091635 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4c3eb89b-021d-4127-84d9-07a3929c8d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f5577b55224b2eb9decfd291728da1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:26.095741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4c3eb89b-021d-4127-84d9-07a3929c8d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f5577b55224b2eb9decfd291728da1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:26.101583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94f630-06b9-4f6b-95a1-22e5b7438c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:26.102996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94f630-06b9-4f6b-95a1-22e5b7438c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:26.103351 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94f630-06b9-4f6b-95a1-22e5b7438c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:26.103656 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94f630-06b9-4f6b-95a1-22e5b7438c6c admin admin] PATH_INFO: `/v3/projects/cc0ea8bab8584d6f98f8bbe1ffed98b8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:26.106333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94f630-06b9-4f6b-95a1-22e5b7438c6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc0ea8bab8584d6f98f8bbe1ffed98b8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:26.108495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94f630-06b9-4f6b-95a1-22e5b7438c6c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:26.116054 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4c3eb89b-021d-4127-84d9-07a3929c8d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f5577b55224b2eb9decfd291728da1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:26.148692 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4c3eb89b-021d-4127-84d9-07a3929c8d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f5577b55224b2eb9decfd291728da1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:26.150041 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4c3eb89b-021d-4127-84d9-07a3929c8d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f5577b55224b2eb9decfd291728da1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:26.159394 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 923/1839] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:25 2022] DELETE /identity/v3/users/c0f5577b55224b2eb9decfd291728da1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:26.170201 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-da94f630-06b9-4f6b-95a1-22e5b7438c6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc0ea8bab8584d6f98f8bbe1ffed98b8', 'request_id': 'req-da94f630-06b9-4f6b-95a1-22e5b7438c6c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:26.178035 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-da94f630-06b9-4f6b-95a1-22e5b7438c6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc0ea8bab8584d6f98f8bbe1ffed98b8', 'request_id': 'req-da94f630-06b9-4f6b-95a1-22e5b7438c6c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:26.186305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-da94f630-06b9-4f6b-95a1-22e5b7438c6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc0ea8bab8584d6f98f8bbe1ffed98b8', 'request_id': 'req-da94f630-06b9-4f6b-95a1-22e5b7438c6c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:26.213138 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-da94f630-06b9-4f6b-95a1-22e5b7438c6c admin admin] The token cache is being invalidate because project cc0ea8bab8584d6f98f8bbe1ffed98b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:26.213702 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-da94f630-06b9-4f6b-95a1-22e5b7438c6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:26.214967 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-da94f630-06b9-4f6b-95a1-22e5b7438c6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:26.217338 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 917/1840] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:26 2022] DELETE /identity/v3/projects/cc0ea8bab8584d6f98f8bbe1ffed98b8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:26.221827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3eb89b-021d-4127-84d9-07a3929c8d1a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:26.225359 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4c3eb89b-021d-4127-84d9-07a3929c8d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:26.328800 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3eb89b-021d-4127-84d9-07a3929c8d1a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:26.334596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9677988-cc15-43c1-9b8a-8cd318dac3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:26.336381 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9677988-cc15-43c1-9b8a-8cd318dac3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:26.336381 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9677988-cc15-43c1-9b8a-8cd318dac3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:26.336381 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9677988-cc15-43c1-9b8a-8cd318dac3fe admin admin] PATH_INFO: `/v3/users/4fe4161e467e479cb63d47b7b540c560` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:26.337393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9677988-cc15-43c1-9b8a-8cd318dac3fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fe4161e467e479cb63d47b7b540c560)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:26.339628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9677988-cc15-43c1-9b8a-8cd318dac3fe admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:26.405507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f9677988-cc15-43c1-9b8a-8cd318dac3fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fe4161e467e479cb63d47b7b540c560'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:26.413035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f9677988-cc15-43c1-9b8a-8cd318dac3fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fe4161e467e479cb63d47b7b540c560'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:26.423163 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f9677988-cc15-43c1-9b8a-8cd318dac3fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fe4161e467e479cb63d47b7b540c560'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:26.435603 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:26.437204 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f9677988-cc15-43c1-9b8a-8cd318dac3fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fe4161e467e479cb63d47b7b540c560'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:26.438374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f9677988-cc15-43c1-9b8a-8cd318dac3fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fe4161e467e479cb63d47b7b540c560'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:26.450139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 924/1841] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:26 2022] DELETE /identity/v3/users/4fe4161e467e479cb63d47b7b540c560 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:26.518611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94f630-06b9-4f6b-95a1-22e5b7438c6c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:26.520204 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-da94f630-06b9-4f6b-95a1-22e5b7438c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:26.614559 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:26.698111 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94f630-06b9-4f6b-95a1-22e5b7438c6c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:26.791605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277eccd-9d0b-495e-8a43-ecc34583eb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:26.792419 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277eccd-9d0b-495e-8a43-ecc34583eb81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:26.792803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277eccd-9d0b-495e-8a43-ecc34583eb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:26.793150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277eccd-9d0b-495e-8a43-ecc34583eb81 admin admin] PATH_INFO: `/v3/projects/8e1f5d254108400982a4ae154b901700` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:26.794535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277eccd-9d0b-495e-8a43-ecc34583eb81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e1f5d254108400982a4ae154b901700)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:26.798911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277eccd-9d0b-495e-8a43-ecc34583eb81 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:26.864738 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4277eccd-9d0b-495e-8a43-ecc34583eb81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e1f5d254108400982a4ae154b901700', 'request_id': 'req-4277eccd-9d0b-495e-8a43-ecc34583eb81'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:26.874999 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4277eccd-9d0b-495e-8a43-ecc34583eb81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e1f5d254108400982a4ae154b901700', 'request_id': 'req-4277eccd-9d0b-495e-8a43-ecc34583eb81'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:26.882197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4277eccd-9d0b-495e-8a43-ecc34583eb81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e1f5d254108400982a4ae154b901700', 'request_id': 'req-4277eccd-9d0b-495e-8a43-ecc34583eb81'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:26.900615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4277eccd-9d0b-495e-8a43-ecc34583eb81 admin admin] The token cache is being invalidate because project 8e1f5d254108400982a4ae154b901700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:26.900615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4277eccd-9d0b-495e-8a43-ecc34583eb81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:26.900615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4277eccd-9d0b-495e-8a43-ecc34583eb81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:26.916732 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 918/1842] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:26 2022] DELETE /identity/v3/projects/8e1f5d254108400982a4ae154b901700 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:26.918149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01274a9-1110-4b99-95da-44d14015c63b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:26.918636 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01274a9-1110-4b99-95da-44d14015c63b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:26.918867 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01274a9-1110-4b99-95da-44d14015c63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:26.949352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e01274a9-1110-4b99-95da-44d14015c63b None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:26.951152 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e01274a9-1110-4b99-95da-44d14015c63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:27.031940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 925/1843] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:27.039925 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb2178-d1a5-47bd-b02d-cb8ba3d9e53c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:27.041763 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb2178-d1a5-47bd-b02d-cb8ba3d9e53c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:27.041763 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb2178-d1a5-47bd-b02d-cb8ba3d9e53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:27.084161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-dfbb2178-d1a5-47bd-b02d-cb8ba3d9e53c None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:27.100240 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-dfbb2178-d1a5-47bd-b02d-cb8ba3d9e53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:27.102861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01274a9-1110-4b99-95da-44d14015c63b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:27.104489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e01274a9-1110-4b99-95da-44d14015c63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:27.141173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01274a9-1110-4b99-95da-44d14015c63b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:27.152276 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8a283-318e-41c7-93dd-95f4da95ee06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:27.153335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8a283-318e-41c7-93dd-95f4da95ee06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:27.153717 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8a283-318e-41c7-93dd-95f4da95ee06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:27.154361 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8a283-318e-41c7-93dd-95f4da95ee06 admin admin] PATH_INFO: `/v3/projects/3e0c7bd28df241e48a21563460f3e5d5` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:27.156551 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8a283-318e-41c7-93dd-95f4da95ee06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e0c7bd28df241e48a21563460f3e5d5)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:27.158736 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8a283-318e-41c7-93dd-95f4da95ee06 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:27.162796 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 919/1844] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:27.169872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb2178-d1a5-47bd-b02d-cb8ba3d9e53c None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:27.195320 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb2178-d1a5-47bd-b02d-cb8ba3d9e53c None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:27.220405 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99957651-de09-45d5-8a05-214a815fa8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:27.221089 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99957651-de09-45d5-8a05-214a815fa8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:27.221376 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99957651-de09-45d5-8a05-214a815fa8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:27.221675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99957651-de09-45d5-8a05-214a815fa8d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:27.222344 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99957651-de09-45d5-8a05-214a815fa8d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:27.222654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99957651-de09-45d5-8a05-214a815fa8d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:27.224371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99957651-de09-45d5-8a05-214a815fa8d9 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:27.260417 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-90d8a283-318e-41c7-93dd-95f4da95ee06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e0c7bd28df241e48a21563460f3e5d5', 'request_id': 'req-90d8a283-318e-41c7-93dd-95f4da95ee06'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:27.265818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 920/1845] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:27.270375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99957651-de09-45d5-8a05-214a815fa8d9 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:27.285378 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-90d8a283-318e-41c7-93dd-95f4da95ee06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e0c7bd28df241e48a21563460f3e5d5', 'request_id': 'req-90d8a283-318e-41c7-93dd-95f4da95ee06'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:27.293021 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99957651-de09-45d5-8a05-214a815fa8d9 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:27.294843 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-90d8a283-318e-41c7-93dd-95f4da95ee06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e0c7bd28df241e48a21563460f3e5d5', 'request_id': 'req-90d8a283-318e-41c7-93dd-95f4da95ee06'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:27.327340 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-90d8a283-318e-41c7-93dd-95f4da95ee06 admin admin] The token cache is being invalidate because project 3e0c7bd28df241e48a21563460f3e5d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:27.328239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-90d8a283-318e-41c7-93dd-95f4da95ee06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:27.330372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-90d8a283-318e-41c7-93dd-95f4da95ee06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:27.334943 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 926/1846] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:27 2022] DELETE /identity/v3/projects/3e0c7bd28df241e48a21563460f3e5d5 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:27.341583 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce7539-7fa6-465c-8be7-e22ebdc52327 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:27.341961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce7539-7fa6-465c-8be7-e22ebdc52327 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:27.342317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce7539-7fa6-465c-8be7-e22ebdc52327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:27.394859 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-94ce7539-7fa6-465c-8be7-e22ebdc52327 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:27.396224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-94ce7539-7fa6-465c-8be7-e22ebdc52327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:27.415915 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405b2a8-6727-4635-96b1-493d950c7de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:27.416438 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405b2a8-6727-4635-96b1-493d950c7de5 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:27.416739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405b2a8-6727-4635-96b1-493d950c7de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:27.416972 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405b2a8-6727-4635-96b1-493d950c7de5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:27.417621 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405b2a8-6727-4635-96b1-493d950c7de5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:27.419605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405b2a8-6727-4635-96b1-493d950c7de5 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:27.449069 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:27.485298 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 921/1847] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:27 2022] POST /identity/v3/projects => generated 377 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:27.488100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405b2a8-6727-4635-96b1-493d950c7de5 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:27.493166 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7405b2a8-6727-4635-96b1-493d950c7de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:27.563984 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 927/1848] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:27.570561 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495136d4-5007-4882-90e9-8547f0e7d487 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:27.570889 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495136d4-5007-4882-90e9-8547f0e7d487 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:27.574653 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495136d4-5007-4882-90e9-8547f0e7d487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:27.635110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-495136d4-5007-4882-90e9-8547f0e7d487 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:27.636878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-495136d4-5007-4882-90e9-8547f0e7d487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:27.650180 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 928/1849] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:27.657191 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495136d4-5007-4882-90e9-8547f0e7d487 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:27.658798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-495136d4-5007-4882-90e9-8547f0e7d487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:27.677089 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405b2a8-6727-4635-96b1-493d950c7de5 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:27.680262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495136d4-5007-4882-90e9-8547f0e7d487 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:27.689825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac6c78-dbe1-4a81-bd36-37677f1b3be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:27.689825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac6c78-dbe1-4a81-bd36-37677f1b3be0 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:27.689825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac6c78-dbe1-4a81-bd36-37677f1b3be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:27.689825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac6c78-dbe1-4a81-bd36-37677f1b3be0 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:27.690716 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac6c78-dbe1-4a81-bd36-37677f1b3be0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:27.691318 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7de6f-0937-4111-9370-5546b7b7d43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:27.692145 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7de6f-0937-4111-9370-5546b7b7d43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:27.692813 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac6c78-dbe1-4a81-bd36-37677f1b3be0 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:27.693256 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7de6f-0937-4111-9370-5546b7b7d43c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:27.694974 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7de6f-0937-4111-9370-5546b7b7d43c admin admin] PATH_INFO: `/v3/users/d6caea1ed4b14fa59855a466947d20d5` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:27.698149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7de6f-0937-4111-9370-5546b7b7d43c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6caea1ed4b14fa59855a466947d20d5)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:27.707193 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7de6f-0937-4111-9370-5546b7b7d43c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:27.723827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:27.730011 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 922/1850] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:27 2022] POST /identity/v3/users => generated 289 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:27.731656 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac6c78-dbe1-4a81-bd36-37677f1b3be0 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:27.748507 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac6c78-dbe1-4a81-bd36-37677f1b3be0 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:27.755639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009e85e-d291-45ab-aaf8-b09dae12f4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:27.756393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009e85e-d291-45ab-aaf8-b09dae12f4ba admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:27.757171 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009e85e-d291-45ab-aaf8-b09dae12f4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:27.757171 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009e85e-d291-45ab-aaf8-b09dae12f4ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:27.758450 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009e85e-d291-45ab-aaf8-b09dae12f4ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:27.758945 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009e85e-d291-45ab-aaf8-b09dae12f4ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:27.762532 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009e85e-d291-45ab-aaf8-b09dae12f4ba admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:27.781068 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 923/1851] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:27.781068 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009e85e-d291-45ab-aaf8-b09dae12f4ba admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:27.793056 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009e85e-d291-45ab-aaf8-b09dae12f4ba admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:27.798999 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e384694-32cb-4a19-8316-ee5c110e64c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:27.799813 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e384694-32cb-4a19-8316-ee5c110e64c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:27.800193 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e384694-32cb-4a19-8316-ee5c110e64c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:27.801047 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e384694-32cb-4a19-8316-ee5c110e64c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:27.801820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e384694-32cb-4a19-8316-ee5c110e64c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:27.803816 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e384694-32cb-4a19-8316-ee5c110e64c9 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:27.817248 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 924/1852] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:27.817998 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e384694-32cb-4a19-8316-ee5c110e64c9 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:27.821550 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2e384694-32cb-4a19-8316-ee5c110e64c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:27.838081 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e384694-32cb-4a19-8316-ee5c110e64c9 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:27.847282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b5bc7-2ba8-4f8b-9eed-a3e3adf84ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:27.848117 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b5bc7-2ba8-4f8b-9eed-a3e3adf84ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:27.848495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b5bc7-2ba8-4f8b-9eed-a3e3adf84ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:27.849000 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b5bc7-2ba8-4f8b-9eed-a3e3adf84ed8 admin admin] PATH_INFO: `/v3/users/0d2763404ef64f6c942d556acda5cca5` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:27.850463 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b5bc7-2ba8-4f8b-9eed-a3e3adf84ed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d2763404ef64f6c942d556acda5cca5)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:27.853004 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b5bc7-2ba8-4f8b-9eed-a3e3adf84ed8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:27.853118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-40e7de6f-0937-4111-9370-5546b7b7d43c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6caea1ed4b14fa59855a466947d20d5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:27.872979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-40e7de6f-0937-4111-9370-5546b7b7d43c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6caea1ed4b14fa59855a466947d20d5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:27.892514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-40e7de6f-0937-4111-9370-5546b7b7d43c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6caea1ed4b14fa59855a466947d20d5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:27.915214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-40e7de6f-0937-4111-9370-5546b7b7d43c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6caea1ed4b14fa59855a466947d20d5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:27.916467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-40e7de6f-0937-4111-9370-5546b7b7d43c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6caea1ed4b14fa59855a466947d20d5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:27.927411 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 929/1853] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:27 2022] DELETE /identity/v3/users/d6caea1ed4b14fa59855a466947d20d5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:27.927411 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7de6f-0937-4111-9370-5546b7b7d43c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:27.929486 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-40e7de6f-0937-4111-9370-5546b7b7d43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:27.951016 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-459b5bc7-2ba8-4f8b-9eed-a3e3adf84ed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d2763404ef64f6c942d556acda5cca5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:27.959150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-459b5bc7-2ba8-4f8b-9eed-a3e3adf84ed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d2763404ef64f6c942d556acda5cca5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:27.971053 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-459b5bc7-2ba8-4f8b-9eed-a3e3adf84ed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d2763404ef64f6c942d556acda5cca5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:27.980889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-459b5bc7-2ba8-4f8b-9eed-a3e3adf84ed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d2763404ef64f6c942d556acda5cca5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:27.987687 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-459b5bc7-2ba8-4f8b-9eed-a3e3adf84ed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d2763404ef64f6c942d556acda5cca5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:28.021118 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 925/1854] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:27 2022] DELETE /identity/v3/users/0d2763404ef64f6c942d556acda5cca5 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:28.023264 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b5bc7-2ba8-4f8b-9eed-a3e3adf84ed8 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:28.027231 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-459b5bc7-2ba8-4f8b-9eed-a3e3adf84ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:28.090832 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:28.112150 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7de6f-0937-4111-9370-5546b7b7d43c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:28.148701 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b5bc7-2ba8-4f8b-9eed-a3e3adf84ed8 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:28.154073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed89ef1-6f87-4aba-afd3-fd70a6669f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:28.154705 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed89ef1-6f87-4aba-afd3-fd70a6669f68 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:28.155220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed89ef1-6f87-4aba-afd3-fd70a6669f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:28.155536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed89ef1-6f87-4aba-afd3-fd70a6669f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:28.156888 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed89ef1-6f87-4aba-afd3-fd70a6669f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:28.159912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed89ef1-6f87-4aba-afd3-fd70a6669f68 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:28.175175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 926/1855] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:28.176374 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b7879-106d-4047-a267-7409a79e7c00 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:28.176666 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b7879-106d-4047-a267-7409a79e7c00 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:28.176944 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b7879-106d-4047-a267-7409a79e7c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:28.207993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e41b7879-106d-4047-a267-7409a79e7c00 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:28.209750 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e41b7879-106d-4047-a267-7409a79e7c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:28.221741 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 927/1856] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:28.223170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69af10-da04-46f5-806b-034dd345de8d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:28.223486 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69af10-da04-46f5-806b-034dd345de8d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:28.223762 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69af10-da04-46f5-806b-034dd345de8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:28.243728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5b6bd-2e04-4131-a0e2-0b3d6c5f3376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:28.244361 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5b6bd-2e04-4131-a0e2-0b3d6c5f3376 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:28.244695 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5b6bd-2e04-4131-a0e2-0b3d6c5f3376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:28.245018 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5b6bd-2e04-4131-a0e2-0b3d6c5f3376 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:28.246086 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5b6bd-2e04-4131-a0e2-0b3d6c5f3376 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:28.248225 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-eb69af10-da04-46f5-806b-034dd345de8d None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:28.248532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5b6bd-2e04-4131-a0e2-0b3d6c5f3376 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:28.249466 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-eb69af10-da04-46f5-806b-034dd345de8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:28.258957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 928/1857] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:28.259915 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69af10-da04-46f5-806b-034dd345de8d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:28.271947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69af10-da04-46f5-806b-034dd345de8d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:28.278576 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7deb20-d04d-4cc6-9897-be5452ccc385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:28.279429 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7deb20-d04d-4cc6-9897-be5452ccc385 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:28.279750 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7deb20-d04d-4cc6-9897-be5452ccc385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:28.280035 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7deb20-d04d-4cc6-9897-be5452ccc385 admin admin] PATH_INFO: `/v3/projects/c31245b4ec5144a5b6b5e6e6e581957e/users/2e7057de36d74e268854f1bbbaaaeb60/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:28.294195 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 930/1858] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:27 2022] POST /identity/v3/projects => generated 371 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:28.295828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5b6bd-2e04-4131-a0e2-0b3d6c5f3376 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:28.302744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7deb20-d04d-4cc6-9897-be5452ccc385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31245b4ec5144a5b6b5e6e6e581957e, user_id=2e7057de36d74e268854f1bbbaaaeb60, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:28.305822 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7deb20-d04d-4cc6-9897-be5452ccc385 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:28.306502 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c5d5b6bd-2e04-4131-a0e2-0b3d6c5f3376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:28.331403 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 929/1859] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:28 2022] PUT /identity/v3/projects/c31245b4ec5144a5b6b5e6e6e581957e/users/2e7057de36d74e268854f1bbbaaaeb60/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:28.331403 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7deb20-d04d-4cc6-9897-be5452ccc385 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:28.333189 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8b7deb20-d04d-4cc6-9897-be5452ccc385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:28.341452 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:28.391815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5b6bd-2e04-4131-a0e2-0b3d6c5f3376 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:28.410900 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7deb20-d04d-4cc6-9897-be5452ccc385 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:28.418900 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad7544-2767-4662-9cd6-5a41dbd5c673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:28.419567 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad7544-2767-4662-9cd6-5a41dbd5c673 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:28.419848 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad7544-2767-4662-9cd6-5a41dbd5c673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:28.420653 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad7544-2767-4662-9cd6-5a41dbd5c673 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:28.421306 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad7544-2767-4662-9cd6-5a41dbd5c673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:28.424240 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad7544-2767-4662-9cd6-5a41dbd5c673 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:28.457530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a2d8e-da31-4e58-ac70-7be0650d24f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:28.458149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a2d8e-da31-4e58-ac70-7be0650d24f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:28.458425 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a2d8e-da31-4e58-ac70-7be0650d24f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:28.458693 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a2d8e-da31-4e58-ac70-7be0650d24f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:28.459190 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 930/1860] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:28 2022] POST /identity/v3/users => generated 286 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:28.460062 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad7544-2767-4662-9cd6-5a41dbd5c673 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:28.461675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-09ad7544-2767-4662-9cd6-5a41dbd5c673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:28.471317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a2d8e-da31-4e58-ac70-7be0650d24f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:28.472794 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a2d8e-da31-4e58-ac70-7be0650d24f8 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:28.472986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad7544-2767-4662-9cd6-5a41dbd5c673 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:28.476595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc577d7-8fae-4329-b456-3c0cdb9b5a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:28.477067 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc577d7-8fae-4329-b456-3c0cdb9b5a7d service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:28.477344 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc577d7-8fae-4329-b456-3c0cdb9b5a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:28.477610 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc577d7-8fae-4329-b456-3c0cdb9b5a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:28.482155 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 931/1861] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:28.483588 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f5060-5013-43d0-93ef-b4d0c7b09ebe None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:28.484045 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f5060-5013-43d0-93ef-b4d0c7b09ebe None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:28.484323 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f5060-5013-43d0-93ef-b4d0c7b09ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:28.487502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc577d7-8fae-4329-b456-3c0cdb9b5a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:28.489029 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc577d7-8fae-4329-b456-3c0cdb9b5a7d service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:28.499254 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 931/1862] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:28.499995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc577d7-8fae-4329-b456-3c0cdb9b5a7d service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:28.511393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc577d7-8fae-4329-b456-3c0cdb9b5a7d service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:28.518271 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb7a6c-6231-4225-a528-a46edefdde1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:28.522999 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ae0f5060-5013-43d0-93ef-b4d0c7b09ebe None None] MFA Rules not processed for user `2e7057de36d74e268854f1bbbaaaeb60`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:28.524797 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ae0f5060-5013-43d0-93ef-b4d0c7b09ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:28.532615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb7a6c-6231-4225-a528-a46edefdde1a admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:28.532615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb7a6c-6231-4225-a528-a46edefdde1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:28.536223 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb7a6c-6231-4225-a528-a46edefdde1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:28.537079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb7a6c-6231-4225-a528-a46edefdde1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:28.540731 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb7a6c-6231-4225-a528-a46edefdde1a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:28.561375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 932/1863] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:28.563774 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb7a6c-6231-4225-a528-a46edefdde1a admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:28.580998 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb7a6c-6231-4225-a528-a46edefdde1a admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:28.589204 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337b9d3-cb6c-412e-b5c7-ded17f4ded0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:28.590701 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337b9d3-cb6c-412e-b5c7-ded17f4ded0d admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:28.591124 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337b9d3-cb6c-412e-b5c7-ded17f4ded0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:28.591569 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337b9d3-cb6c-412e-b5c7-ded17f4ded0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:28.592461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337b9d3-cb6c-412e-b5c7-ded17f4ded0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:28.594481 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337b9d3-cb6c-412e-b5c7-ded17f4ded0d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:28.609829 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 933/1864] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:28.614799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337b9d3-cb6c-412e-b5c7-ded17f4ded0d admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:28.628068 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337b9d3-cb6c-412e-b5c7-ded17f4ded0d admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:28.628923 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 932/1865] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:28.636800 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb3cce-7ccd-4fc9-84d3-452e1976bb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:28.637480 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb3cce-7ccd-4fc9-84d3-452e1976bb80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:28.637761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb3cce-7ccd-4fc9-84d3-452e1976bb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:28.638033 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb3cce-7ccd-4fc9-84d3-452e1976bb80 admin admin] PATH_INFO: `/v3/projects/46996ac229954463b79ea4befe3039db/users/997559b856a441beadd196e79b58c225/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:28.647165 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f5060-5013-43d0-93ef-b4d0c7b09ebe None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:28.652237 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ae0f5060-5013-43d0-93ef-b4d0c7b09ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:28.677048 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb3cce-7ccd-4fc9-84d3-452e1976bb80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46996ac229954463b79ea4befe3039db, user_id=997559b856a441beadd196e79b58c225, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:28.681443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb3cce-7ccd-4fc9-84d3-452e1976bb80 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:28.724586 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 934/1866] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:28 2022] PUT /identity/v3/projects/46996ac229954463b79ea4befe3039db/users/997559b856a441beadd196e79b58c225/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:28.736211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff9262-cd2b-4068-b8d1-0383cb89506d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:28.736497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff9262-cd2b-4068-b8d1-0383cb89506d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:28.736775 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff9262-cd2b-4068-b8d1-0383cb89506d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:28.768290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-97ff9262-cd2b-4068-b8d1-0383cb89506d None None] MFA Rules not processed for user `997559b856a441beadd196e79b58c225`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:28.770183 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-97ff9262-cd2b-4068-b8d1-0383cb89506d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:28.777883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:28.815612 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:28.823966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f5060-5013-43d0-93ef-b4d0c7b09ebe None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:28.868243 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 935/1867] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:28.869103 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff9262-cd2b-4068-b8d1-0383cb89506d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:28.907050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42be20b-ab8f-4988-a2e3-92aca0be6838 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6682c22be8c4bdca4be33a93e802409', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:28.907977 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42be20b-ab8f-4988-a2e3-92aca0be6838 service glance] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:28.908573 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42be20b-ab8f-4988-a2e3-92aca0be6838 service glance] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:28.908811 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42be20b-ab8f-4988-a2e3-92aca0be6838 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:28.953673 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff9262-cd2b-4068-b8d1-0383cb89506d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:28.959149 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c48a47-357d-43ca-b706-160c8edcc604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:28.959943 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c48a47-357d-43ca-b706-160c8edcc604 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:28.960478 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c48a47-357d-43ca-b706-160c8edcc604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:28.961248 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c48a47-357d-43ca-b706-160c8edcc604 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:28.964534 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c48a47-357d-43ca-b706-160c8edcc604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:28.967627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c48a47-357d-43ca-b706-160c8edcc604 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:28.996190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42be20b-ab8f-4988-a2e3-92aca0be6838 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:28.998429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42be20b-ab8f-4988-a2e3-92aca0be6838 service glance] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:29.016263 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 933/1868] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:29.018986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 936/1869] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:28 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:29.023002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42be20b-ab8f-4988-a2e3-92aca0be6838 service glance] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:29.035348 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42be20b-ab8f-4988-a2e3-92aca0be6838 service glance] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:29.181632 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c464c-613b-446a-83ac-3dc0233762c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:29.183197 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c464c-613b-446a-83ac-3dc0233762c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:29.183508 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c464c-613b-446a-83ac-3dc0233762c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:29.183836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c464c-613b-446a-83ac-3dc0233762c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:29.185630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c464c-613b-446a-83ac-3dc0233762c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:29.188909 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c464c-613b-446a-83ac-3dc0233762c5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:29.242575 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 934/1870] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:29 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:29.247041 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c48a47-357d-43ca-b706-160c8edcc604 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:29.265441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c48a47-357d-43ca-b706-160c8edcc604 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:29.271648 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897ce65-51a5-4a7b-b29a-02d46ea0a9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:29.272380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897ce65-51a5-4a7b-b29a-02d46ea0a9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:29.272768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897ce65-51a5-4a7b-b29a-02d46ea0a9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:29.273132 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897ce65-51a5-4a7b-b29a-02d46ea0a9b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:29.273866 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897ce65-51a5-4a7b-b29a-02d46ea0a9b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:29.275846 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897ce65-51a5-4a7b-b29a-02d46ea0a9b9 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:29.285850 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c464c-613b-446a-83ac-3dc0233762c5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:29.289071 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-179c464c-613b-446a-83ac-3dc0233762c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:29.294107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 937/1871] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:58:29.298404 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897ce65-51a5-4a7b-b29a-02d46ea0a9b9 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:29.313466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c464c-613b-446a-83ac-3dc0233762c5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:29.316656 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897ce65-51a5-4a7b-b29a-02d46ea0a9b9 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:29.325114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2eaa1c-0c98-4b3f-9032-a8ee2daff5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:29.326679 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90195fd-c911-416c-bd3f-743946cbf93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:29.327353 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90195fd-c911-416c-bd3f-743946cbf93c admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:29.327664 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2eaa1c-0c98-4b3f-9032-a8ee2daff5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:29.327950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2eaa1c-0c98-4b3f-9032-a8ee2daff5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:29.328220 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2eaa1c-0c98-4b3f-9032-a8ee2daff5d7 admin admin] PATH_INFO: `/v3/projects/bdc3c35ac74e463d9066acca75cce54d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:29.329248 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90195fd-c911-416c-bd3f-743946cbf93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:29.329520 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90195fd-c911-416c-bd3f-743946cbf93c admin admin] PATH_INFO: `/v3/projects/9d1c091f59ad4333b42fd6f07cfae758/users/ea4e885306d3436cbb15b0d0d6ff77e6/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:29.330949 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2eaa1c-0c98-4b3f-9032-a8ee2daff5d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdc3c35ac74e463d9066acca75cce54d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:29.333275 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2eaa1c-0c98-4b3f-9032-a8ee2daff5d7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:29.383009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90195fd-c911-416c-bd3f-743946cbf93c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1c091f59ad4333b42fd6f07cfae758, user_id=ea4e885306d3436cbb15b0d0d6ff77e6, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:29.386178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90195fd-c911-416c-bd3f-743946cbf93c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:29.412929 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:29.418645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 938/1872] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:29 2022] PUT /identity/v3/projects/9d1c091f59ad4333b42fd6f07cfae758/users/ea4e885306d3436cbb15b0d0d6ff77e6/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:29.419341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90195fd-c911-416c-bd3f-743946cbf93c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:29.422218 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d90195fd-c911-416c-bd3f-743946cbf93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:29.430209 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-aa2eaa1c-0c98-4b3f-9032-a8ee2daff5d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdc3c35ac74e463d9066acca75cce54d', 'request_id': 'req-aa2eaa1c-0c98-4b3f-9032-a8ee2daff5d7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:29.442725 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-aa2eaa1c-0c98-4b3f-9032-a8ee2daff5d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdc3c35ac74e463d9066acca75cce54d', 'request_id': 'req-aa2eaa1c-0c98-4b3f-9032-a8ee2daff5d7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:29.450259 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-aa2eaa1c-0c98-4b3f-9032-a8ee2daff5d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdc3c35ac74e463d9066acca75cce54d', 'request_id': 'req-aa2eaa1c-0c98-4b3f-9032-a8ee2daff5d7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:29.470813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-aa2eaa1c-0c98-4b3f-9032-a8ee2daff5d7 admin admin] The token cache is being invalidate because project bdc3c35ac74e463d9066acca75cce54d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:29.470813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-aa2eaa1c-0c98-4b3f-9032-a8ee2daff5d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:29.471539 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-aa2eaa1c-0c98-4b3f-9032-a8ee2daff5d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:29.473618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 935/1873] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:29 2022] DELETE /identity/v3/projects/bdc3c35ac74e463d9066acca75cce54d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:29.476741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2eaa1c-0c98-4b3f-9032-a8ee2daff5d7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:29.477979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-aa2eaa1c-0c98-4b3f-9032-a8ee2daff5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:29.507491 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:29.533798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90195fd-c911-416c-bd3f-743946cbf93c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:29.577637 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2eaa1c-0c98-4b3f-9032-a8ee2daff5d7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:29.583697 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14ac66-a476-45fe-ad03-f3213fab0da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:29.584325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14ac66-a476-45fe-ad03-f3213fab0da1 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:29.584614 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14ac66-a476-45fe-ad03-f3213fab0da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:29.584878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14ac66-a476-45fe-ad03-f3213fab0da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:29.585751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14ac66-a476-45fe-ad03-f3213fab0da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:29.587446 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14ac66-a476-45fe-ad03-f3213fab0da1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:29.606613 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 936/1874] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:29.606613 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14ac66-a476-45fe-ad03-f3213fab0da1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:29.607771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ae14ac66-a476-45fe-ad03-f3213fab0da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:29.624815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14ac66-a476-45fe-ad03-f3213fab0da1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:29.631710 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51602a5-5970-440c-9b29-30113ac9e79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:29.632367 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51602a5-5970-440c-9b29-30113ac9e79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:29.632643 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51602a5-5970-440c-9b29-30113ac9e79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:29.634571 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51602a5-5970-440c-9b29-30113ac9e79e admin admin] PATH_INFO: `/v3/users/63eb3ce3999a41ad85512fe5f1bc4566` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:29.636053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51602a5-5970-440c-9b29-30113ac9e79e admin admin] RBAC: Authorizing `identity:delete_user(user_id=63eb3ce3999a41ad85512fe5f1bc4566)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:29.642658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51602a5-5970-440c-9b29-30113ac9e79e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:29.671998 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb3840-39f5-4cc2-bf23-9fd86f31de0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:29.673901 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb3840-39f5-4cc2-bf23-9fd86f31de0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:29.673901 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb3840-39f5-4cc2-bf23-9fd86f31de0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:29.673901 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb3840-39f5-4cc2-bf23-9fd86f31de0d admin admin] PATH_INFO: `/v3/projects/1c6f274ca4db4698bfe7c24e88c93c3f` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:29.676899 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb3840-39f5-4cc2-bf23-9fd86f31de0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c6f274ca4db4698bfe7c24e88c93c3f)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:29.678855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb3840-39f5-4cc2-bf23-9fd86f31de0d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:29.772452 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d51602a5-5970-440c-9b29-30113ac9e79e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63eb3ce3999a41ad85512fe5f1bc4566'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:29.779774 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-23bb3840-39f5-4cc2-bf23-9fd86f31de0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c6f274ca4db4698bfe7c24e88c93c3f', 'request_id': 'req-23bb3840-39f5-4cc2-bf23-9fd86f31de0d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:29.791852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-23bb3840-39f5-4cc2-bf23-9fd86f31de0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c6f274ca4db4698bfe7c24e88c93c3f', 'request_id': 'req-23bb3840-39f5-4cc2-bf23-9fd86f31de0d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:29.798639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d51602a5-5970-440c-9b29-30113ac9e79e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63eb3ce3999a41ad85512fe5f1bc4566'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:29.801948 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-23bb3840-39f5-4cc2-bf23-9fd86f31de0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c6f274ca4db4698bfe7c24e88c93c3f', 'request_id': 'req-23bb3840-39f5-4cc2-bf23-9fd86f31de0d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:29.828556 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d51602a5-5970-440c-9b29-30113ac9e79e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63eb3ce3999a41ad85512fe5f1bc4566'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:29.830581 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-23bb3840-39f5-4cc2-bf23-9fd86f31de0d admin admin] The token cache is being invalidate because project 1c6f274ca4db4698bfe7c24e88c93c3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:29.830925 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-23bb3840-39f5-4cc2-bf23-9fd86f31de0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:29.831591 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-23bb3840-39f5-4cc2-bf23-9fd86f31de0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:29.833186 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 939/1875] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:29 2022] DELETE /identity/v3/projects/1c6f274ca4db4698bfe7c24e88c93c3f => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:29.836403 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb3840-39f5-4cc2-bf23-9fd86f31de0d admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:29.836403 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-23bb3840-39f5-4cc2-bf23-9fd86f31de0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:29.848902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d51602a5-5970-440c-9b29-30113ac9e79e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63eb3ce3999a41ad85512fe5f1bc4566'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:29.850133 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d51602a5-5970-440c-9b29-30113ac9e79e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63eb3ce3999a41ad85512fe5f1bc4566'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:29.858362 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 937/1876] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:29 2022] DELETE /identity/v3/users/63eb3ce3999a41ad85512fe5f1bc4566 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:29.859505 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51602a5-5970-440c-9b29-30113ac9e79e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:29.861063 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d51602a5-5970-440c-9b29-30113ac9e79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:29.904538 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb3840-39f5-4cc2-bf23-9fd86f31de0d admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:29.928664 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:29.958524 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:29.962897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51602a5-5970-440c-9b29-30113ac9e79e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:29.968826 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f3a10-93f2-4251-9043-2adfc3c2e312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:29.969873 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f3a10-93f2-4251-9043-2adfc3c2e312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:29.970327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f3a10-93f2-4251-9043-2adfc3c2e312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:29.970663 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f3a10-93f2-4251-9043-2adfc3c2e312 admin admin] PATH_INFO: `/v3/users/44a0a0d706114181b3957d173d6b5ec4` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:29.972105 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f3a10-93f2-4251-9043-2adfc3c2e312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44a0a0d706114181b3957d173d6b5ec4)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:29.974728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f3a10-93f2-4251-9043-2adfc3c2e312 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:29.986330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1237cb1-4bd3-4bf9-a022-b6b333f066c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:29.993053 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1237cb1-4bd3-4bf9-a022-b6b333f066c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:29.993340 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1237cb1-4bd3-4bf9-a022-b6b333f066c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:29.993699 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1237cb1-4bd3-4bf9-a022-b6b333f066c6 admin admin] PATH_INFO: `/v3/projects/9d1c091f59ad4333b42fd6f07cfae758/users/ea4e885306d3436cbb15b0d0d6ff77e6/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:29.995987 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1237cb1-4bd3-4bf9-a022-b6b333f066c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1c091f59ad4333b42fd6f07cfae758, user_id=ea4e885306d3436cbb15b0d0d6ff77e6, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:29.998851 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1237cb1-4bd3-4bf9-a022-b6b333f066c6 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:30.011434 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 940/1877] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:29 2022] PUT /identity/v3/projects/9d1c091f59ad4333b42fd6f07cfae758/users/ea4e885306d3436cbb15b0d0d6ff77e6/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:30.023644 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60520116-c47a-4184-bf3a-1200b2f32103 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:30.023930 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60520116-c47a-4184-bf3a-1200b2f32103 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:30.024207 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60520116-c47a-4184-bf3a-1200b2f32103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:30.037861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4e2f3a10-93f2-4251-9043-2adfc3c2e312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44a0a0d706114181b3957d173d6b5ec4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:30.045128 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4e2f3a10-93f2-4251-9043-2adfc3c2e312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44a0a0d706114181b3957d173d6b5ec4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:30.055401 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4e2f3a10-93f2-4251-9043-2adfc3c2e312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44a0a0d706114181b3957d173d6b5ec4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:30.056707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-60520116-c47a-4184-bf3a-1200b2f32103 None None] MFA Rules not processed for user `ea4e885306d3436cbb15b0d0d6ff77e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:30.057975 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-60520116-c47a-4184-bf3a-1200b2f32103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:30.080068 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4e2f3a10-93f2-4251-9043-2adfc3c2e312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44a0a0d706114181b3957d173d6b5ec4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:30.081462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4e2f3a10-93f2-4251-9043-2adfc3c2e312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44a0a0d706114181b3957d173d6b5ec4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:30.093201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 938/1878] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:29 2022] DELETE /identity/v3/users/44a0a0d706114181b3957d173d6b5ec4 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:30.216396 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 941/1879] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:30.225108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f3a10-93f2-4251-9043-2adfc3c2e312 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:30.226518 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4e2f3a10-93f2-4251-9043-2adfc3c2e312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:30.336441 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f3a10-93f2-4251-9043-2adfc3c2e312 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:30.341868 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb61ef-71c6-4d0c-b149-bfe9e5978478 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:30.342321 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb61ef-71c6-4d0c-b149-bfe9e5978478 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:30.342628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb61ef-71c6-4d0c-b149-bfe9e5978478 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:30.342933 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb61ef-71c6-4d0c-b149-bfe9e5978478 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:30.442460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb61ef-71c6-4d0c-b149-bfe9e5978478 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:30.443169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb61ef-71c6-4d0c-b149-bfe9e5978478 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:30.463543 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 939/1880] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:30.516596 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60520116-c47a-4184-bf3a-1200b2f32103 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:30.518068 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-60520116-c47a-4184-bf3a-1200b2f32103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:30.702100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60520116-c47a-4184-bf3a-1200b2f32103 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:30.738562 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb61ef-71c6-4d0c-b149-bfe9e5978478 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:30.740121 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-02cb61ef-71c6-4d0c-b149-bfe9e5978478 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:30.755942 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:30.852730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acf23f-2b25-4935-bdd7-819551b1d68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:30.853524 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acf23f-2b25-4935-bdd7-819551b1d68e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:30.853722 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acf23f-2b25-4935-bdd7-819551b1d68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:30.854114 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acf23f-2b25-4935-bdd7-819551b1d68e admin admin] PATH_INFO: `/v3/projects/5f3a6a0107094b429ba541cd5c738eff` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:30.855403 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acf23f-2b25-4935-bdd7-819551b1d68e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f3a6a0107094b429ba541cd5c738eff)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:30.858856 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acf23f-2b25-4935-bdd7-819551b1d68e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:30.871051 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:30.912397 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb61ef-71c6-4d0c-b149-bfe9e5978478 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:30.936514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564f30d-032b-4b98-b45b-bb1ae4a63bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:30.937456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564f30d-032b-4b98-b45b-bb1ae4a63bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:30.938504 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564f30d-032b-4b98-b45b-bb1ae4a63bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:30.938961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564f30d-032b-4b98-b45b-bb1ae4a63bec admin admin] PATH_INFO: `/v3/projects/f1e3a5d887664b1bb90b95a1dda1db92` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:30.941489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564f30d-032b-4b98-b45b-bb1ae4a63bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1e3a5d887664b1bb90b95a1dda1db92)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:30.944002 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-22acf23f-2b25-4935-bdd7-819551b1d68e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f3a6a0107094b429ba541cd5c738eff', 'request_id': 'req-22acf23f-2b25-4935-bdd7-819551b1d68e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:30.945218 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564f30d-032b-4b98-b45b-bb1ae4a63bec admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:30.953754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-22acf23f-2b25-4935-bdd7-819551b1d68e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f3a6a0107094b429ba541cd5c738eff', 'request_id': 'req-22acf23f-2b25-4935-bdd7-819551b1d68e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:30.962612 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-22acf23f-2b25-4935-bdd7-819551b1d68e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f3a6a0107094b429ba541cd5c738eff', 'request_id': 'req-22acf23f-2b25-4935-bdd7-819551b1d68e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:31.014476 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-22acf23f-2b25-4935-bdd7-819551b1d68e admin admin] The token cache is being invalidate because project 5f3a6a0107094b429ba541cd5c738eff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:31.014771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-22acf23f-2b25-4935-bdd7-819551b1d68e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:31.015809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-22acf23f-2b25-4935-bdd7-819551b1d68e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:31.017658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 942/1881] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:30 2022] DELETE /identity/v3/projects/5f3a6a0107094b429ba541cd5c738eff => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:31.022345 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1f313-6d90-424d-be08-d2786fbc8768 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:31.022597 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1f313-6d90-424d-be08-d2786fbc8768 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:31.022868 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1f313-6d90-424d-be08-d2786fbc8768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:31.057696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2564f30d-032b-4b98-b45b-bb1ae4a63bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1e3a5d887664b1bb90b95a1dda1db92', 'request_id': 'req-2564f30d-032b-4b98-b45b-bb1ae4a63bec'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:31.070905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2564f30d-032b-4b98-b45b-bb1ae4a63bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1e3a5d887664b1bb90b95a1dda1db92', 'request_id': 'req-2564f30d-032b-4b98-b45b-bb1ae4a63bec'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:31.081618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2564f30d-032b-4b98-b45b-bb1ae4a63bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1e3a5d887664b1bb90b95a1dda1db92', 'request_id': 'req-2564f30d-032b-4b98-b45b-bb1ae4a63bec'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:31.081710 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-9ad1f313-6d90-424d-be08-d2786fbc8768 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:31.083017 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9ad1f313-6d90-424d-be08-d2786fbc8768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:31.123077 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2564f30d-032b-4b98-b45b-bb1ae4a63bec admin admin] The token cache is being invalidate because project f1e3a5d887664b1bb90b95a1dda1db92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:31.123077 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2564f30d-032b-4b98-b45b-bb1ae4a63bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:31.123727 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2564f30d-032b-4b98-b45b-bb1ae4a63bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:31.127343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 940/1882] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:30 2022] DELETE /identity/v3/projects/f1e3a5d887664b1bb90b95a1dda1db92 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:31.132436 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b208add-d379-464d-bdad-ac34e45ceaf0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:31.132715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b208add-d379-464d-bdad-ac34e45ceaf0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:31.143283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b208add-d379-464d-bdad-ac34e45ceaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:31.191964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2b208add-d379-464d-bdad-ac34e45ceaf0 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:31.193205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2b208add-d379-464d-bdad-ac34e45ceaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:31.199935 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 943/1883] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:31.209398 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 941/1884] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:31.211287 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84624de5-401b-443f-abae-b1faba9be99b None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:31.212166 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84624de5-401b-443f-abae-b1faba9be99b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:31.213217 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84624de5-401b-443f-abae-b1faba9be99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:31.217880 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50af9b-6f33-46c2-a8ab-eaf97f42bc6c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:31.218187 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50af9b-6f33-46c2-a8ab-eaf97f42bc6c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:31.218495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50af9b-6f33-46c2-a8ab-eaf97f42bc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:31.263921 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4b50af9b-6f33-46c2-a8ab-eaf97f42bc6c None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:31.266013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4b50af9b-6f33-46c2-a8ab-eaf97f42bc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:31.278149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 942/1885] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:31.279103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50af9b-6f33-46c2-a8ab-eaf97f42bc6c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:31.282890 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4b50af9b-6f33-46c2-a8ab-eaf97f42bc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:31.283891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-84624de5-401b-443f-abae-b1faba9be99b None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:31.285531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-84624de5-401b-443f-abae-b1faba9be99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:31.299566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50af9b-6f33-46c2-a8ab-eaf97f42bc6c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:31.299751 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 944/1886] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:31.300681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84624de5-401b-443f-abae-b1faba9be99b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:31.311380 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79025f-244f-4b4c-bb39-fc166b673bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:31.312041 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79025f-244f-4b4c-bb39-fc166b673bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:31.312181 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84624de5-401b-443f-abae-b1faba9be99b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:31.312317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79025f-244f-4b4c-bb39-fc166b673bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:31.314284 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79025f-244f-4b4c-bb39-fc166b673bc3 admin admin] PATH_INFO: `/v3/users/997559b856a441beadd196e79b58c225` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:31.318854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af0111-d66a-42d2-a7a8-ac1962c0b882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:31.319016 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79025f-244f-4b4c-bb39-fc166b673bc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=997559b856a441beadd196e79b58c225)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:31.319521 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af0111-d66a-42d2-a7a8-ac1962c0b882 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:31.319805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af0111-d66a-42d2-a7a8-ac1962c0b882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:31.320082 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af0111-d66a-42d2-a7a8-ac1962c0b882 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:31.320735 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af0111-d66a-42d2-a7a8-ac1962c0b882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:31.321092 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af0111-d66a-42d2-a7a8-ac1962c0b882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:31.322446 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79025f-244f-4b4c-bb39-fc166b673bc3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:31.322777 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af0111-d66a-42d2-a7a8-ac1962c0b882 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:31.346585 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 945/1887] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:31.348142 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af0111-d66a-42d2-a7a8-ac1962c0b882 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:31.368843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af0111-d66a-42d2-a7a8-ac1962c0b882 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:31.377348 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03219f-5026-48c2-81e1-cfd83c91e10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:31.378250 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03219f-5026-48c2-81e1-cfd83c91e10c admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:31.378563 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03219f-5026-48c2-81e1-cfd83c91e10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:31.378815 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03219f-5026-48c2-81e1-cfd83c91e10c admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:31.379556 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03219f-5026-48c2-81e1-cfd83c91e10c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:31.379868 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03219f-5026-48c2-81e1-cfd83c91e10c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:31.381736 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03219f-5026-48c2-81e1-cfd83c91e10c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:31.400839 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 946/1888] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:31.400839 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03219f-5026-48c2-81e1-cfd83c91e10c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:31.409287 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ba79025f-244f-4b4c-bb39-fc166b673bc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '997559b856a441beadd196e79b58c225'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:31.409843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03219f-5026-48c2-81e1-cfd83c91e10c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:31.414644 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05741c3-85ce-483b-b097-491e1b2c19fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:31.415263 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05741c3-85ce-483b-b097-491e1b2c19fb admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:31.415573 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05741c3-85ce-483b-b097-491e1b2c19fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:31.416019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05741c3-85ce-483b-b097-491e1b2c19fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:31.416643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05741c3-85ce-483b-b097-491e1b2c19fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:31.418567 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05741c3-85ce-483b-b097-491e1b2c19fb admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:31.419763 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ba79025f-244f-4b4c-bb39-fc166b673bc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '997559b856a441beadd196e79b58c225'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:31.434608 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ba79025f-244f-4b4c-bb39-fc166b673bc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '997559b856a441beadd196e79b58c225'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:31.457617 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:31.459777 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 947/1889] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:31 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:31.459945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ba79025f-244f-4b4c-bb39-fc166b673bc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '997559b856a441beadd196e79b58c225'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:31.461584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ba79025f-244f-4b4c-bb39-fc166b673bc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '997559b856a441beadd196e79b58c225'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:31.464420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05741c3-85ce-483b-b097-491e1b2c19fb admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:31.466306 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e05741c3-85ce-483b-b097-491e1b2c19fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:31.472840 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 943/1890] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:31 2022] DELETE /identity/v3/users/997559b856a441beadd196e79b58c225 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:31.474184 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79025f-244f-4b4c-bb39-fc166b673bc3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:31.476580 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ba79025f-244f-4b4c-bb39-fc166b673bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:31.532384 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:31.556600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05741c3-85ce-483b-b097-491e1b2c19fb admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:31.563126 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175e7b4-0213-4c06-a875-878fdfe86b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:31.564121 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175e7b4-0213-4c06-a875-878fdfe86b06 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:31.564464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175e7b4-0213-4c06-a875-878fdfe86b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:31.564916 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175e7b4-0213-4c06-a875-878fdfe86b06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:31.566000 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175e7b4-0213-4c06-a875-878fdfe86b06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:31.567592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175e7b4-0213-4c06-a875-878fdfe86b06 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:31.571579 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79025f-244f-4b4c-bb39-fc166b673bc3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:31.592472 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8f62d-ced5-4f30-b8d9-684b13754024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:31.594479 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8f62d-ced5-4f30-b8d9-684b13754024 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:31.594765 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8f62d-ced5-4f30-b8d9-684b13754024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:31.595092 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8f62d-ced5-4f30-b8d9-684b13754024 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:31.596100 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8f62d-ced5-4f30-b8d9-684b13754024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:31.598124 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8f62d-ced5-4f30-b8d9-684b13754024 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:31.621281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 948/1891] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:31 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:31.621281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a65b1-a71a-4d53-a679-2c9a0f7d5f2a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:31.621281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a65b1-a71a-4d53-a679-2c9a0f7d5f2a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:31.621281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a65b1-a71a-4d53-a679-2c9a0f7d5f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:31.640777 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 944/1892] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:31 2022] POST /identity/v3/users => generated 283 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:31.642052 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8f62d-ced5-4f30-b8d9-684b13754024 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:31.654464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8f62d-ced5-4f30-b8d9-684b13754024 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:31.684413 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-745a65b1-a71a-4d53-a679-2c9a0f7d5f2a None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:31.685654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-745a65b1-a71a-4d53-a679-2c9a0f7d5f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:31.740558 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c640f4e-8508-4929-8c2e-6417cb548e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:31.741321 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c640f4e-8508-4929-8c2e-6417cb548e08 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:31.742693 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c640f4e-8508-4929-8c2e-6417cb548e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:31.742693 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c640f4e-8508-4929-8c2e-6417cb548e08 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:31.743291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c640f4e-8508-4929-8c2e-6417cb548e08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:31.745973 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c640f4e-8508-4929-8c2e-6417cb548e08 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:31.780824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 945/1893] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:31 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:31.782144 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c640f4e-8508-4929-8c2e-6417cb548e08 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:31.784315 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 949/1894] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:31.788272 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a65b1-a71a-4d53-a679-2c9a0f7d5f2a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:31.794932 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c640f4e-8508-4929-8c2e-6417cb548e08 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:31.798791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a65b1-a71a-4d53-a679-2c9a0f7d5f2a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:31.798969 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfaae03-5ed0-42c6-98ea-ff86509241f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:31.799671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaae03-5ed0-42c6-98ea-ff86509241f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:31.800022 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaae03-5ed0-42c6-98ea-ff86509241f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:31.800453 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaae03-5ed0-42c6-98ea-ff86509241f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:31.801255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfaae03-5ed0-42c6-98ea-ff86509241f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:31.802989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfaae03-5ed0-42c6-98ea-ff86509241f0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:31.804802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8ae35-4377-4aa3-a725-0d863d68c089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:31.805435 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8ae35-4377-4aa3-a725-0d863d68c089 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:31.805718 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8ae35-4377-4aa3-a725-0d863d68c089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:31.805990 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8ae35-4377-4aa3-a725-0d863d68c089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:31.806638 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8ae35-4377-4aa3-a725-0d863d68c089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:31.808787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8ae35-4377-4aa3-a725-0d863d68c089 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:31.823553 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 946/1895] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:31.823553 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfaae03-5ed0-42c6-98ea-ff86509241f0 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:31.823553 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9dfaae03-5ed0-42c6-98ea-ff86509241f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:31.826776 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 950/1896] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:31.826894 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8ae35-4377-4aa3-a725-0d863d68c089 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:31.838929 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8ae35-4377-4aa3-a725-0d863d68c089 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:31.844356 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbddf60-a15c-4e98-b09d-27501e407973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:31.844988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbddf60-a15c-4e98-b09d-27501e407973 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:31.845276 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbddf60-a15c-4e98-b09d-27501e407973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:31.845552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbddf60-a15c-4e98-b09d-27501e407973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:31.846198 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbddf60-a15c-4e98-b09d-27501e407973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:31.847852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbddf60-a15c-4e98-b09d-27501e407973 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:31.858325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 951/1897] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:31.859163 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbddf60-a15c-4e98-b09d-27501e407973 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:31.869601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbddf60-a15c-4e98-b09d-27501e407973 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:31.875046 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40569a8c-12d0-4ec8-91c7-9c37ed940ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:31.875522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40569a8c-12d0-4ec8-91c7-9c37ed940ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:31.875806 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40569a8c-12d0-4ec8-91c7-9c37ed940ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:31.876200 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40569a8c-12d0-4ec8-91c7-9c37ed940ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:31.876881 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40569a8c-12d0-4ec8-91c7-9c37ed940ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:31.878598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40569a8c-12d0-4ec8-91c7-9c37ed940ef4 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:31.889913 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 952/1898] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:31.893896 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40569a8c-12d0-4ec8-91c7-9c37ed940ef4 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:31.898230 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfaae03-5ed0-42c6-98ea-ff86509241f0 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:31.904387 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af8fff-f90d-4825-9771-c2a7e454f9b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:31.906797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40569a8c-12d0-4ec8-91c7-9c37ed940ef4 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:31.911530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a78a9-cfdb-41aa-b480-c721a274a4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:31.912227 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a78a9-cfdb-41aa-b480-c721a274a4bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:31.912510 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a78a9-cfdb-41aa-b480-c721a274a4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:31.912785 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a78a9-cfdb-41aa-b480-c721a274a4bf admin admin] PATH_INFO: `/v3/projects/33dd023d36ea4c76aa477400b6bbca33/users/0fff2861027c4235ab8d1bf209f8d1c6/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:31.917112 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af8fff-f90d-4825-9771-c2a7e454f9b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:31.917394 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af8fff-f90d-4825-9771-c2a7e454f9b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:31.917735 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af8fff-f90d-4825-9771-c2a7e454f9b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:31.929719 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a78a9-cfdb-41aa-b480-c721a274a4bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=33dd023d36ea4c76aa477400b6bbca33, user_id=0fff2861027c4235ab8d1bf209f8d1c6, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:31.930831 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af8fff-f90d-4825-9771-c2a7e454f9b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:31.932308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af8fff-f90d-4825-9771-c2a7e454f9b6 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:31.932781 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a78a9-cfdb-41aa-b480-c721a274a4bf admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:31.944090 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 947/1899] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:31.949437 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 953/1900] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:31 2022] PUT /identity/v3/projects/33dd023d36ea4c76aa477400b6bbca33/users/0fff2861027c4235ab8d1bf209f8d1c6/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:31.950263 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a78a9-cfdb-41aa-b480-c721a274a4bf admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:31.964055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13720a-9b43-4193-afa4-3647aa05ea04 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:31.964470 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13720a-9b43-4193-afa4-3647aa05ea04 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:31.965125 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13720a-9b43-4193-afa4-3647aa05ea04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:31.981904 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:32.004100 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ba13720a-9b43-4193-afa4-3647aa05ea04 None None] MFA Rules not processed for user `0fff2861027c4235ab8d1bf209f8d1c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:32.005390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ba13720a-9b43-4193-afa4-3647aa05ea04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:32.064789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a78a9-cfdb-41aa-b480-c721a274a4bf admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:32.074358 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601cbb7-73b0-4472-b7b5-d5cae190c05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:32.075727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601cbb7-73b0-4472-b7b5-d5cae190c05f admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:32.076598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601cbb7-73b0-4472-b7b5-d5cae190c05f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:32.077071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601cbb7-73b0-4472-b7b5-d5cae190c05f admin admin] PATH_INFO: `/v3/projects/734c0ea16a844803a26e52563380b2e2/users/b51ec805926c45f09a274f226be6c36a/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:32.109534 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601cbb7-73b0-4472-b7b5-d5cae190c05f admin admin] RBAC: Authorizing `identity:create_grant(project_id=734c0ea16a844803a26e52563380b2e2, user_id=b51ec805926c45f09a274f226be6c36a, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:32.114225 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601cbb7-73b0-4472-b7b5-d5cae190c05f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:32.132463 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:32.149859 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 948/1901] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:32.151780 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 954/1902] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:31 2022] PUT /identity/v3/projects/734c0ea16a844803a26e52563380b2e2/users/b51ec805926c45f09a274f226be6c36a/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:32.155969 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601cbb7-73b0-4472-b7b5-d5cae190c05f admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:32.166931 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42aa596-1fd8-423c-a1d1-fe7d8ab6f21f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:32.167328 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42aa596-1fd8-423c-a1d1-fe7d8ab6f21f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:32.167671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42aa596-1fd8-423c-a1d1-fe7d8ab6f21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:32.200628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c42aa596-1fd8-423c-a1d1-fe7d8ab6f21f None None] MFA Rules not processed for user `b51ec805926c45f09a274f226be6c36a`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:32.202269 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c42aa596-1fd8-423c-a1d1-fe7d8ab6f21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:32.226383 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601cbb7-73b0-4472-b7b5-d5cae190c05f admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:32.231503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5c0fa-7836-4baf-8651-31288d49908a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:32.232736 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5c0fa-7836-4baf-8651-31288d49908a admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:32.233020 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5c0fa-7836-4baf-8651-31288d49908a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:32.233288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5c0fa-7836-4baf-8651-31288d49908a admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:32.233940 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5c0fa-7836-4baf-8651-31288d49908a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:32.236755 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5c0fa-7836-4baf-8651-31288d49908a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:32.268120 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 955/1903] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:32 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:58:32.272461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5c0fa-7836-4baf-8651-31288d49908a admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:32.301540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 949/1904] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:32.302534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42aa596-1fd8-423c-a1d1-fe7d8ab6f21f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:32.304494 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c42aa596-1fd8-423c-a1d1-fe7d8ab6f21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:32.327074 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42aa596-1fd8-423c-a1d1-fe7d8ab6f21f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:32.374234 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5c0fa-7836-4baf-8651-31288d49908a admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:32.379956 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa6347-72c1-4365-9693-ae997942afd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:32.380579 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa6347-72c1-4365-9693-ae997942afd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:32.380847 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa6347-72c1-4365-9693-ae997942afd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:32.381115 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa6347-72c1-4365-9693-ae997942afd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:32.381750 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa6347-72c1-4365-9693-ae997942afd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:32.383743 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa6347-72c1-4365-9693-ae997942afd8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:32.408916 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 956/1905] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:32 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:32.412409 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa6347-72c1-4365-9693-ae997942afd8 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:32.414210 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3dfa6347-72c1-4365-9693-ae997942afd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:32.423750 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e6141-af26-40c0-a38b-66f56978672a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:32.424410 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e6141-af26-40c0-a38b-66f56978672a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:32.424690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e6141-af26-40c0-a38b-66f56978672a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:32.425352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e6141-af26-40c0-a38b-66f56978672a admin admin] PATH_INFO: `/v3/projects/46996ac229954463b79ea4befe3039db` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:32.426202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e6141-af26-40c0-a38b-66f56978672a admin admin] RBAC: Authorizing `identity:delete_project(project_id=46996ac229954463b79ea4befe3039db)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:32.428351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e6141-af26-40c0-a38b-66f56978672a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:32.470217 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:32.481449 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa6347-72c1-4365-9693-ae997942afd8 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:32.486047 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-592e6141-af26-40c0-a38b-66f56978672a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46996ac229954463b79ea4befe3039db', 'request_id': 'req-592e6141-af26-40c0-a38b-66f56978672a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:32.495703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-592e6141-af26-40c0-a38b-66f56978672a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46996ac229954463b79ea4befe3039db', 'request_id': 'req-592e6141-af26-40c0-a38b-66f56978672a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:32.501727 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-592e6141-af26-40c0-a38b-66f56978672a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46996ac229954463b79ea4befe3039db', 'request_id': 'req-592e6141-af26-40c0-a38b-66f56978672a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:32.508406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:32.514717 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-592e6141-af26-40c0-a38b-66f56978672a admin admin] The token cache is being invalidate because project 46996ac229954463b79ea4befe3039db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:32.515049 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-592e6141-af26-40c0-a38b-66f56978672a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:32.520448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-592e6141-af26-40c0-a38b-66f56978672a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:32.522136 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 950/1906] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:32 2022] DELETE /identity/v3/projects/46996ac229954463b79ea4befe3039db => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:32.525998 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e6141-af26-40c0-a38b-66f56978672a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:32.527494 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-592e6141-af26-40c0-a38b-66f56978672a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:32.554401 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794b291-fbdc-4de9-af67-9a94c1c8fe7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:32.556098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794b291-fbdc-4de9-af67-9a94c1c8fe7b service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:32.556576 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794b291-fbdc-4de9-af67-9a94c1c8fe7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:32.556867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794b291-fbdc-4de9-af67-9a94c1c8fe7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:32.561508 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1794b291-fbdc-4de9-af67-9a94c1c8fe7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:32.613504 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e6141-af26-40c0-a38b-66f56978672a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:32.620008 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4906b92-c340-42fa-a1a8-d1a235d4d8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:32.621205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4906b92-c340-42fa-a1a8-d1a235d4d8aa admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:32.621562 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4906b92-c340-42fa-a1a8-d1a235d4d8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:32.622024 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4906b92-c340-42fa-a1a8-d1a235d4d8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:32.623021 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4906b92-c340-42fa-a1a8-d1a235d4d8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:32.626050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4906b92-c340-42fa-a1a8-d1a235d4d8aa admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:32.638826 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 951/1907] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:32.639770 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4906b92-c340-42fa-a1a8-d1a235d4d8aa admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:32.641549 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d4906b92-c340-42fa-a1a8-d1a235d4d8aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:32.652872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794b291-fbdc-4de9-af67-9a94c1c8fe7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:32.654668 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4906b92-c340-42fa-a1a8-d1a235d4d8aa admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:32.658895 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794b291-fbdc-4de9-af67-9a94c1c8fe7b service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:32.661671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef64ba-a805-49f9-b1ef-9043865954bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:32.661835 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef64ba-a805-49f9-b1ef-9043865954bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:32.662116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef64ba-a805-49f9-b1ef-9043865954bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:32.662385 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef64ba-a805-49f9-b1ef-9043865954bb admin admin] PATH_INFO: `/v3/users/ea4e885306d3436cbb15b0d0d6ff77e6` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:32.664215 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef64ba-a805-49f9-b1ef-9043865954bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea4e885306d3436cbb15b0d0d6ff77e6)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:32.666181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef64ba-a805-49f9-b1ef-9043865954bb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:32.679075 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 957/1908] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:32.680056 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794b291-fbdc-4de9-af67-9a94c1c8fe7b service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:32.697248 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794b291-fbdc-4de9-af67-9a94c1c8fe7b service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:32.702799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be156a-5714-4b46-837f-f05d392bd9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:32.703696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be156a-5714-4b46-837f-f05d392bd9e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:32.704199 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be156a-5714-4b46-837f-f05d392bd9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:32.704911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be156a-5714-4b46-837f-f05d392bd9e3 admin admin] PATH_INFO: `/v3/projects/3b62d95081a44fe6a664e443c3ef2b9c/users/006d9d31bc4949178ed0c7be84d1d017/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:32.721399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be156a-5714-4b46-837f-f05d392bd9e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b62d95081a44fe6a664e443c3ef2b9c, user_id=006d9d31bc4949178ed0c7be84d1d017, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:32.724100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be156a-5714-4b46-837f-f05d392bd9e3 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:32.743073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 958/1909] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:32 2022] PUT /identity/v3/projects/3b62d95081a44fe6a664e443c3ef2b9c/users/006d9d31bc4949178ed0c7be84d1d017/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:32.745411 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be156a-5714-4b46-837f-f05d392bd9e3 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:32.747546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-17be156a-5714-4b46-837f-f05d392bd9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:32.758087 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f5ef64ba-a805-49f9-b1ef-9043865954bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea4e885306d3436cbb15b0d0d6ff77e6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:32.766323 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f5ef64ba-a805-49f9-b1ef-9043865954bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea4e885306d3436cbb15b0d0d6ff77e6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:32.776861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f5ef64ba-a805-49f9-b1ef-9043865954bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea4e885306d3436cbb15b0d0d6ff77e6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:32.791996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f5ef64ba-a805-49f9-b1ef-9043865954bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea4e885306d3436cbb15b0d0d6ff77e6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:32.792778 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f5ef64ba-a805-49f9-b1ef-9043865954bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea4e885306d3436cbb15b0d0d6ff77e6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:32.798897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 952/1910] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:32 2022] DELETE /identity/v3/users/ea4e885306d3436cbb15b0d0d6ff77e6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:32.799727 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef64ba-a805-49f9-b1ef-9043865954bb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:32.801156 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f5ef64ba-a805-49f9-b1ef-9043865954bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:32.824966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be156a-5714-4b46-837f-f05d392bd9e3 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:32.845571 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:32.892107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31999344-dc67-4c71-94bc-a0fc0a8803b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:32.892855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31999344-dc67-4c71-94bc-a0fc0a8803b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:32.893135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31999344-dc67-4c71-94bc-a0fc0a8803b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:32.893434 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31999344-dc67-4c71-94bc-a0fc0a8803b7 admin admin] PATH_INFO: `/v3/users/b51ec805926c45f09a274f226be6c36a` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:32.894730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31999344-dc67-4c71-94bc-a0fc0a8803b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b51ec805926c45f09a274f226be6c36a)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:32.896958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31999344-dc67-4c71-94bc-a0fc0a8803b7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:32.900043 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:32.918830 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef64ba-a805-49f9-b1ef-9043865954bb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:32.924884 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d776db-2d4c-429f-8b4a-6838eb6c536e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:32.925846 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d776db-2d4c-429f-8b4a-6838eb6c536e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:32.926134 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d776db-2d4c-429f-8b4a-6838eb6c536e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:32.926412 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d776db-2d4c-429f-8b4a-6838eb6c536e admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:32.929950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d776db-2d4c-429f-8b4a-6838eb6c536e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:32.931815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d776db-2d4c-429f-8b4a-6838eb6c536e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:32.944518 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 953/1911] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:32.948843 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d776db-2d4c-429f-8b4a-6838eb6c536e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:32.964138 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d776db-2d4c-429f-8b4a-6838eb6c536e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:32.970700 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253a14e-7ac6-4231-a2b6-39369db320ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:32.971733 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253a14e-7ac6-4231-a2b6-39369db320ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:32.972943 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253a14e-7ac6-4231-a2b6-39369db320ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:32.973487 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253a14e-7ac6-4231-a2b6-39369db320ab admin admin] PATH_INFO: `/v3/projects/3b62d95081a44fe6a664e443c3ef2b9c/users/006d9d31bc4949178ed0c7be84d1d017/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:32.976790 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253a14e-7ac6-4231-a2b6-39369db320ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b62d95081a44fe6a664e443c3ef2b9c, user_id=006d9d31bc4949178ed0c7be84d1d017, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:32.980263 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253a14e-7ac6-4231-a2b6-39369db320ab admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:33.005092 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-31999344-dc67-4c71-94bc-a0fc0a8803b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b51ec805926c45f09a274f226be6c36a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:33.013400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 954/1912] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:32 2022] PUT /identity/v3/projects/3b62d95081a44fe6a664e443c3ef2b9c/users/006d9d31bc4949178ed0c7be84d1d017/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:33.026075 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd70039-40c5-4aef-b5bb-dc7f2148b577 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:33.026412 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd70039-40c5-4aef-b5bb-dc7f2148b577 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:33.026687 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd70039-40c5-4aef-b5bb-dc7f2148b577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:33.027532 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-31999344-dc67-4c71-94bc-a0fc0a8803b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b51ec805926c45f09a274f226be6c36a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:33.038209 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-31999344-dc67-4c71-94bc-a0fc0a8803b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b51ec805926c45f09a274f226be6c36a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:33.040219 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-31999344-dc67-4c71-94bc-a0fc0a8803b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b51ec805926c45f09a274f226be6c36a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:33.069152 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-31999344-dc67-4c71-94bc-a0fc0a8803b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b51ec805926c45f09a274f226be6c36a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:33.076688 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 959/1913] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:32 2022] DELETE /identity/v3/users/b51ec805926c45f09a274f226be6c36a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:33.080882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4a23c-faab-4a62-b46f-e1cf36705425 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:33.081308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4a23c-faab-4a62-b46f-e1cf36705425 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:33.081685 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4a23c-faab-4a62-b46f-e1cf36705425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:33.105689 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cbd70039-40c5-4aef-b5bb-dc7f2148b577 None None] MFA Rules not processed for user `006d9d31bc4949178ed0c7be84d1d017`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:33.107281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cbd70039-40c5-4aef-b5bb-dc7f2148b577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:33.171934 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-ddb4a23c-faab-4a62-b46f-e1cf36705425 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:33.173229 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ddb4a23c-faab-4a62-b46f-e1cf36705425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:33.272499 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 955/1914] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:33.282779 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd70039-40c5-4aef-b5bb-dc7f2148b577 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:33.285712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cbd70039-40c5-4aef-b5bb-dc7f2148b577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:33.365300 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 960/1915] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:33.374358 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4a23c-faab-4a62-b46f-e1cf36705425 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:33.379756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ddb4a23c-faab-4a62-b46f-e1cf36705425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:33.419783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd70039-40c5-4aef-b5bb-dc7f2148b577 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:33.424891 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d8d57-4334-498e-bf13-930f987f9dc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:33.425783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d8d57-4334-498e-bf13-930f987f9dc2 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:33.426080 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d8d57-4334-498e-bf13-930f987f9dc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:33.426353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d8d57-4334-498e-bf13-930f987f9dc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:33.451602 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d8d57-4334-498e-bf13-930f987f9dc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:33.451602 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d8d57-4334-498e-bf13-930f987f9dc2 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:33.465016 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 956/1916] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:58:33.466365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d8d57-4334-498e-bf13-930f987f9dc2 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:33.468210 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d31d8d57-4334-498e-bf13-930f987f9dc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:33.500579 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d8d57-4334-498e-bf13-930f987f9dc2 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:33.511079 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0d03a-576f-4ed5-801a-9ee33ac7278c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:33.512147 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0d03a-576f-4ed5-801a-9ee33ac7278c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:33.512657 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0d03a-576f-4ed5-801a-9ee33ac7278c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:33.513417 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0d03a-576f-4ed5-801a-9ee33ac7278c admin admin] PATH_INFO: `/v3/projects/9d1c091f59ad4333b42fd6f07cfae758` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:33.515694 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0d03a-576f-4ed5-801a-9ee33ac7278c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d1c091f59ad4333b42fd6f07cfae758)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:33.518678 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0d03a-576f-4ed5-801a-9ee33ac7278c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:33.565461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4a23c-faab-4a62-b46f-e1cf36705425 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:33.587424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bf067-5ab2-4a10-bc6a-3804bfab7ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:33.587424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bf067-5ab2-4a10-bc6a-3804bfab7ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:33.587424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bf067-5ab2-4a10-bc6a-3804bfab7ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:33.587424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bf067-5ab2-4a10-bc6a-3804bfab7ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:33.588063 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:33.606380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bf067-5ab2-4a10-bc6a-3804bfab7ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:33.608692 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bf067-5ab2-4a10-bc6a-3804bfab7ef2 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:33.622483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-65a0d03a-576f-4ed5-801a-9ee33ac7278c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d1c091f59ad4333b42fd6f07cfae758', 'request_id': 'req-65a0d03a-576f-4ed5-801a-9ee33ac7278c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:33.624844 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 961/1917] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:58:33.626266 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bf067-5ab2-4a10-bc6a-3804bfab7ef2 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:33.636919 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bf067-5ab2-4a10-bc6a-3804bfab7ef2 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:33.637421 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-65a0d03a-576f-4ed5-801a-9ee33ac7278c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d1c091f59ad4333b42fd6f07cfae758', 'request_id': 'req-65a0d03a-576f-4ed5-801a-9ee33ac7278c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:33.646700 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-65a0d03a-576f-4ed5-801a-9ee33ac7278c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d1c091f59ad4333b42fd6f07cfae758', 'request_id': 'req-65a0d03a-576f-4ed5-801a-9ee33ac7278c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:33.666529 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-65a0d03a-576f-4ed5-801a-9ee33ac7278c admin admin] The token cache is being invalidate because project 9d1c091f59ad4333b42fd6f07cfae758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:33.666940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-65a0d03a-576f-4ed5-801a-9ee33ac7278c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:33.668837 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-65a0d03a-576f-4ed5-801a-9ee33ac7278c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:33.670164 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:33.671408 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 957/1918] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:33 2022] DELETE /identity/v3/projects/9d1c091f59ad4333b42fd6f07cfae758 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:33.681492 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02891882-b63e-44e1-baad-96e282ff0eb7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:33.683294 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02891882-b63e-44e1-baad-96e282ff0eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:33.683739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02891882-b63e-44e1-baad-96e282ff0eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:33.734232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d550800-b046-4339-bb01-5f2bf33493ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:33.736182 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d550800-b046-4339-bb01-5f2bf33493ec service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:33.738203 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d550800-b046-4339-bb01-5f2bf33493ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:33.738482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d550800-b046-4339-bb01-5f2bf33493ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:33.747158 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2d550800-b046-4339-bb01-5f2bf33493ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:33.749784 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-02891882-b63e-44e1-baad-96e282ff0eb7 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:33.751466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-02891882-b63e-44e1-baad-96e282ff0eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:33.856068 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 958/1919] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:33.857633 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc3002-747a-41fd-894d-476f1bbaa627 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:33.857930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc3002-747a-41fd-894d-476f1bbaa627 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:33.858227 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc3002-747a-41fd-894d-476f1bbaa627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:33.888215 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8bdc3002-747a-41fd-894d-476f1bbaa627 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:33.889493 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8bdc3002-747a-41fd-894d-476f1bbaa627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:33.920517 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d550800-b046-4339-bb01-5f2bf33493ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:33.920911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 959/1920] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:33.922553 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d550800-b046-4339-bb01-5f2bf33493ec service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:33.924861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc3002-747a-41fd-894d-476f1bbaa627 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:33.935283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc3002-747a-41fd-894d-476f1bbaa627 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:33.940898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f5822-ccff-4136-b676-21818275728b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:33.941530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f5822-ccff-4136-b676-21818275728b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:33.941810 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f5822-ccff-4136-b676-21818275728b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:33.942186 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f5822-ccff-4136-b676-21818275728b admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:33.942848 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f5822-ccff-4136-b676-21818275728b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:33.943150 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f5822-ccff-4136-b676-21818275728b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:33.944874 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f5822-ccff-4136-b676-21818275728b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:33.945928 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 962/1921] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:33.986622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d550800-b046-4339-bb01-5f2bf33493ec service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:33.994747 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 960/1922] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:34.008997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d550800-b046-4339-bb01-5f2bf33493ec service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:34.019504 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc5ffb-635b-4be6-ae67-7a1515507054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:34.020155 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc5ffb-635b-4be6-ae67-7a1515507054 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:34.021480 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc5ffb-635b-4be6-ae67-7a1515507054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:34.021480 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc5ffb-635b-4be6-ae67-7a1515507054 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:34.021980 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc5ffb-635b-4be6-ae67-7a1515507054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:34.024333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc5ffb-635b-4be6-ae67-7a1515507054 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:34.072215 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 963/1923] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:33 2022] POST /identity/v3/projects => generated 387 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:34.076579 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f5822-ccff-4136-b676-21818275728b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:34.088595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f5822-ccff-4136-b676-21818275728b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:34.138869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc5ffb-635b-4be6-ae67-7a1515507054 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:34.146925 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c8fc5ffb-635b-4be6-ae67-7a1515507054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:34.210949 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e60de-d2a9-4fa6-b3ec-64cfbfa7f88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:34.220478 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e60de-d2a9-4fa6-b3ec-64cfbfa7f88c admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:34.220849 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e60de-d2a9-4fa6-b3ec-64cfbfa7f88c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:34.221098 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e60de-d2a9-4fa6-b3ec-64cfbfa7f88c admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:34.221958 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e60de-d2a9-4fa6-b3ec-64cfbfa7f88c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:34.225815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e60de-d2a9-4fa6-b3ec-64cfbfa7f88c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:34.289766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 961/1924] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:34 2022] POST /identity/v3/users => generated 294 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:34.292674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e60de-d2a9-4fa6-b3ec-64cfbfa7f88c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:34.304420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc5ffb-635b-4be6-ae67-7a1515507054 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:34.309543 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e60de-d2a9-4fa6-b3ec-64cfbfa7f88c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:34.311221 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94136fb-7d80-46af-89d5-b2fadc4fb6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:34.312074 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94136fb-7d80-46af-89d5-b2fadc4fb6b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:34.312824 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94136fb-7d80-46af-89d5-b2fadc4fb6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:34.313384 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94136fb-7d80-46af-89d5-b2fadc4fb6b4 admin admin] PATH_INFO: `/v3/projects/734c0ea16a844803a26e52563380b2e2` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:34.314712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94136fb-7d80-46af-89d5-b2fadc4fb6b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=734c0ea16a844803a26e52563380b2e2)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:34.316852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94136fb-7d80-46af-89d5-b2fadc4fb6b4 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:34.318053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc603743-27e5-4ef3-bb67-28efad56a8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:34.321917 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc603743-27e5-4ef3-bb67-28efad56a8ad admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:34.322330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc603743-27e5-4ef3-bb67-28efad56a8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:34.323443 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc603743-27e5-4ef3-bb67-28efad56a8ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:34.325983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc603743-27e5-4ef3-bb67-28efad56a8ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:34.327729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc603743-27e5-4ef3-bb67-28efad56a8ad admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:34.359604 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 962/1925] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:58:34.360874 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc603743-27e5-4ef3-bb67-28efad56a8ad admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:34.397891 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc603743-27e5-4ef3-bb67-28efad56a8ad admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:34.404680 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1c5c3-008b-4f7f-ad4b-70500f837ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:34.405402 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1c5c3-008b-4f7f-ad4b-70500f837ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:34.405916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1c5c3-008b-4f7f-ad4b-70500f837ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:34.406253 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1c5c3-008b-4f7f-ad4b-70500f837ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:34.407319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1c5c3-008b-4f7f-ad4b-70500f837ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:34.409362 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1c5c3-008b-4f7f-ad4b-70500f837ce4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:34.421278 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 963/1926] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:34.428081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1c5c3-008b-4f7f-ad4b-70500f837ce4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:34.444254 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c94136fb-7d80-46af-89d5-b2fadc4fb6b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '734c0ea16a844803a26e52563380b2e2', 'request_id': 'req-c94136fb-7d80-46af-89d5-b2fadc4fb6b4'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:34.448625 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1c5c3-008b-4f7f-ad4b-70500f837ce4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:34.453678 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:34.453890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c94136fb-7d80-46af-89d5-b2fadc4fb6b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '734c0ea16a844803a26e52563380b2e2', 'request_id': 'req-c94136fb-7d80-46af-89d5-b2fadc4fb6b4'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:34.466092 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:34.475122 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c94136fb-7d80-46af-89d5-b2fadc4fb6b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '734c0ea16a844803a26e52563380b2e2', 'request_id': 'req-c94136fb-7d80-46af-89d5-b2fadc4fb6b4'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:34.527472 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c94136fb-7d80-46af-89d5-b2fadc4fb6b4 admin admin] The token cache is being invalidate because project 734c0ea16a844803a26e52563380b2e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:34.529049 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c94136fb-7d80-46af-89d5-b2fadc4fb6b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:34.530787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c94136fb-7d80-46af-89d5-b2fadc4fb6b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:34.544919 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 964/1927] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:34 2022] DELETE /identity/v3/projects/734c0ea16a844803a26e52563380b2e2 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:34.567155 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78834f24-d0c2-4e51-a542-5771222785c1 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:34.567653 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78834f24-d0c2-4e51-a542-5771222785c1 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:34.568193 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78834f24-d0c2-4e51-a542-5771222785c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:34.619735 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a2fa0-02b3-4dfa-8592-c4977a27cb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:34.621335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a2fa0-02b3-4dfa-8592-c4977a27cb74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:34.621619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a2fa0-02b3-4dfa-8592-c4977a27cb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:34.622017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a2fa0-02b3-4dfa-8592-c4977a27cb74 admin admin] PATH_INFO: `/v3/projects/a3b87ee802e44aa781e579917951c92b/users/7505796e852c4038b6a66cdebc27c631/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:34.648079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-78834f24-d0c2-4e51-a542-5771222785c1 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:34.649890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-78834f24-d0c2-4e51-a542-5771222785c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:34.662185 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a2fa0-02b3-4dfa-8592-c4977a27cb74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b87ee802e44aa781e579917951c92b, user_id=7505796e852c4038b6a66cdebc27c631, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:34.666019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a2fa0-02b3-4dfa-8592-c4977a27cb74 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:34.679694 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 965/1928] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:34.689675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d5c5c-ad4d-4ae7-9427-e383d38ca4c6 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:34.689897 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d5c5c-ad4d-4ae7-9427-e383d38ca4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:34.690301 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d5c5c-ad4d-4ae7-9427-e383d38ca4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:34.722255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 964/1929] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:34 2022] PUT /identity/v3/projects/a3b87ee802e44aa781e579917951c92b/users/7505796e852c4038b6a66cdebc27c631/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:34.722504 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d73d5c5c-ad4d-4ae7-9427-e383d38ca4c6 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:34.724090 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d73d5c5c-ad4d-4ae7-9427-e383d38ca4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:34.733287 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae0064-952e-46bb-aaf6-b10bd7c0f8b1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:34.733573 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae0064-952e-46bb-aaf6-b10bd7c0f8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:34.733964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae0064-952e-46bb-aaf6-b10bd7c0f8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:34.790048 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a4ae0064-952e-46bb-aaf6-b10bd7c0f8b1 None None] MFA Rules not processed for user `7505796e852c4038b6a66cdebc27c631`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:34.792883 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a4ae0064-952e-46bb-aaf6-b10bd7c0f8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:34.864726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 966/1930] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:34.870405 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d5c5c-ad4d-4ae7-9427-e383d38ca4c6 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:34.884298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 965/1931] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:34.884298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae0064-952e-46bb-aaf6-b10bd7c0f8b1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:34.885390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a4ae0064-952e-46bb-aaf6-b10bd7c0f8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:34.893183 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d5c5c-ad4d-4ae7-9427-e383d38ca4c6 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:34.899845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5efa8-45d1-49be-b53d-48e9961f5b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:34.900582 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5efa8-45d1-49be-b53d-48e9961f5b02 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:34.901014 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5efa8-45d1-49be-b53d-48e9961f5b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:34.901387 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5efa8-45d1-49be-b53d-48e9961f5b02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:34.902247 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5efa8-45d1-49be-b53d-48e9961f5b02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:34.902649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5efa8-45d1-49be-b53d-48e9961f5b02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:34.904412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5efa8-45d1-49be-b53d-48e9961f5b02 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:34.922074 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae0064-952e-46bb-aaf6-b10bd7c0f8b1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:34.927142 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 967/1932] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:34.928322 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cd8f8-f20c-4e8c-ba38-0867857be645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:34.929199 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cd8f8-f20c-4e8c-ba38-0867857be645 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:34.929608 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cd8f8-f20c-4e8c-ba38-0867857be645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:34.929943 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cd8f8-f20c-4e8c-ba38-0867857be645 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:34.930664 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cd8f8-f20c-4e8c-ba38-0867857be645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:34.931189 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5efa8-45d1-49be-b53d-48e9961f5b02 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:34.932772 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cd8f8-f20c-4e8c-ba38-0867857be645 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:34.951774 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5efa8-45d1-49be-b53d-48e9961f5b02 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:34.957262 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c510c7-4add-417d-bda7-5e0d89e304f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:34.957936 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c510c7-4add-417d-bda7-5e0d89e304f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:34.958218 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c510c7-4add-417d-bda7-5e0d89e304f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:34.958486 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c510c7-4add-417d-bda7-5e0d89e304f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:34.959283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c510c7-4add-417d-bda7-5e0d89e304f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:34.961867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c510c7-4add-417d-bda7-5e0d89e304f2 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:34.983713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 966/1933] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:34 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:34.984617 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cd8f8-f20c-4e8c-ba38-0867857be645 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:35.026733 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 968/1934] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:34 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:58:35.033228 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c510c7-4add-417d-bda7-5e0d89e304f2 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:35.083904 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:35.088393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cd8f8-f20c-4e8c-ba38-0867857be645 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:35.129778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c510c7-4add-417d-bda7-5e0d89e304f2 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:35.136920 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488e3d4-05b8-48e1-8359-0e1787c1e831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:35.138558 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488e3d4-05b8-48e1-8359-0e1787c1e831 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:35.138989 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488e3d4-05b8-48e1-8359-0e1787c1e831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:35.139437 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488e3d4-05b8-48e1-8359-0e1787c1e831 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:35.140358 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488e3d4-05b8-48e1-8359-0e1787c1e831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:35.142832 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488e3d4-05b8-48e1-8359-0e1787c1e831 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:35.176014 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 969/1935] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:35 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:58:35.176886 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488e3d4-05b8-48e1-8359-0e1787c1e831 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:35.191508 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488e3d4-05b8-48e1-8359-0e1787c1e831 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:35.196225 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e91f5b-620f-417b-9d12-ecf5df3f8c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:35.197433 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e91f5b-620f-417b-9d12-ecf5df3f8c64 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:35.197727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e91f5b-620f-417b-9d12-ecf5df3f8c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:35.198096 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e91f5b-620f-417b-9d12-ecf5df3f8c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:35.198876 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e91f5b-620f-417b-9d12-ecf5df3f8c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:35.199814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fb078-38e3-4154-befa-7e53738b40f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:35.200452 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fb078-38e3-4154-befa-7e53738b40f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:35.200733 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fb078-38e3-4154-befa-7e53738b40f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:35.201060 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fb078-38e3-4154-befa-7e53738b40f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:35.201708 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5fb078-38e3-4154-befa-7e53738b40f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:35.202412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e91f5b-620f-417b-9d12-ecf5df3f8c64 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:35.204785 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5fb078-38e3-4154-befa-7e53738b40f9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:35.216001 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 970/1936] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:35.222531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e91f5b-620f-417b-9d12-ecf5df3f8c64 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:35.238352 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e91f5b-620f-417b-9d12-ecf5df3f8c64 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:35.239457 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 967/1937] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:34 2022] POST /identity/v3/users => generated 300 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:58:35.244006 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fb078-38e3-4154-befa-7e53738b40f9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:35.246967 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3bd76-52e3-4431-b62e-4e659f0afe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:35.247701 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3bd76-52e3-4431-b62e-4e659f0afe7b admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:35.247983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3bd76-52e3-4431-b62e-4e659f0afe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:35.248256 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3bd76-52e3-4431-b62e-4e659f0afe7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:35.248898 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3bd76-52e3-4431-b62e-4e659f0afe7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:35.250621 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3bd76-52e3-4431-b62e-4e659f0afe7b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:35.258141 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fb078-38e3-4154-befa-7e53738b40f9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:35.263871 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7e120-5b8f-41fb-a85c-6a1f43c0d864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:35.264617 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7e120-5b8f-41fb-a85c-6a1f43c0d864 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:35.264953 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7e120-5b8f-41fb-a85c-6a1f43c0d864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:35.265285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7e120-5b8f-41fb-a85c-6a1f43c0d864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:35.266363 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7e120-5b8f-41fb-a85c-6a1f43c0d864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:35.267800 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 971/1938] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:35.269165 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7e120-5b8f-41fb-a85c-6a1f43c0d864 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:35.269407 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3bd76-52e3-4431-b62e-4e659f0afe7b admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:35.285171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 968/1939] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:58:35.288779 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3bd76-52e3-4431-b62e-4e659f0afe7b admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:35.289910 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7e120-5b8f-41fb-a85c-6a1f43c0d864 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:35.295817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41c783-3dae-47f3-b2ea-c292ed3690ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:35.296804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41c783-3dae-47f3-b2ea-c292ed3690ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:35.297306 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41c783-3dae-47f3-b2ea-c292ed3690ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:35.298405 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41c783-3dae-47f3-b2ea-c292ed3690ba admin admin] PATH_INFO: `/v3/projects/2f69f78ac13c4fc0966eaae660a12fcf/users/1e9c34804ffe423f93d1f3537b5f19a1/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:35.307080 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7e120-5b8f-41fb-a85c-6a1f43c0d864 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:35.311662 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:35.313587 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e5da4-c327-41f9-b09b-d10c7381135a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:35.314364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e5da4-c327-41f9-b09b-d10c7381135a admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:35.314637 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e5da4-c327-41f9-b09b-d10c7381135a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:35.315243 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e5da4-c327-41f9-b09b-d10c7381135a admin admin] PATH_INFO: `/v3/projects/f256f155cc664aa8854f9ecac9fdf2e4/users/ad4d55f087bf4079b9ee4cb27c536bba/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:35.320203 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41c783-3dae-47f3-b2ea-c292ed3690ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f69f78ac13c4fc0966eaae660a12fcf, user_id=1e9c34804ffe423f93d1f3537b5f19a1, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:35.323707 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41c783-3dae-47f3-b2ea-c292ed3690ba admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:35.340740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e5da4-c327-41f9-b09b-d10c7381135a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f256f155cc664aa8854f9ecac9fdf2e4, user_id=ad4d55f087bf4079b9ee4cb27c536bba, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:35.343051 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 972/1940] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:35 2022] PUT /identity/v3/projects/2f69f78ac13c4fc0966eaae660a12fcf/users/1e9c34804ffe423f93d1f3537b5f19a1/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:35.344710 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e5da4-c327-41f9-b09b-d10c7381135a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:35.356406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc79fb4-9b2a-49ac-9f3a-dd82ab7951f2 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:35.356723 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc79fb4-9b2a-49ac-9f3a-dd82ab7951f2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:35.356958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc79fb4-9b2a-49ac-9f3a-dd82ab7951f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:35.361618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 969/1941] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:35 2022] PUT /identity/v3/projects/f256f155cc664aa8854f9ecac9fdf2e4/users/ad4d55f087bf4079b9ee4cb27c536bba/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:35.365084 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e5da4-c327-41f9-b09b-d10c7381135a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:35.401314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-5dc79fb4-9b2a-49ac-9f3a-dd82ab7951f2 None None] MFA Rules not processed for user `1e9c34804ffe423f93d1f3537b5f19a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:35.402034 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5dc79fb4-9b2a-49ac-9f3a-dd82ab7951f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:35.441183 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e5da4-c327-41f9-b09b-d10c7381135a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:35.449780 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d9c63-e24d-466c-ba2d-bd8f8d1cd934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:35.450612 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d9c63-e24d-466c-ba2d-bd8f8d1cd934 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:35.451683 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d9c63-e24d-466c-ba2d-bd8f8d1cd934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:35.456532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d9c63-e24d-466c-ba2d-bd8f8d1cd934 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:35.457322 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d9c63-e24d-466c-ba2d-bd8f8d1cd934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:35.458992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d9c63-e24d-466c-ba2d-bd8f8d1cd934 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:35.471284 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 970/1942] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:58:35.475630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d9c63-e24d-466c-ba2d-bd8f8d1cd934 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:35.488433 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d9c63-e24d-466c-ba2d-bd8f8d1cd934 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:35.493129 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d0827-b096-4c7b-948e-8534ba5c5898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:35.493795 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d0827-b096-4c7b-948e-8534ba5c5898 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:35.494071 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d0827-b096-4c7b-948e-8534ba5c5898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:35.494342 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d0827-b096-4c7b-948e-8534ba5c5898 admin admin] PATH_INFO: `/v3/projects/f256f155cc664aa8854f9ecac9fdf2e4/users/ad4d55f087bf4079b9ee4cb27c536bba/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:35.494625 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 973/1943] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:35.496423 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d0827-b096-4c7b-948e-8534ba5c5898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f256f155cc664aa8854f9ecac9fdf2e4, user_id=ad4d55f087bf4079b9ee4cb27c536bba, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:35.499194 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d0827-b096-4c7b-948e-8534ba5c5898 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:35.507024 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc79fb4-9b2a-49ac-9f3a-dd82ab7951f2 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:35.512068 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 971/1944] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:35 2022] PUT /identity/v3/projects/f256f155cc664aa8854f9ecac9fdf2e4/users/ad4d55f087bf4079b9ee4cb27c536bba/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:35.512494 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5dc79fb4-9b2a-49ac-9f3a-dd82ab7951f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:35.521470 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd4166-5576-4950-a9f7-406c5075a8ba None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:35.521756 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd4166-5576-4950-a9f7-406c5075a8ba None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:35.522028 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd4166-5576-4950-a9f7-406c5075a8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:35.566105 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-93cd4166-5576-4950-a9f7-406c5075a8ba None None] MFA Rules not processed for user `ad4d55f087bf4079b9ee4cb27c536bba`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:35.568032 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-93cd4166-5576-4950-a9f7-406c5075a8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:35.576709 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc79fb4-9b2a-49ac-9f3a-dd82ab7951f2 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:35.610418 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:35.690905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 972/1945] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:35.717605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b4184-c924-431d-8234-dbf20412bb00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:35.718304 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b4184-c924-431d-8234-dbf20412bb00 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:35.718597 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b4184-c924-431d-8234-dbf20412bb00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:35.718920 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b4184-c924-431d-8234-dbf20412bb00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:35.783422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd4166-5576-4950-a9f7-406c5075a8ba None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:35.785102 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-93cd4166-5576-4950-a9f7-406c5075a8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:35.798727 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd4166-5576-4950-a9f7-406c5075a8ba None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:35.802554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa22fac-6397-4c00-b4c7-d55ca62544f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:35.803173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa22fac-6397-4c00-b4c7-d55ca62544f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:35.803483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa22fac-6397-4c00-b4c7-d55ca62544f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:35.803757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa22fac-6397-4c00-b4c7-d55ca62544f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:35.809187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:35.817143 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa22fac-6397-4c00-b4c7-d55ca62544f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:35.818851 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa22fac-6397-4c00-b4c7-d55ca62544f1 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:35.829920 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b4184-c924-431d-8234-dbf20412bb00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:35.835737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 973/1946] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:35 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:58:35.841245 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b4184-c924-431d-8234-dbf20412bb00 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:35.852037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 974/1947] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:58:36.145727 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa22fac-6397-4c00-b4c7-d55ca62544f1 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:36.259913 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa22fac-6397-4c00-b4c7-d55ca62544f1 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:36.282971 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b16c2-96da-4a20-818c-32b33fee8eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:36.284728 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b16c2-96da-4a20-818c-32b33fee8eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:36.285264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b16c2-96da-4a20-818c-32b33fee8eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:36.285811 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b16c2-96da-4a20-818c-32b33fee8eb1 admin admin] PATH_INFO: `/v3/users/7505796e852c4038b6a66cdebc27c631` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:36.287311 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b16c2-96da-4a20-818c-32b33fee8eb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7505796e852c4038b6a66cdebc27c631)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:36.290227 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b16c2-96da-4a20-818c-32b33fee8eb1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:36.419151 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2b7b16c2-96da-4a20-818c-32b33fee8eb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7505796e852c4038b6a66cdebc27c631'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:36.428764 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2b7b16c2-96da-4a20-818c-32b33fee8eb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7505796e852c4038b6a66cdebc27c631'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:36.440907 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2b7b16c2-96da-4a20-818c-32b33fee8eb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7505796e852c4038b6a66cdebc27c631'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:36.481287 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2b7b16c2-96da-4a20-818c-32b33fee8eb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7505796e852c4038b6a66cdebc27c631'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:36.482501 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2b7b16c2-96da-4a20-818c-32b33fee8eb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7505796e852c4038b6a66cdebc27c631'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:36.506109 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 974/1948] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:36 2022] DELETE /identity/v3/users/7505796e852c4038b6a66cdebc27c631 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:36.508794 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c02f0-70ab-4064-b123-91b7c9085b8b None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:36.509218 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c02f0-70ab-4064-b123-91b7c9085b8b None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:36.509295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c02f0-70ab-4064-b123-91b7c9085b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:36.541735 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f98c02f0-70ab-4064-b123-91b7c9085b8b None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:36.541735 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f98c02f0-70ab-4064-b123-91b7c9085b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:36.638380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 975/1949] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:36.670893 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b16c2-96da-4a20-818c-32b33fee8eb1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:36.672510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2b7b16c2-96da-4a20-818c-32b33fee8eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:36.711323 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:36.739691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b16c2-96da-4a20-818c-32b33fee8eb1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:36.743160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cf1de-3cbf-466a-988c-07c9b47f7bea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:36.743809 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cf1de-3cbf-466a-988c-07c9b47f7bea service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:36.744088 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cf1de-3cbf-466a-988c-07c9b47f7bea service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:36.744360 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cf1de-3cbf-466a-988c-07c9b47f7bea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:36.754277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cf1de-3cbf-466a-988c-07c9b47f7bea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:36.755821 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cf1de-3cbf-466a-988c-07c9b47f7bea service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:36.766631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 975/1950] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:37.250680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c02f0-70ab-4064-b123-91b7c9085b8b None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:37.252390 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f98c02f0-70ab-4064-b123-91b7c9085b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:37.269820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c02f0-70ab-4064-b123-91b7c9085b8b None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:37.285884 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee365c0-2fda-496c-b1d1-04a46ece1bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:37.288748 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee365c0-2fda-496c-b1d1-04a46ece1bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:37.289339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee365c0-2fda-496c-b1d1-04a46ece1bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:37.291213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee365c0-2fda-496c-b1d1-04a46ece1bce admin admin] PATH_INFO: `/v3/projects/a3b87ee802e44aa781e579917951c92b` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:37.305604 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee365c0-2fda-496c-b1d1-04a46ece1bce admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3b87ee802e44aa781e579917951c92b)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:37.308044 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee365c0-2fda-496c-b1d1-04a46ece1bce admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:37.427010 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-bee365c0-2fda-496c-b1d1-04a46ece1bce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b87ee802e44aa781e579917951c92b', 'request_id': 'req-bee365c0-2fda-496c-b1d1-04a46ece1bce'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:37.439263 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-bee365c0-2fda-496c-b1d1-04a46ece1bce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b87ee802e44aa781e579917951c92b', 'request_id': 'req-bee365c0-2fda-496c-b1d1-04a46ece1bce'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:37.448112 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-bee365c0-2fda-496c-b1d1-04a46ece1bce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b87ee802e44aa781e579917951c92b', 'request_id': 'req-bee365c0-2fda-496c-b1d1-04a46ece1bce'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:37.481946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-bee365c0-2fda-496c-b1d1-04a46ece1bce admin admin] The token cache is being invalidate because project a3b87ee802e44aa781e579917951c92b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:37.482470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-bee365c0-2fda-496c-b1d1-04a46ece1bce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:37.483458 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-bee365c0-2fda-496c-b1d1-04a46ece1bce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:37.485911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 976/1951] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:37 2022] DELETE /identity/v3/projects/a3b87ee802e44aa781e579917951c92b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:37.490025 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cf1de-3cbf-466a-988c-07c9b47f7bea service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:37.502368 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cf1de-3cbf-466a-988c-07c9b47f7bea service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:37.600882 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c42c7a-f555-4e7d-9065-eb5c47e04a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:37.601929 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c42c7a-f555-4e7d-9065-eb5c47e04a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:37.602327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c42c7a-f555-4e7d-9065-eb5c47e04a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:37.602661 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c42c7a-f555-4e7d-9065-eb5c47e04a9a admin admin] PATH_INFO: `/v3/users/ad4d55f087bf4079b9ee4cb27c536bba` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:37.603977 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c42c7a-f555-4e7d-9065-eb5c47e04a9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad4d55f087bf4079b9ee4cb27c536bba)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:37.616724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c42c7a-f555-4e7d-9065-eb5c47e04a9a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:37.712565 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-68c42c7a-f555-4e7d-9065-eb5c47e04a9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad4d55f087bf4079b9ee4cb27c536bba'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:37.732984 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-68c42c7a-f555-4e7d-9065-eb5c47e04a9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad4d55f087bf4079b9ee4cb27c536bba'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:37.752733 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-68c42c7a-f555-4e7d-9065-eb5c47e04a9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad4d55f087bf4079b9ee4cb27c536bba'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:37.786784 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-68c42c7a-f555-4e7d-9065-eb5c47e04a9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad4d55f087bf4079b9ee4cb27c536bba'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:37.788463 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-68c42c7a-f555-4e7d-9065-eb5c47e04a9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad4d55f087bf4079b9ee4cb27c536bba'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:37.798332 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 976/1952] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:37 2022] DELETE /identity/v3/users/ad4d55f087bf4079b9ee4cb27c536bba => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:38.165226 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee365c0-2fda-496c-b1d1-04a46ece1bce admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:38.169504 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bee365c0-2fda-496c-b1d1-04a46ece1bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:38.185724 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee365c0-2fda-496c-b1d1-04a46ece1bce admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:38.273063 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ef2b0-c382-4264-8221-7ede813fd93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:38.274448 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ef2b0-c382-4264-8221-7ede813fd93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:38.274897 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ef2b0-c382-4264-8221-7ede813fd93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:38.275173 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ef2b0-c382-4264-8221-7ede813fd93c admin admin] PATH_INFO: `/v3/projects/f256f155cc664aa8854f9ecac9fdf2e4` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:38.279978 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ef2b0-c382-4264-8221-7ede813fd93c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f256f155cc664aa8854f9ecac9fdf2e4)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:38.282878 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ef2b0-c382-4264-8221-7ede813fd93c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:38.307798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:38.355954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1a2ef2b0-c382-4264-8221-7ede813fd93c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f256f155cc664aa8854f9ecac9fdf2e4', 'request_id': 'req-1a2ef2b0-c382-4264-8221-7ede813fd93c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:38.363829 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1a2ef2b0-c382-4264-8221-7ede813fd93c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f256f155cc664aa8854f9ecac9fdf2e4', 'request_id': 'req-1a2ef2b0-c382-4264-8221-7ede813fd93c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:38.370710 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1a2ef2b0-c382-4264-8221-7ede813fd93c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f256f155cc664aa8854f9ecac9fdf2e4', 'request_id': 'req-1a2ef2b0-c382-4264-8221-7ede813fd93c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:38.390200 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1a2ef2b0-c382-4264-8221-7ede813fd93c admin admin] The token cache is being invalidate because project f256f155cc664aa8854f9ecac9fdf2e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:38.390643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1a2ef2b0-c382-4264-8221-7ede813fd93c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:38.391325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1a2ef2b0-c382-4264-8221-7ede813fd93c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:38.392949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 977/1953] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:38 2022] DELETE /identity/v3/projects/f256f155cc664aa8854f9ecac9fdf2e4 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:38.399842 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af365c5-51a1-411d-a723-43e0da95b8cb None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:38.400132 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af365c5-51a1-411d-a723-43e0da95b8cb None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:38.400414 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af365c5-51a1-411d-a723-43e0da95b8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:38.440636 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5af365c5-51a1-411d-a723-43e0da95b8cb None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:38.441899 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5af365c5-51a1-411d-a723-43e0da95b8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:38.512745 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:38.545502 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 977/1954] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:38.547393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50494e5c-73ba-4ae8-bd25-d1957fbfa479 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:38.547675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50494e5c-73ba-4ae8-bd25-d1957fbfa479 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:38.547951 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50494e5c-73ba-4ae8-bd25-d1957fbfa479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:38.597842 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-50494e5c-73ba-4ae8-bd25-d1957fbfa479 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:38.599598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-50494e5c-73ba-4ae8-bd25-d1957fbfa479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:38.609530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 978/1955] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:38.614451 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af365c5-51a1-411d-a723-43e0da95b8cb None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:38.626933 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af365c5-51a1-411d-a723-43e0da95b8cb None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:38.632229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62b5d2-da77-4c11-9384-1b7e628fa736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:38.632857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62b5d2-da77-4c11-9384-1b7e628fa736 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:38.633140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62b5d2-da77-4c11-9384-1b7e628fa736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:38.633413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62b5d2-da77-4c11-9384-1b7e628fa736 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:38.634196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62b5d2-da77-4c11-9384-1b7e628fa736 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:38.634397 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62b5d2-da77-4c11-9384-1b7e628fa736 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:38.636075 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62b5d2-da77-4c11-9384-1b7e628fa736 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:38.649637 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 978/1956] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:38.654185 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50494e5c-73ba-4ae8-bd25-d1957fbfa479 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:38.664768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50494e5c-73ba-4ae8-bd25-d1957fbfa479 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:38.671030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d183f7-1087-4ed7-8bda-5885c306dafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:38.671903 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d183f7-1087-4ed7-8bda-5885c306dafd admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:38.672391 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d183f7-1087-4ed7-8bda-5885c306dafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:38.672763 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d183f7-1087-4ed7-8bda-5885c306dafd admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:38.673794 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d183f7-1087-4ed7-8bda-5885c306dafd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:38.675835 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d183f7-1087-4ed7-8bda-5885c306dafd admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:38.711409 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 979/1957] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:38 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:58:38.714404 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62b5d2-da77-4c11-9384-1b7e628fa736 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:38.725801 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62b5d2-da77-4c11-9384-1b7e628fa736 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:38.789081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fa11d-638d-427d-a59d-eda276a87838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:38.789834 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fa11d-638d-427d-a59d-eda276a87838 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:38.790337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fa11d-638d-427d-a59d-eda276a87838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:38.790661 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fa11d-638d-427d-a59d-eda276a87838 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:38.791473 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0fa11d-638d-427d-a59d-eda276a87838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:38.793634 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0fa11d-638d-427d-a59d-eda276a87838 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:38.821471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 979/1958] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:38 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:38.825501 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d183f7-1087-4ed7-8bda-5885c306dafd admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:38.836186 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d183f7-1087-4ed7-8bda-5885c306dafd admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:38.841597 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024661e-7fb6-47f7-a05a-0f377345dd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:38.842498 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024661e-7fb6-47f7-a05a-0f377345dd5a admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:38.842778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024661e-7fb6-47f7-a05a-0f377345dd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:38.843051 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024661e-7fb6-47f7-a05a-0f377345dd5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:38.844104 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024661e-7fb6-47f7-a05a-0f377345dd5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:38.845768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024661e-7fb6-47f7-a05a-0f377345dd5a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:38.859952 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 980/1959] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:38.861631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fa11d-638d-427d-a59d-eda276a87838 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:38.872392 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fa11d-638d-427d-a59d-eda276a87838 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:38.878751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fb5d7-794a-48d0-ba64-997a175a43cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:38.879619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fb5d7-794a-48d0-ba64-997a175a43cb admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:38.879959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fb5d7-794a-48d0-ba64-997a175a43cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:38.880312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fb5d7-794a-48d0-ba64-997a175a43cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:38.881034 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fb5d7-794a-48d0-ba64-997a175a43cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:38.882858 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fb5d7-794a-48d0-ba64-997a175a43cb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:38.895889 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 980/1960] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:38.900449 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024661e-7fb6-47f7-a05a-0f377345dd5a admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:38.913114 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024661e-7fb6-47f7-a05a-0f377345dd5a admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:38.918434 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4c5f2-cfb9-4823-bf49-88cfda7f2810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:38.919093 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4c5f2-cfb9-4823-bf49-88cfda7f2810 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:38.919451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4c5f2-cfb9-4823-bf49-88cfda7f2810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:38.919670 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4c5f2-cfb9-4823-bf49-88cfda7f2810 admin admin] PATH_INFO: `/v3/projects/d52a769c7bd44845b3b63256a8344ee2/users/fa53ebbd3d544e3cb60ed1ef27b60334/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:38.936794 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4c5f2-cfb9-4823-bf49-88cfda7f2810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52a769c7bd44845b3b63256a8344ee2, user_id=fa53ebbd3d544e3cb60ed1ef27b60334, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:38.940418 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4c5f2-cfb9-4823-bf49-88cfda7f2810 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:38.983401 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 981/1961] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:38 2022] PUT /identity/v3/projects/d52a769c7bd44845b3b63256a8344ee2/users/fa53ebbd3d544e3cb60ed1ef27b60334/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:38.988693 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11221cc1-004f-4c77-b0f9-68ce4531f0c3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:38.989076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11221cc1-004f-4c77-b0f9-68ce4531f0c3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:38.989497 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11221cc1-004f-4c77-b0f9-68ce4531f0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:39.020860 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-11221cc1-004f-4c77-b0f9-68ce4531f0c3 None None] MFA Rules not processed for user `fa53ebbd3d544e3cb60ed1ef27b60334`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:39.022175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-11221cc1-004f-4c77-b0f9-68ce4531f0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:39.097545 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 981/1962] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:39.099221 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4c5f2-cfb9-4823-bf49-88cfda7f2810 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:39.170845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4c5f2-cfb9-4823-bf49-88cfda7f2810 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:39.176058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1dbcb-8957-4a86-8dd0-1cc665046bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:39.176676 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1dbcb-8957-4a86-8dd0-1cc665046bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:39.177044 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1dbcb-8957-4a86-8dd0-1cc665046bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:39.177220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1dbcb-8957-4a86-8dd0-1cc665046bb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:39.177854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1dbcb-8957-4a86-8dd0-1cc665046bb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:39.179888 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1dbcb-8957-4a86-8dd0-1cc665046bb9 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:39.208629 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 982/1963] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:39 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:39.212887 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11221cc1-004f-4c77-b0f9-68ce4531f0c3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:39.227664 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11221cc1-004f-4c77-b0f9-68ce4531f0c3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:39.281598 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:39.293428 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4a64c-c88b-464a-8809-76c2290a6e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:39.294159 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4a64c-c88b-464a-8809-76c2290a6e88 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:39.294503 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4a64c-c88b-464a-8809-76c2290a6e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:39.294925 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4a64c-c88b-464a-8809-76c2290a6e88 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:39.295677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4a64c-c88b-464a-8809-76c2290a6e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:39.297935 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4a64c-c88b-464a-8809-76c2290a6e88 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:39.326343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 982/1964] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:39 2022] POST /identity/v3/users => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:39.327835 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1dbcb-8957-4a86-8dd0-1cc665046bb9 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:39.341622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1dbcb-8957-4a86-8dd0-1cc665046bb9 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:39.346679 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01e03b-4559-4ca9-9bd4-0a28c86013bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:39.347272 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01e03b-4559-4ca9-9bd4-0a28c86013bd admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:39.347594 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01e03b-4559-4ca9-9bd4-0a28c86013bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:39.347870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01e03b-4559-4ca9-9bd4-0a28c86013bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:39.348511 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01e03b-4559-4ca9-9bd4-0a28c86013bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:39.350231 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01e03b-4559-4ca9-9bd4-0a28c86013bd admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:39.362300 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 983/1965] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:39.366592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4a64c-c88b-464a-8809-76c2290a6e88 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:39.376972 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4a64c-c88b-464a-8809-76c2290a6e88 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:39.381759 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a804e75-a48d-4253-a59f-08b4d9067af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:39.382430 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a804e75-a48d-4253-a59f-08b4d9067af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:39.382701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a804e75-a48d-4253-a59f-08b4d9067af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:39.382976 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a804e75-a48d-4253-a59f-08b4d9067af8 admin admin] PATH_INFO: `/v3/projects/7e3c0809cc69445a8074f5e641c655ae/users/5a2cfa9061eb460f9b8d1793692708af/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:39.398368 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a804e75-a48d-4253-a59f-08b4d9067af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e3c0809cc69445a8074f5e641c655ae, user_id=5a2cfa9061eb460f9b8d1793692708af, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:39.401131 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a804e75-a48d-4253-a59f-08b4d9067af8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:39.416358 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 983/1966] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:39 2022] PUT /identity/v3/projects/7e3c0809cc69445a8074f5e641c655ae/users/5a2cfa9061eb460f9b8d1793692708af/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:39.420599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01e03b-4559-4ca9-9bd4-0a28c86013bd admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:39.430897 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01e03b-4559-4ca9-9bd4-0a28c86013bd admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:39.440258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:39.491923 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41130603-0d7b-4cdd-8e96-ec84d8b55778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:39.492535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41130603-0d7b-4cdd-8e96-ec84d8b55778 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:39.492839 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41130603-0d7b-4cdd-8e96-ec84d8b55778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:39.493109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41130603-0d7b-4cdd-8e96-ec84d8b55778 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:39.493741 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41130603-0d7b-4cdd-8e96-ec84d8b55778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:39.495341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41130603-0d7b-4cdd-8e96-ec84d8b55778 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:39.506172 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 984/1967] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:39.510403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a804e75-a48d-4253-a59f-08b4d9067af8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:39.522067 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a804e75-a48d-4253-a59f-08b4d9067af8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:39.527328 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f5429-a561-46b6-ae59-328f21e9c2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:39.528012 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f5429-a561-46b6-ae59-328f21e9c2d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:39.528295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f5429-a561-46b6-ae59-328f21e9c2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:39.528564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f5429-a561-46b6-ae59-328f21e9c2d7 admin admin] PATH_INFO: `/v3/projects/7e3c0809cc69445a8074f5e641c655ae/users/5a2cfa9061eb460f9b8d1793692708af/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:39.530512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f5429-a561-46b6-ae59-328f21e9c2d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e3c0809cc69445a8074f5e641c655ae, user_id=5a2cfa9061eb460f9b8d1793692708af, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:39.533366 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f5429-a561-46b6-ae59-328f21e9c2d7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:39.548226 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 984/1968] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:39 2022] PUT /identity/v3/projects/7e3c0809cc69445a8074f5e641c655ae/users/5a2cfa9061eb460f9b8d1793692708af/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:39.559405 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dd937-f67d-4260-b1e1-3314d5bfb13e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:39.559915 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dd937-f67d-4260-b1e1-3314d5bfb13e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:39.560327 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dd937-f67d-4260-b1e1-3314d5bfb13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:39.591310 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-8c1dd937-f67d-4260-b1e1-3314d5bfb13e None None] MFA Rules not processed for user `5a2cfa9061eb460f9b8d1793692708af`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:39.592538 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8c1dd937-f67d-4260-b1e1-3314d5bfb13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:39.673807 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 985/1969] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:39.685093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f5429-a561-46b6-ae59-328f21e9c2d7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:39.687006 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2d0f5429-a561-46b6-ae59-328f21e9c2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:39.769983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f5429-a561-46b6-ae59-328f21e9c2d7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:39.773802 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123025b-59b2-4c93-a361-19e710f8650f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:39.774502 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123025b-59b2-4c93-a361-19e710f8650f service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:39.774893 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123025b-59b2-4c93-a361-19e710f8650f service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:39.775232 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123025b-59b2-4c93-a361-19e710f8650f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:39.784830 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123025b-59b2-4c93-a361-19e710f8650f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:39.786273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123025b-59b2-4c93-a361-19e710f8650f service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:39.795870 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 985/1970] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:39.907506 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dd937-f67d-4260-b1e1-3314d5bfb13e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:39.908838 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8c1dd937-f67d-4260-b1e1-3314d5bfb13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:39.923250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123025b-59b2-4c93-a361-19e710f8650f service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:39.932176 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123025b-59b2-4c93-a361-19e710f8650f service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:39.935891 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74165575-9f4d-4521-be6a-85bc008d4e6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:39.936533 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74165575-9f4d-4521-be6a-85bc008d4e6c service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:39.937035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74165575-9f4d-4521-be6a-85bc008d4e6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:39.937516 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74165575-9f4d-4521-be6a-85bc008d4e6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:40.051011 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dd937-f67d-4260-b1e1-3314d5bfb13e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:40.058763 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a854b5-599a-4268-9387-a61f727966a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:40.059668 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a854b5-599a-4268-9387-a61f727966a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:40.059882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a854b5-599a-4268-9387-a61f727966a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:40.060159 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a854b5-599a-4268-9387-a61f727966a4 admin admin] PATH_INFO: `/v3/users/0fff2861027c4235ab8d1bf209f8d1c6` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:40.061072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74165575-9f4d-4521-be6a-85bc008d4e6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:40.061659 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a854b5-599a-4268-9387-a61f727966a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fff2861027c4235ab8d1bf209f8d1c6)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:40.063599 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74165575-9f4d-4521-be6a-85bc008d4e6c service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:40.064560 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a854b5-599a-4268-9387-a61f727966a4 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:40.083767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 986/1971] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:58:40.134398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:40.153837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c0a854b5-599a-4268-9387-a61f727966a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fff2861027c4235ab8d1bf209f8d1c6'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:40.167097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c0a854b5-599a-4268-9387-a61f727966a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fff2861027c4235ab8d1bf209f8d1c6'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:40.187976 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c0a854b5-599a-4268-9387-a61f727966a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fff2861027c4235ab8d1bf209f8d1c6'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:40.189668 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c0a854b5-599a-4268-9387-a61f727966a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fff2861027c4235ab8d1bf209f8d1c6'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:40.217834 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c0a854b5-599a-4268-9387-a61f727966a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fff2861027c4235ab8d1bf209f8d1c6'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:40.229431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 986/1972] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:39 2022] DELETE /identity/v3/users/0fff2861027c4235ab8d1bf209f8d1c6 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:40.231528 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93748151-ae23-4d2b-8f71-7add2b7760d2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:40.232274 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93748151-ae23-4d2b-8f71-7add2b7760d2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:40.232743 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93748151-ae23-4d2b-8f71-7add2b7760d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:40.253317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-93748151-ae23-4d2b-8f71-7add2b7760d2 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:40.254821 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-93748151-ae23-4d2b-8f71-7add2b7760d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:40.322878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:40.350479 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 987/1973] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:40.364686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a854b5-599a-4268-9387-a61f727966a4 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:40.367162 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c0a854b5-599a-4268-9387-a61f727966a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:40.501754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a854b5-599a-4268-9387-a61f727966a4 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:40.507200 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978c76e-cb10-4b89-af10-9c79bc0baa79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:40.508273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978c76e-cb10-4b89-af10-9c79bc0baa79 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:40.508871 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978c76e-cb10-4b89-af10-9c79bc0baa79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:40.510182 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978c76e-cb10-4b89-af10-9c79bc0baa79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:40.524420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978c76e-cb10-4b89-af10-9c79bc0baa79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:40.529070 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978c76e-cb10-4b89-af10-9c79bc0baa79 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:40.542765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 987/1974] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:41.389515 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93748151-ae23-4d2b-8f71-7add2b7760d2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:41.391395 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-93748151-ae23-4d2b-8f71-7add2b7760d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:41.440810 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93748151-ae23-4d2b-8f71-7add2b7760d2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:41.458135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86d6b5-5ab0-4772-b398-af7347e22cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:41.460160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86d6b5-5ab0-4772-b398-af7347e22cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:41.461459 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86d6b5-5ab0-4772-b398-af7347e22cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:41.461749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86d6b5-5ab0-4772-b398-af7347e22cc8 admin admin] PATH_INFO: `/v3/projects/33dd023d36ea4c76aa477400b6bbca33` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:41.464446 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86d6b5-5ab0-4772-b398-af7347e22cc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33dd023d36ea4c76aa477400b6bbca33)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:41.471226 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86d6b5-5ab0-4772-b398-af7347e22cc8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:41.578252 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9d86d6b5-5ab0-4772-b398-af7347e22cc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33dd023d36ea4c76aa477400b6bbca33', 'request_id': 'req-9d86d6b5-5ab0-4772-b398-af7347e22cc8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:41.592648 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9d86d6b5-5ab0-4772-b398-af7347e22cc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33dd023d36ea4c76aa477400b6bbca33', 'request_id': 'req-9d86d6b5-5ab0-4772-b398-af7347e22cc8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:41.603416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9d86d6b5-5ab0-4772-b398-af7347e22cc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33dd023d36ea4c76aa477400b6bbca33', 'request_id': 'req-9d86d6b5-5ab0-4772-b398-af7347e22cc8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:41.627305 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9d86d6b5-5ab0-4772-b398-af7347e22cc8 admin admin] The token cache is being invalidate because project 33dd023d36ea4c76aa477400b6bbca33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:41.627897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9d86d6b5-5ab0-4772-b398-af7347e22cc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:41.628874 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9d86d6b5-5ab0-4772-b398-af7347e22cc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:41.632334 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 988/1975] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:41 2022] DELETE /identity/v3/projects/33dd023d36ea4c76aa477400b6bbca33 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:41.636170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978c76e-cb10-4b89-af10-9c79bc0baa79 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:41.655658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978c76e-cb10-4b89-af10-9c79bc0baa79 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:41.801692 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d078f4-653c-477c-a249-906280a29c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:41.802386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d078f4-653c-477c-a249-906280a29c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:41.802903 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d078f4-653c-477c-a249-906280a29c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:41.803191 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d078f4-653c-477c-a249-906280a29c3c admin admin] PATH_INFO: `/v3/users/006d9d31bc4949178ed0c7be84d1d017` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:41.804700 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d078f4-653c-477c-a249-906280a29c3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=006d9d31bc4949178ed0c7be84d1d017)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:41.810440 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d078f4-653c-477c-a249-906280a29c3c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:41.910365 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-35d078f4-653c-477c-a249-906280a29c3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '006d9d31bc4949178ed0c7be84d1d017'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:41.942679 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-35d078f4-653c-477c-a249-906280a29c3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '006d9d31bc4949178ed0c7be84d1d017'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:41.952872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:41.964364 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-35d078f4-653c-477c-a249-906280a29c3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '006d9d31bc4949178ed0c7be84d1d017'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:41.968228 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-35d078f4-653c-477c-a249-906280a29c3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '006d9d31bc4949178ed0c7be84d1d017'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:41.991529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-35d078f4-653c-477c-a249-906280a29c3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '006d9d31bc4949178ed0c7be84d1d017'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:42.001108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 988/1976] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:41 2022] DELETE /identity/v3/users/006d9d31bc4949178ed0c7be84d1d017 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:42.387173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86d6b5-5ab0-4772-b398-af7347e22cc8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:42.388953 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9d86d6b5-5ab0-4772-b398-af7347e22cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:42.404979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86d6b5-5ab0-4772-b398-af7347e22cc8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:42.472523 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b0134-8fd0-4e8b-89d1-6a2dd443cb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:42.473929 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b0134-8fd0-4e8b-89d1-6a2dd443cb82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:42.474321 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b0134-8fd0-4e8b-89d1-6a2dd443cb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:42.474695 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b0134-8fd0-4e8b-89d1-6a2dd443cb82 admin admin] PATH_INFO: `/v3/projects/3b62d95081a44fe6a664e443c3ef2b9c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:42.476312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b0134-8fd0-4e8b-89d1-6a2dd443cb82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b62d95081a44fe6a664e443c3ef2b9c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:42.478409 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b0134-8fd0-4e8b-89d1-6a2dd443cb82 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:42.539764 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-712b0134-8fd0-4e8b-89d1-6a2dd443cb82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b62d95081a44fe6a664e443c3ef2b9c', 'request_id': 'req-712b0134-8fd0-4e8b-89d1-6a2dd443cb82'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:42.551392 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-712b0134-8fd0-4e8b-89d1-6a2dd443cb82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b62d95081a44fe6a664e443c3ef2b9c', 'request_id': 'req-712b0134-8fd0-4e8b-89d1-6a2dd443cb82'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:42.561713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-712b0134-8fd0-4e8b-89d1-6a2dd443cb82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b62d95081a44fe6a664e443c3ef2b9c', 'request_id': 'req-712b0134-8fd0-4e8b-89d1-6a2dd443cb82'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:42.573372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:42.579110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-712b0134-8fd0-4e8b-89d1-6a2dd443cb82 admin admin] The token cache is being invalidate because project 3b62d95081a44fe6a664e443c3ef2b9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:42.579453 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-712b0134-8fd0-4e8b-89d1-6a2dd443cb82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:42.580247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-712b0134-8fd0-4e8b-89d1-6a2dd443cb82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:42.582356 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 989/1977] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:42 2022] DELETE /identity/v3/projects/3b62d95081a44fe6a664e443c3ef2b9c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:42.588402 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289c489-2769-4856-94ed-7bc6c42e3a6e None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:42.588694 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289c489-2769-4856-94ed-7bc6c42e3a6e None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:42.589187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289c489-2769-4856-94ed-7bc6c42e3a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:42.617563 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-7289c489-2769-4856-94ed-7bc6c42e3a6e None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:42.618943 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7289c489-2769-4856-94ed-7bc6c42e3a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:42.729001 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 989/1978] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:42.737957 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89dafc-99cb-449f-9649-33859610db14 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:42.738520 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89dafc-99cb-449f-9649-33859610db14 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:42.739119 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89dafc-99cb-449f-9649-33859610db14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:42.766974 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6b89dafc-99cb-449f-9649-33859610db14 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:42.768423 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6b89dafc-99cb-449f-9649-33859610db14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:42.789199 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289c489-2769-4856-94ed-7bc6c42e3a6e None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:42.789492 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 990/1979] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:42.801530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289c489-2769-4856-94ed-7bc6c42e3a6e None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:42.819836 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f533c77-e4a4-426d-a7be-340acaa967d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:42.820485 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f533c77-e4a4-426d-a7be-340acaa967d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:42.820765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f533c77-e4a4-426d-a7be-340acaa967d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:42.821037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f533c77-e4a4-426d-a7be-340acaa967d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:42.821790 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f533c77-e4a4-426d-a7be-340acaa967d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:42.822092 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f533c77-e4a4-426d-a7be-340acaa967d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:42.823773 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f533c77-e4a4-426d-a7be-340acaa967d9 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:42.840521 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 990/1980] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:58:42.842120 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89dafc-99cb-449f-9649-33859610db14 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:42.859396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89dafc-99cb-449f-9649-33859610db14 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:42.865373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86031f1-0df5-43c1-ab77-0d28ee5b6075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:42.866190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86031f1-0df5-43c1-ab77-0d28ee5b6075 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:42.866614 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86031f1-0df5-43c1-ab77-0d28ee5b6075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:42.867081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86031f1-0df5-43c1-ab77-0d28ee5b6075 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:42.867913 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86031f1-0df5-43c1-ab77-0d28ee5b6075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:42.870186 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86031f1-0df5-43c1-ab77-0d28ee5b6075 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:42.926094 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 991/1981] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:42 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:58:42.930746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f533c77-e4a4-426d-a7be-340acaa967d9 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:42.949020 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f533c77-e4a4-426d-a7be-340acaa967d9 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:43.097321 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ab56e-2ed4-4b2a-8589-c4430bd9fea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:43.097321 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ab56e-2ed4-4b2a-8589-c4430bd9fea1 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:43.097321 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ab56e-2ed4-4b2a-8589-c4430bd9fea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:43.097842 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ab56e-2ed4-4b2a-8589-c4430bd9fea1 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:43.099352 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ab56e-2ed4-4b2a-8589-c4430bd9fea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:43.101756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ab56e-2ed4-4b2a-8589-c4430bd9fea1 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:43.139830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 991/1982] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:42 2022] POST /identity/v3/users => generated 288 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:43.144228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86031f1-0df5-43c1-ab77-0d28ee5b6075 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:43.154832 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86031f1-0df5-43c1-ab77-0d28ee5b6075 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:43.160545 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810f72a-4934-4ac7-bd0e-2cf8a9766e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:43.161100 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810f72a-4934-4ac7-bd0e-2cf8a9766e09 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:43.161375 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810f72a-4934-4ac7-bd0e-2cf8a9766e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:43.161647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810f72a-4934-4ac7-bd0e-2cf8a9766e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:43.163018 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810f72a-4934-4ac7-bd0e-2cf8a9766e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:43.164089 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810f72a-4934-4ac7-bd0e-2cf8a9766e09 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:43.183471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 992/1983] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:43.187588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ab56e-2ed4-4b2a-8589-c4430bd9fea1 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:43.198935 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ab56e-2ed4-4b2a-8589-c4430bd9fea1 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:43.204462 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad881cea-ad42-475f-a386-297620044b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:43.205370 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad881cea-ad42-475f-a386-297620044b8f admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:43.205748 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad881cea-ad42-475f-a386-297620044b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:43.206232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad881cea-ad42-475f-a386-297620044b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:43.207751 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad881cea-ad42-475f-a386-297620044b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:43.210230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad881cea-ad42-475f-a386-297620044b8f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:43.222066 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 992/1984] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:43.226574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810f72a-4934-4ac7-bd0e-2cf8a9766e09 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:43.237496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810f72a-4934-4ac7-bd0e-2cf8a9766e09 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:43.243302 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab3d35-ef6d-4054-9046-4dd6ab71b364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:43.244172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab3d35-ef6d-4054-9046-4dd6ab71b364 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:43.244634 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab3d35-ef6d-4054-9046-4dd6ab71b364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:43.244854 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab3d35-ef6d-4054-9046-4dd6ab71b364 admin admin] PATH_INFO: `/v3/projects/fbebb044d0924f7199df6ff1fd0eb4ca/users/3afc232a8a9748c4b3a7dc48f049b83b/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:43.262322 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab3d35-ef6d-4054-9046-4dd6ab71b364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbebb044d0924f7199df6ff1fd0eb4ca, user_id=3afc232a8a9748c4b3a7dc48f049b83b, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:43.265389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab3d35-ef6d-4054-9046-4dd6ab71b364 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:43.285192 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 993/1985] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:43 2022] PUT /identity/v3/projects/fbebb044d0924f7199df6ff1fd0eb4ca/users/3afc232a8a9748c4b3a7dc48f049b83b/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:43.297193 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3cc1b-2cf9-41ea-b082-bac43072fc27 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:43.297624 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3cc1b-2cf9-41ea-b082-bac43072fc27 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:43.298044 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3cc1b-2cf9-41ea-b082-bac43072fc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:43.342570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-47c3cc1b-2cf9-41ea-b082-bac43072fc27 None None] MFA Rules not processed for user `3afc232a8a9748c4b3a7dc48f049b83b`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:43.344903 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-47c3cc1b-2cf9-41ea-b082-bac43072fc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:43.390768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab3d35-ef6d-4054-9046-4dd6ab71b364 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:43.393690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7dab3d35-ef6d-4054-9046-4dd6ab71b364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:43.409274 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:43.467404 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 993/1986] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:43.473333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3cc1b-2cf9-41ea-b082-bac43072fc27 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:43.498406 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab3d35-ef6d-4054-9046-4dd6ab71b364 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:43.504018 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72e881-7075-4399-bc1c-1a3740979119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:43.504905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72e881-7075-4399-bc1c-1a3740979119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:43.505250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72e881-7075-4399-bc1c-1a3740979119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:43.505644 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72e881-7075-4399-bc1c-1a3740979119 admin admin] PATH_INFO: `/v3/users/fa53ebbd3d544e3cb60ed1ef27b60334` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:43.506892 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72e881-7075-4399-bc1c-1a3740979119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa53ebbd3d544e3cb60ed1ef27b60334)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:43.509078 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72e881-7075-4399-bc1c-1a3740979119 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:43.555743 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3cc1b-2cf9-41ea-b082-bac43072fc27 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:43.563701 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583a559-cd6a-4300-9350-edc2b1e8bc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:43.564337 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583a559-cd6a-4300-9350-edc2b1e8bc3d admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:43.564670 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583a559-cd6a-4300-9350-edc2b1e8bc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:43.565085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583a559-cd6a-4300-9350-edc2b1e8bc3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:43.565756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583a559-cd6a-4300-9350-edc2b1e8bc3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:43.568046 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583a559-cd6a-4300-9350-edc2b1e8bc3d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:43.580615 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ae72e881-7075-4399-bc1c-1a3740979119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa53ebbd3d544e3cb60ed1ef27b60334'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:43.595057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ae72e881-7075-4399-bc1c-1a3740979119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa53ebbd3d544e3cb60ed1ef27b60334'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:43.612629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ae72e881-7075-4399-bc1c-1a3740979119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa53ebbd3d544e3cb60ed1ef27b60334'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:43.619662 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 994/1987] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:43 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:43.622717 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583a559-cd6a-4300-9350-edc2b1e8bc3d admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:43.629938 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ae72e881-7075-4399-bc1c-1a3740979119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa53ebbd3d544e3cb60ed1ef27b60334'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:43.631242 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ae72e881-7075-4399-bc1c-1a3740979119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa53ebbd3d544e3cb60ed1ef27b60334'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:43.639813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 994/1988] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:43 2022] DELETE /identity/v3/users/fa53ebbd3d544e3cb60ed1ef27b60334 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:43.646854 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16051a8-c48a-48f8-87a1-0c381e226cde None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:43.647249 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16051a8-c48a-48f8-87a1-0c381e226cde None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:43.647567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16051a8-c48a-48f8-87a1-0c381e226cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:43.678194 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f16051a8-c48a-48f8-87a1-0c381e226cde None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:43.679456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f16051a8-c48a-48f8-87a1-0c381e226cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:43.689730 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:43.731965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583a559-cd6a-4300-9350-edc2b1e8bc3d admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:43.788724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 995/1989] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:43.800670 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16051a8-c48a-48f8-87a1-0c381e226cde None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:43.802512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f16051a8-c48a-48f8-87a1-0c381e226cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:43.816090 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7acd95a-02aa-4783-aaff-bc88d5654284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:43.816787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acd95a-02aa-4783-aaff-bc88d5654284 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:43.817076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acd95a-02aa-4783-aaff-bc88d5654284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:43.817352 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acd95a-02aa-4783-aaff-bc88d5654284 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:43.818021 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7acd95a-02aa-4783-aaff-bc88d5654284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:43.820316 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7acd95a-02aa-4783-aaff-bc88d5654284 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:43.838565 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:43.852903 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 995/1990] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:43 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:58:43.856806 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7acd95a-02aa-4783-aaff-bc88d5654284 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:43.859169 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f7acd95a-02aa-4783-aaff-bc88d5654284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:43.871113 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16051a8-c48a-48f8-87a1-0c381e226cde None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:43.871524 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7acd95a-02aa-4783-aaff-bc88d5654284 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:43.874860 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38dc93-0fae-40c4-b35c-573d834cb811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:43.875583 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38dc93-0fae-40c4-b35c-573d834cb811 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:43.875865 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38dc93-0fae-40c4-b35c-573d834cb811 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:43.876138 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38dc93-0fae-40c4-b35c-573d834cb811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:43.877200 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5c197-402b-40d8-9188-3d5a61d0e042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:43.877862 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5c197-402b-40d8-9188-3d5a61d0e042 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:43.878093 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5c197-402b-40d8-9188-3d5a61d0e042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:43.878365 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5c197-402b-40d8-9188-3d5a61d0e042 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:43.879263 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5c197-402b-40d8-9188-3d5a61d0e042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:43.880995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5c197-402b-40d8-9188-3d5a61d0e042 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:43.886428 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38dc93-0fae-40c4-b35c-573d834cb811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:43.888267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38dc93-0fae-40c4-b35c-573d834cb811 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:43.899496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 996/1991] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:43.899656 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 996/1992] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:58:43.904057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38dc93-0fae-40c4-b35c-573d834cb811 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:43.917506 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38dc93-0fae-40c4-b35c-573d834cb811 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:43.923689 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645a90e-8d79-4a47-8433-a87d76692d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:43.924315 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645a90e-8d79-4a47-8433-a87d76692d65 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:43.924739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645a90e-8d79-4a47-8433-a87d76692d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:43.924958 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645a90e-8d79-4a47-8433-a87d76692d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:43.925849 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645a90e-8d79-4a47-8433-a87d76692d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:43.927800 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645a90e-8d79-4a47-8433-a87d76692d65 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:43.941615 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 997/1993] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:58:43.946248 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5c197-402b-40d8-9188-3d5a61d0e042 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:43.958690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5c197-402b-40d8-9188-3d5a61d0e042 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:43.964169 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64404d-bece-4940-917d-58daaa451a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:43.964932 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64404d-bece-4940-917d-58daaa451a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:43.965277 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64404d-bece-4940-917d-58daaa451a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:43.965551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64404d-bece-4940-917d-58daaa451a22 admin admin] PATH_INFO: `/v3/projects/6a7dc9f1225e4bf1be128dcec462721b/users/c689916876134761af956502a23dac5a/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:43.988506 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64404d-bece-4940-917d-58daaa451a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a7dc9f1225e4bf1be128dcec462721b, user_id=c689916876134761af956502a23dac5a, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:43.992037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64404d-bece-4940-917d-58daaa451a22 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:44.010134 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 997/1994] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:43 2022] PUT /identity/v3/projects/6a7dc9f1225e4bf1be128dcec462721b/users/c689916876134761af956502a23dac5a/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:44.021086 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08f457-8a17-43f4-894c-ba16a8f44c9d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:44.021386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08f457-8a17-43f4-894c-ba16a8f44c9d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:44.021893 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08f457-8a17-43f4-894c-ba16a8f44c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:44.055144 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6e08f457-8a17-43f4-894c-ba16a8f44c9d None None] MFA Rules not processed for user `c689916876134761af956502a23dac5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:44.056440 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6e08f457-8a17-43f4-894c-ba16a8f44c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:44.153041 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 998/1995] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:44.157509 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64404d-bece-4940-917d-58daaa451a22 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:44.263094 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64404d-bece-4940-917d-58daaa451a22 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:44.268952 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f36b1c-bd19-451f-8207-f3b1f1b2b91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:44.269744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f36b1c-bd19-451f-8207-f3b1f1b2b91b admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:44.270036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f36b1c-bd19-451f-8207-f3b1f1b2b91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:44.270308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f36b1c-bd19-451f-8207-f3b1f1b2b91b admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:44.271058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f36b1c-bd19-451f-8207-f3b1f1b2b91b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:44.273617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f36b1c-bd19-451f-8207-f3b1f1b2b91b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:44.324552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08f457-8a17-43f4-894c-ba16a8f44c9d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:44.326424 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6e08f457-8a17-43f4-894c-ba16a8f44c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:44.331117 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 998/1996] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:44 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:44.332414 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f36b1c-bd19-451f-8207-f3b1f1b2b91b admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:44.349162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08f457-8a17-43f4-894c-ba16a8f44c9d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:44.407513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:44.440812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f36b1c-bd19-451f-8207-f3b1f1b2b91b admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:44.446929 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757eba72-dec9-4f19-932c-11ba318f23d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:44.447579 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757eba72-dec9-4f19-932c-11ba318f23d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:44.447869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757eba72-dec9-4f19-932c-11ba318f23d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:44.448141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757eba72-dec9-4f19-932c-11ba318f23d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:44.448805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757eba72-dec9-4f19-932c-11ba318f23d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:44.451107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757eba72-dec9-4f19-932c-11ba318f23d6 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:44.481592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 999/1997] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:44 2022] POST /identity/v3/users => generated 295 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:44.484258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757eba72-dec9-4f19-932c-11ba318f23d6 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:44.486786 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c80f19-69f3-43c2-b498-a45876615074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:44.487491 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c80f19-69f3-43c2-b498-a45876615074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:44.487774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c80f19-69f3-43c2-b498-a45876615074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:44.488047 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c80f19-69f3-43c2-b498-a45876615074 admin admin] PATH_INFO: `/v3/projects/d52a769c7bd44845b3b63256a8344ee2` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:44.489458 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c80f19-69f3-43c2-b498-a45876615074 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d52a769c7bd44845b3b63256a8344ee2)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:44.491456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c80f19-69f3-43c2-b498-a45876615074 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:44.505722 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757eba72-dec9-4f19-932c-11ba318f23d6 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:44.512420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ae100-0bc3-40fe-9635-b6557e6951f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:44.513375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ae100-0bc3-40fe-9635-b6557e6951f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:44.513834 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ae100-0bc3-40fe-9635-b6557e6951f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:44.514312 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ae100-0bc3-40fe-9635-b6557e6951f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:44.515129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ae100-0bc3-40fe-9635-b6557e6951f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:44.517275 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ae100-0bc3-40fe-9635-b6557e6951f6 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:44.530377 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1000/1998] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:44.535170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ae100-0bc3-40fe-9635-b6557e6951f6 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:44.545632 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ae100-0bc3-40fe-9635-b6557e6951f6 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:44.567366 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:44.568600 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-37c80f19-69f3-43c2-b498-a45876615074 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52a769c7bd44845b3b63256a8344ee2', 'request_id': 'req-37c80f19-69f3-43c2-b498-a45876615074'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:44.588511 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-37c80f19-69f3-43c2-b498-a45876615074 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52a769c7bd44845b3b63256a8344ee2', 'request_id': 'req-37c80f19-69f3-43c2-b498-a45876615074'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:44.598341 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-37c80f19-69f3-43c2-b498-a45876615074 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52a769c7bd44845b3b63256a8344ee2', 'request_id': 'req-37c80f19-69f3-43c2-b498-a45876615074'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:44.618012 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6909a2b-2217-4fff-8e16-44c8b16de431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:44.618709 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6909a2b-2217-4fff-8e16-44c8b16de431 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:44.619124 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6909a2b-2217-4fff-8e16-44c8b16de431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:44.619471 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6909a2b-2217-4fff-8e16-44c8b16de431 admin admin] PATH_INFO: `/v3/projects/0c81f5f4df2945cfaba5d9303271154e/users/6585b521c29a4315b12d955099c0e3b1/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:44.622455 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-37c80f19-69f3-43c2-b498-a45876615074 admin admin] The token cache is being invalidate because project d52a769c7bd44845b3b63256a8344ee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:44.623741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-37c80f19-69f3-43c2-b498-a45876615074 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:44.628274 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-37c80f19-69f3-43c2-b498-a45876615074 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:44.630718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 999/1999] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:44 2022] DELETE /identity/v3/projects/d52a769c7bd44845b3b63256a8344ee2 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:44.634892 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c80f19-69f3-43c2-b498-a45876615074 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:44.637422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-37c80f19-69f3-43c2-b498-a45876615074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:44.643293 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6909a2b-2217-4fff-8e16-44c8b16de431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c81f5f4df2945cfaba5d9303271154e, user_id=6585b521c29a4315b12d955099c0e3b1, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:44.646014 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6909a2b-2217-4fff-8e16-44c8b16de431 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:44.666292 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1001/2000] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:44 2022] PUT /identity/v3/projects/0c81f5f4df2945cfaba5d9303271154e/users/6585b521c29a4315b12d955099c0e3b1/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:44.667597 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c80f19-69f3-43c2-b498-a45876615074 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:44.670452 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6909a2b-2217-4fff-8e16-44c8b16de431 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:44.673330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e6909a2b-2217-4fff-8e16-44c8b16de431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:44.749107 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9216e8-a232-418d-98ad-1755473f6db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:44.749894 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9216e8-a232-418d-98ad-1755473f6db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:44.750237 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9216e8-a232-418d-98ad-1755473f6db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:44.750588 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9216e8-a232-418d-98ad-1755473f6db6 admin admin] PATH_INFO: `/v3/users/5a2cfa9061eb460f9b8d1793692708af` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:44.751885 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9216e8-a232-418d-98ad-1755473f6db6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a2cfa9061eb460f9b8d1793692708af)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:44.753974 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9216e8-a232-418d-98ad-1755473f6db6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:44.758854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6909a2b-2217-4fff-8e16-44c8b16de431 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:44.764195 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48701b3d-46dd-4424-9322-53570e670924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:44.764939 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48701b3d-46dd-4424-9322-53570e670924 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:44.765337 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48701b3d-46dd-4424-9322-53570e670924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:44.765667 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48701b3d-46dd-4424-9322-53570e670924 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:44.766373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48701b3d-46dd-4424-9322-53570e670924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:44.768113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48701b3d-46dd-4424-9322-53570e670924 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:44.778728 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1002/2001] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:58:44.783162 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48701b3d-46dd-4424-9322-53570e670924 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:44.793895 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48701b3d-46dd-4424-9322-53570e670924 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:44.802213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26ccc0-f453-430d-bec0-fc2c182533e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:44.802966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26ccc0-f453-430d-bec0-fc2c182533e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:44.803239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26ccc0-f453-430d-bec0-fc2c182533e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:44.803557 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26ccc0-f453-430d-bec0-fc2c182533e7 admin admin] PATH_INFO: `/v3/projects/0c81f5f4df2945cfaba5d9303271154e/users/6585b521c29a4315b12d955099c0e3b1/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:44.805938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26ccc0-f453-430d-bec0-fc2c182533e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c81f5f4df2945cfaba5d9303271154e, user_id=6585b521c29a4315b12d955099c0e3b1, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:44.808820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26ccc0-f453-430d-bec0-fc2c182533e7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:44.811024 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ea9216e8-a232-418d-98ad-1755473f6db6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a2cfa9061eb460f9b8d1793692708af'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:44.819122 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ea9216e8-a232-418d-98ad-1755473f6db6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a2cfa9061eb460f9b8d1793692708af'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:44.821952 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1003/2002] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:44 2022] PUT /identity/v3/projects/0c81f5f4df2945cfaba5d9303271154e/users/6585b521c29a4315b12d955099c0e3b1/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:44.827669 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ea9216e8-a232-418d-98ad-1755473f6db6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a2cfa9061eb460f9b8d1793692708af'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:44.834157 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef666b-ca1d-4a7d-abad-bc002ec571b4 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:44.834469 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:44.834889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef666b-ca1d-4a7d-abad-bc002ec571b4 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:44.835163 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef666b-ca1d-4a7d-abad-bc002ec571b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:44.852754 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ea9216e8-a232-418d-98ad-1755473f6db6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a2cfa9061eb460f9b8d1793692708af'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:44.853822 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ea9216e8-a232-418d-98ad-1755473f6db6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a2cfa9061eb460f9b8d1793692708af'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:44.861424 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1000/2003] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:44 2022] DELETE /identity/v3/users/5a2cfa9061eb460f9b8d1793692708af => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:44.868587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-6aef666b-ca1d-4a7d-abad-bc002ec571b4 None None] MFA Rules not processed for user `6585b521c29a4315b12d955099c0e3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:44.870143 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6aef666b-ca1d-4a7d-abad-bc002ec571b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:44.997347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1004/2004] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:45.009250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9216e8-a232-418d-98ad-1755473f6db6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:45.011079 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ea9216e8-a232-418d-98ad-1755473f6db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:45.089211 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9216e8-a232-418d-98ad-1755473f6db6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:45.094640 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265eb5e8-3e06-43b9-894e-8bda652efcbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:45.095969 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265eb5e8-3e06-43b9-894e-8bda652efcbc service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:45.096311 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265eb5e8-3e06-43b9-894e-8bda652efcbc service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:45.096701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265eb5e8-3e06-43b9-894e-8bda652efcbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:45.099605 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-265eb5e8-3e06-43b9-894e-8bda652efcbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:45.229932 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef666b-ca1d-4a7d-abad-bc002ec571b4 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:45.231681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6aef666b-ca1d-4a7d-abad-bc002ec571b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:45.255018 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:45.260733 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265eb5e8-3e06-43b9-894e-8bda652efcbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:45.264767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265eb5e8-3e06-43b9-894e-8bda652efcbc service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:45.280680 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1001/2005] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:45.327475 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef666b-ca1d-4a7d-abad-bc002ec571b4 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:45.333748 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a9708-9214-49e6-ba53-6cd86a442fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:45.335820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a9708-9214-49e6-ba53-6cd86a442fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:45.336111 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a9708-9214-49e6-ba53-6cd86a442fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:45.336389 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a9708-9214-49e6-ba53-6cd86a442fd8 admin admin] PATH_INFO: `/v3/projects/7e3c0809cc69445a8074f5e641c655ae` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:45.337586 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a9708-9214-49e6-ba53-6cd86a442fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e3c0809cc69445a8074f5e641c655ae)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:45.339551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a9708-9214-49e6-ba53-6cd86a442fd8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:45.398038 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-620a9708-9214-49e6-ba53-6cd86a442fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e3c0809cc69445a8074f5e641c655ae', 'request_id': 'req-620a9708-9214-49e6-ba53-6cd86a442fd8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:45.406711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-620a9708-9214-49e6-ba53-6cd86a442fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e3c0809cc69445a8074f5e641c655ae', 'request_id': 'req-620a9708-9214-49e6-ba53-6cd86a442fd8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:45.413720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-620a9708-9214-49e6-ba53-6cd86a442fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e3c0809cc69445a8074f5e641c655ae', 'request_id': 'req-620a9708-9214-49e6-ba53-6cd86a442fd8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:45.429000 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-620a9708-9214-49e6-ba53-6cd86a442fd8 admin admin] The token cache is being invalidate because project 7e3c0809cc69445a8074f5e641c655ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:45.429360 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-620a9708-9214-49e6-ba53-6cd86a442fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:45.430462 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-620a9708-9214-49e6-ba53-6cd86a442fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:45.432704 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1005/2006] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:45 2022] DELETE /identity/v3/projects/7e3c0809cc69445a8074f5e641c655ae => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:45.438325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83f5a4-17e0-4f04-afc9-da24ae6ad84d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:45.438914 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83f5a4-17e0-4f04-afc9-da24ae6ad84d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:45.439197 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83f5a4-17e0-4f04-afc9-da24ae6ad84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:45.468486 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ce83f5a4-17e0-4f04-afc9-da24ae6ad84d None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:45.470124 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ce83f5a4-17e0-4f04-afc9-da24ae6ad84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:45.572339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1002/2007] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:45.575234 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e9841-63be-4d96-8a40-415fb04c579d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:45.575556 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e9841-63be-4d96-8a40-415fb04c579d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:45.575827 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e9841-63be-4d96-8a40-415fb04c579d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:45.602704 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a27e9841-63be-4d96-8a40-415fb04c579d None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:45.604545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a27e9841-63be-4d96-8a40-415fb04c579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:45.621854 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1006/2008] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:45.627092 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83f5a4-17e0-4f04-afc9-da24ae6ad84d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:45.637892 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83f5a4-17e0-4f04-afc9-da24ae6ad84d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:45.642988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6df53-c6cd-4124-91d0-712903d21afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:45.643846 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6df53-c6cd-4124-91d0-712903d21afc admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:45.644075 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6df53-c6cd-4124-91d0-712903d21afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:45.645520 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6df53-c6cd-4124-91d0-712903d21afc admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:45.645520 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6df53-c6cd-4124-91d0-712903d21afc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:45.645520 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6df53-c6cd-4124-91d0-712903d21afc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:45.647395 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6df53-c6cd-4124-91d0-712903d21afc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:45.660488 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1003/2009] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:58:45.664924 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e9841-63be-4d96-8a40-415fb04c579d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:45.675846 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e9841-63be-4d96-8a40-415fb04c579d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:45.680611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb4abe-1929-45fa-a42e-a6421ca72894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:45.681238 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb4abe-1929-45fa-a42e-a6421ca72894 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:45.681586 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb4abe-1929-45fa-a42e-a6421ca72894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:45.681849 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb4abe-1929-45fa-a42e-a6421ca72894 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:45.682571 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb4abe-1929-45fa-a42e-a6421ca72894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:45.684682 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb4abe-1929-45fa-a42e-a6421ca72894 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:45.725445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1007/2010] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:45 2022] POST /identity/v3/projects => generated 409 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:45.730113 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6df53-c6cd-4124-91d0-712903d21afc admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:45.743720 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6df53-c6cd-4124-91d0-712903d21afc admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:45.772219 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:45.812418 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe38bd-f32c-4a84-8620-9771aafd9879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:45.813852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe38bd-f32c-4a84-8620-9771aafd9879 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:45.813978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe38bd-f32c-4a84-8620-9771aafd9879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:45.814250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe38bd-f32c-4a84-8620-9771aafd9879 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:45.814892 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe38bd-f32c-4a84-8620-9771aafd9879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:45.817048 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe38bd-f32c-4a84-8620-9771aafd9879 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:45.847416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1004/2011] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:45 2022] POST /identity/v3/users => generated 305 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:45.849207 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb4abe-1929-45fa-a42e-a6421ca72894 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:45.862044 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb4abe-1929-45fa-a42e-a6421ca72894 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:45.869356 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e473b68-8ea1-4611-a733-cd948bbf53cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:45.869985 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e473b68-8ea1-4611-a733-cd948bbf53cb admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:45.870264 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e473b68-8ea1-4611-a733-cd948bbf53cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:45.870537 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e473b68-8ea1-4611-a733-cd948bbf53cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:45.871233 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e473b68-8ea1-4611-a733-cd948bbf53cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:45.873083 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e473b68-8ea1-4611-a733-cd948bbf53cb admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:45.885439 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1008/2012] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:45.889618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe38bd-f32c-4a84-8620-9771aafd9879 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:45.901474 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe38bd-f32c-4a84-8620-9771aafd9879 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:45.907789 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca3b20-d9cf-4025-b381-232f7c6e0c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:45.908469 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca3b20-d9cf-4025-b381-232f7c6e0c80 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:45.909165 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca3b20-d9cf-4025-b381-232f7c6e0c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:45.909165 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca3b20-d9cf-4025-b381-232f7c6e0c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:45.909763 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca3b20-d9cf-4025-b381-232f7c6e0c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:45.911946 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca3b20-d9cf-4025-b381-232f7c6e0c80 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:45.926500 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1005/2013] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:45.930766 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e473b68-8ea1-4611-a733-cd948bbf53cb admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:45.943151 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e473b68-8ea1-4611-a733-cd948bbf53cb admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:45.948213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad05e7c-c810-4eb0-98bb-77544e623b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:45.949061 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad05e7c-c810-4eb0-98bb-77544e623b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:45.949346 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad05e7c-c810-4eb0-98bb-77544e623b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:45.949619 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad05e7c-c810-4eb0-98bb-77544e623b57 admin admin] PATH_INFO: `/v3/projects/03ed88c3e9384a42a5ecb28a0860dc7e/users/201e588e3d864503a4a6d1b2a66da436/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:45.964895 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad05e7c-c810-4eb0-98bb-77544e623b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ed88c3e9384a42a5ecb28a0860dc7e, user_id=201e588e3d864503a4a6d1b2a66da436, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:45.967719 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad05e7c-c810-4eb0-98bb-77544e623b57 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:45.982255 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1009/2014] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:45 2022] PUT /identity/v3/projects/03ed88c3e9384a42a5ecb28a0860dc7e/users/201e588e3d864503a4a6d1b2a66da436/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:45.993968 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b175a37-fc7f-4330-8c04-ae84fd057fbd None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:45.994253 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b175a37-fc7f-4330-8c04-ae84fd057fbd None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:45.994520 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b175a37-fc7f-4330-8c04-ae84fd057fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.025568 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9b175a37-fc7f-4330-8c04-ae84fd057fbd None None] MFA Rules not processed for user `201e588e3d864503a4a6d1b2a66da436`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:46.026778 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9b175a37-fc7f-4330-8c04-ae84fd057fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:46.096259 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1006/2015] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:45 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:46.101764 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad05e7c-c810-4eb0-98bb-77544e623b57 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:46.151532 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:46.173966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad05e7c-c810-4eb0-98bb-77544e623b57 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:46.178967 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affec4b6-dad8-486e-8d20-7b11fe6b194a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:46.179623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affec4b6-dad8-486e-8d20-7b11fe6b194a admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:46.179899 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affec4b6-dad8-486e-8d20-7b11fe6b194a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:46.180169 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affec4b6-dad8-486e-8d20-7b11fe6b194a admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.180802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affec4b6-dad8-486e-8d20-7b11fe6b194a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:46.182773 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affec4b6-dad8-486e-8d20-7b11fe6b194a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:46.210835 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1010/2016] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:46 2022] POST /identity/v3/projects => generated 407 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:58:46.214977 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b175a37-fc7f-4330-8c04-ae84fd057fbd None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:46.226072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b175a37-fc7f-4330-8c04-ae84fd057fbd None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:46.299939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58e77a-4016-41da-a931-17814f0d7ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:46.300559 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58e77a-4016-41da-a931-17814f0d7ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:46.300840 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58e77a-4016-41da-a931-17814f0d7ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:46.301110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58e77a-4016-41da-a931-17814f0d7ce2 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.301750 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58e77a-4016-41da-a931-17814f0d7ce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:46.303715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58e77a-4016-41da-a931-17814f0d7ce2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:46.330305 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1007/2017] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:46 2022] POST /identity/v3/users => generated 310 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:58:46.331877 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affec4b6-dad8-486e-8d20-7b11fe6b194a admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:46.344077 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affec4b6-dad8-486e-8d20-7b11fe6b194a admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:46.349806 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f804e-e789-4df1-b4f8-dd822f8aae21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:46.350443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f804e-e789-4df1-b4f8-dd822f8aae21 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:46.350721 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f804e-e789-4df1-b4f8-dd822f8aae21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:46.351022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f804e-e789-4df1-b4f8-dd822f8aae21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.352046 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f804e-e789-4df1-b4f8-dd822f8aae21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:46.353971 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f804e-e789-4df1-b4f8-dd822f8aae21 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:46.369309 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1011/2018] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:46.374133 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58e77a-4016-41da-a931-17814f0d7ce2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:46.384771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58e77a-4016-41da-a931-17814f0d7ce2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:46.390207 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d20b2-7513-46f0-8ecb-28e8c06156ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:46.390892 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d20b2-7513-46f0-8ecb-28e8c06156ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:46.391280 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d20b2-7513-46f0-8ecb-28e8c06156ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:46.391693 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d20b2-7513-46f0-8ecb-28e8c06156ee admin admin] PATH_INFO: `/v3/projects/67555e44780d411cab094b9532a6b02f/users/d49bb40b904947358863ef8abee2799a/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.410630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d20b2-7513-46f0-8ecb-28e8c06156ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=67555e44780d411cab094b9532a6b02f, user_id=d49bb40b904947358863ef8abee2799a, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:46.413473 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d20b2-7513-46f0-8ecb-28e8c06156ee admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:46.424696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:46.430308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1008/2019] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:46 2022] PUT /identity/v3/projects/67555e44780d411cab094b9532a6b02f/users/d49bb40b904947358863ef8abee2799a/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:46.434308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f804e-e789-4df1-b4f8-dd822f8aae21 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:46.446258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f804e-e789-4df1-b4f8-dd822f8aae21 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:46.519704 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db7593-387f-4175-8e52-206a2d9a4b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:46.520644 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db7593-387f-4175-8e52-206a2d9a4b13 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:46.520928 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db7593-387f-4175-8e52-206a2d9a4b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:46.521196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db7593-387f-4175-8e52-206a2d9a4b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.522579 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db7593-387f-4175-8e52-206a2d9a4b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:46.524240 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db7593-387f-4175-8e52-206a2d9a4b13 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:46.535532 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1012/2020] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:46.540373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d20b2-7513-46f0-8ecb-28e8c06156ee admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:46.551549 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d20b2-7513-46f0-8ecb-28e8c06156ee admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:46.557035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62fa69-0c0e-40f2-b847-95b8faf65e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:46.557853 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62fa69-0c0e-40f2-b847-95b8faf65e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:46.558116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62fa69-0c0e-40f2-b847-95b8faf65e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:46.558410 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62fa69-0c0e-40f2-b847-95b8faf65e18 admin admin] PATH_INFO: `/v3/projects/67555e44780d411cab094b9532a6b02f/users/d49bb40b904947358863ef8abee2799a/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.560536 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62fa69-0c0e-40f2-b847-95b8faf65e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67555e44780d411cab094b9532a6b02f, user_id=d49bb40b904947358863ef8abee2799a, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:46.564229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62fa69-0c0e-40f2-b847-95b8faf65e18 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:46.577384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1009/2021] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:46 2022] PUT /identity/v3/projects/67555e44780d411cab094b9532a6b02f/users/d49bb40b904947358863ef8abee2799a/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:46.587862 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a2076-c858-4a67-bbbe-66d707075712 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:46.588148 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a2076-c858-4a67-bbbe-66d707075712 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:46.588804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a2076-c858-4a67-bbbe-66d707075712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.637693 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e30a2076-c858-4a67-bbbe-66d707075712 None None] MFA Rules not processed for user `d49bb40b904947358863ef8abee2799a`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:46.639800 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e30a2076-c858-4a67-bbbe-66d707075712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:46.731095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1013/2022] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:46 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:46.743015 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62fa69-0c0e-40f2-b847-95b8faf65e18 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:46.744654 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9f62fa69-0c0e-40f2-b847-95b8faf65e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:46.827437 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62fa69-0c0e-40f2-b847-95b8faf65e18 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:46.836874 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88cc30-0df0-4a00-87d3-af6284b5738b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:46.839206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88cc30-0df0-4a00-87d3-af6284b5738b service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:46.839549 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88cc30-0df0-4a00-87d3-af6284b5738b service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:46.839815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88cc30-0df0-4a00-87d3-af6284b5738b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.852589 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88cc30-0df0-4a00-87d3-af6284b5738b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:46.854849 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88cc30-0df0-4a00-87d3-af6284b5738b service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:46.866137 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1010/2023] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:46 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:46.919288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a2076-c858-4a67-bbbe-66d707075712 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:46.928950 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e30a2076-c858-4a67-bbbe-66d707075712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:46.942789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a2076-c858-4a67-bbbe-66d707075712 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:46.946428 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b38451-e61e-41f5-9f61-4238e3300e81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:46.947049 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b38451-e61e-41f5-9f61-4238e3300e81 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:46.947327 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b38451-e61e-41f5-9f61-4238e3300e81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:46.947632 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b38451-e61e-41f5-9f61-4238e3300e81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:46.952768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-38b38451-e61e-41f5-9f61-4238e3300e81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:46.991531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:47.023509 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b38451-e61e-41f5-9f61-4238e3300e81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:47.024975 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b38451-e61e-41f5-9f61-4238e3300e81 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:47.040424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1014/2024] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:47.055070 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88cc30-0df0-4a00-87d3-af6284b5738b service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:47.065970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88cc30-0df0-4a00-87d3-af6284b5738b service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:47.069893 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e660e6-0425-4ad7-a2e0-5d2e9d886110 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:47.070666 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e660e6-0425-4ad7-a2e0-5d2e9d886110 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:47.070906 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e660e6-0425-4ad7-a2e0-5d2e9d886110 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:47.071174 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e660e6-0425-4ad7-a2e0-5d2e9d886110 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:47.138567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e660e6-0425-4ad7-a2e0-5d2e9d886110 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:47.140550 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e660e6-0425-4ad7-a2e0-5d2e9d886110 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:47.151478 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1011/2025] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:47 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:47.972635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b38451-e61e-41f5-9f61-4238e3300e81 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:47.982205 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b38451-e61e-41f5-9f61-4238e3300e81 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:47.987252 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5060e99-c7dd-4d93-9fbd-69859ce1bcbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:47.988018 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5060e99-c7dd-4d93-9fbd-69859ce1bcbb service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:47.988478 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5060e99-c7dd-4d93-9fbd-69859ce1bcbb service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:47.988843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5060e99-c7dd-4d93-9fbd-69859ce1bcbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:47.991129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e5060e99-c7dd-4d93-9fbd-69859ce1bcbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:48.084356 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5060e99-c7dd-4d93-9fbd-69859ce1bcbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:48.086379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5060e99-c7dd-4d93-9fbd-69859ce1bcbb service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:48.115090 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1015/2026] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:49.139181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e660e6-0425-4ad7-a2e0-5d2e9d886110 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:49.141348 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f3e660e6-0425-4ad7-a2e0-5d2e9d886110 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:49.276819 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e660e6-0425-4ad7-a2e0-5d2e9d886110 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:49.285866 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1c46f-77f5-43e1-a72a-ad69c16c055e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:49.286638 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1c46f-77f5-43e1-a72a-ad69c16c055e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:49.287719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1c46f-77f5-43e1-a72a-ad69c16c055e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:49.288766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1c46f-77f5-43e1-a72a-ad69c16c055e admin admin] PATH_INFO: `/v3/users/1e9c34804ffe423f93d1f3537b5f19a1` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:49.290963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1c46f-77f5-43e1-a72a-ad69c16c055e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e9c34804ffe423f93d1f3537b5f19a1)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:49.298275 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1c46f-77f5-43e1-a72a-ad69c16c055e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:49.358834 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5060e99-c7dd-4d93-9fbd-69859ce1bcbb service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:49.358834 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e5060e99-c7dd-4d93-9fbd-69859ce1bcbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:49.364225 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:49.382138 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5060e99-c7dd-4d93-9fbd-69859ce1bcbb service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:49.389744 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f9f1c46f-77f5-43e1-a72a-ad69c16c055e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e9c34804ffe423f93d1f3537b5f19a1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:49.397919 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f9f1c46f-77f5-43e1-a72a-ad69c16c055e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e9c34804ffe423f93d1f3537b5f19a1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:49.398164 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139c09b-b7d6-49ec-8bc4-503b9e7d0892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:49.398947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139c09b-b7d6-49ec-8bc4-503b9e7d0892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:49.399324 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139c09b-b7d6-49ec-8bc4-503b9e7d0892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:49.399710 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139c09b-b7d6-49ec-8bc4-503b9e7d0892 admin admin] PATH_INFO: `/v3/users/2e7057de36d74e268854f1bbbaaaeb60` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:49.402554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139c09b-b7d6-49ec-8bc4-503b9e7d0892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e7057de36d74e268854f1bbbaaaeb60)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:49.404680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139c09b-b7d6-49ec-8bc4-503b9e7d0892 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:49.407710 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f9f1c46f-77f5-43e1-a72a-ad69c16c055e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e9c34804ffe423f93d1f3537b5f19a1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:49.426952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f9f1c46f-77f5-43e1-a72a-ad69c16c055e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e9c34804ffe423f93d1f3537b5f19a1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:49.428771 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f9f1c46f-77f5-43e1-a72a-ad69c16c055e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e9c34804ffe423f93d1f3537b5f19a1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:49.440994 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1012/2027] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:49 2022] DELETE /identity/v3/users/1e9c34804ffe423f93d1f3537b5f19a1 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:49.445911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed680d-c98e-4f38-a53b-3834de635228 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:49.446286 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed680d-c98e-4f38-a53b-3834de635228 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:49.446681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed680d-c98e-4f38-a53b-3834de635228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:49.480410 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3fed680d-c98e-4f38-a53b-3834de635228 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:49.482038 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3fed680d-c98e-4f38-a53b-3834de635228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:49.506423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b139c09b-b7d6-49ec-8bc4-503b9e7d0892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e7057de36d74e268854f1bbbaaaeb60'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:49.517308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b139c09b-b7d6-49ec-8bc4-503b9e7d0892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e7057de36d74e268854f1bbbaaaeb60'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:49.529195 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b139c09b-b7d6-49ec-8bc4-503b9e7d0892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e7057de36d74e268854f1bbbaaaeb60'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:49.530999 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b139c09b-b7d6-49ec-8bc4-503b9e7d0892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e7057de36d74e268854f1bbbaaaeb60'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:49.566202 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b139c09b-b7d6-49ec-8bc4-503b9e7d0892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e7057de36d74e268854f1bbbaaaeb60'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:49.579005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1013/2028] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:49.590821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1016/2029] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:49 2022] DELETE /identity/v3/users/2e7057de36d74e268854f1bbbaaaeb60 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:49.591920 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed680d-c98e-4f38-a53b-3834de635228 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:49.594862 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3fed680d-c98e-4f38-a53b-3834de635228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:49.595736 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad3b70-73c1-4af0-9153-7da4bb4b8120 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:49.596308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad3b70-73c1-4af0-9153-7da4bb4b8120 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:49.596800 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad3b70-73c1-4af0-9153-7da4bb4b8120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:49.632683 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-fcad3b70-73c1-4af0-9153-7da4bb4b8120 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:49.633896 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-fcad3b70-73c1-4af0-9153-7da4bb4b8120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:49.679038 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:49.712076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed680d-c98e-4f38-a53b-3834de635228 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:49.717272 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1017/2030] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:49.724713 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad3b70-73c1-4af0-9153-7da4bb4b8120 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:49.806327 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad3b70-73c1-4af0-9153-7da4bb4b8120 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:49.806712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3751976-7b99-41b0-b6c7-8d22a2d48d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:49.806712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3751976-7b99-41b0-b6c7-8d22a2d48d8a service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:49.806712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3751976-7b99-41b0-b6c7-8d22a2d48d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:49.806712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3751976-7b99-41b0-b6c7-8d22a2d48d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:49.806980 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269c1a1-d03b-4215-812c-af4b0fe5bfac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:49.806980 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269c1a1-d03b-4215-812c-af4b0fe5bfac service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:49.806980 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269c1a1-d03b-4215-812c-af4b0fe5bfac service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:49.806980 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269c1a1-d03b-4215-812c-af4b0fe5bfac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:49.813287 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269c1a1-d03b-4215-812c-af4b0fe5bfac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:49.815880 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269c1a1-d03b-4215-812c-af4b0fe5bfac service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:49.817549 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3751976-7b99-41b0-b6c7-8d22a2d48d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:49.818951 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3751976-7b99-41b0-b6c7-8d22a2d48d8a service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:49.839270 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1018/2031] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:58:49.844293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1014/2032] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:58:50.206499 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6fe4e-0034-4bff-8e10-cccd81d01834 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:50.206914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6fe4e-0034-4bff-8e10-cccd81d01834 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:50.207297 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6fe4e-0034-4bff-8e10-cccd81d01834 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:50.209105 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1019/2033] 10.222.0.27 () {54 vars in 921 bytes} [Tue Aug 30 11:58:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:58:50.258781 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8961ec2-cc02-4122-b49a-5d6aa95ebd42 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:50.259712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8961ec2-cc02-4122-b49a-5d6aa95ebd42 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:50.260625 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8961ec2-cc02-4122-b49a-5d6aa95ebd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:50.294531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:50.307539 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d8961ec2-cc02-4122-b49a-5d6aa95ebd42 None None] MFA Rules not processed for user `9efd2ac7fc4a42558e8dc48c408ce525`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:50.309003 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d8961ec2-cc02-4122-b49a-5d6aa95ebd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:50.312496 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6fe4e-0034-4bff-8e10-cccd81d01834 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:50.314604 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c0d6fe4e-0034-4bff-8e10-cccd81d01834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:50.344628 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6fe4e-0034-4bff-8e10-cccd81d01834 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:50.357054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24534efb-891b-4c7a-8dec-bddd84435f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:50.358045 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24534efb-891b-4c7a-8dec-bddd84435f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:50.358339 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24534efb-891b-4c7a-8dec-bddd84435f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:50.358617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24534efb-891b-4c7a-8dec-bddd84435f2f admin admin] PATH_INFO: `/v3/users/4086920bf3624371a3d0444d592feb47` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:50.361446 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24534efb-891b-4c7a-8dec-bddd84435f2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4086920bf3624371a3d0444d592feb47)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:50.363440 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24534efb-891b-4c7a-8dec-bddd84435f2f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:50.461556 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1015/2034] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Aug 30 11:58:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:50.463380 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8961ec2-cc02-4122-b49a-5d6aa95ebd42 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:50.465426 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d8961ec2-cc02-4122-b49a-5d6aa95ebd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:50.467264 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-24534efb-891b-4c7a-8dec-bddd84435f2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4086920bf3624371a3d0444d592feb47'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.477438 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-24534efb-891b-4c7a-8dec-bddd84435f2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4086920bf3624371a3d0444d592feb47'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.484942 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8961ec2-cc02-4122-b49a-5d6aa95ebd42 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:50.488788 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-24534efb-891b-4c7a-8dec-bddd84435f2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4086920bf3624371a3d0444d592feb47'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.489825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-24534efb-891b-4c7a-8dec-bddd84435f2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4086920bf3624371a3d0444d592feb47'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.490580 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ef703-772c-4636-b5a1-59d205ac6bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:50.491734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ef703-772c-4636-b5a1-59d205ac6bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:50.492021 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ef703-772c-4636-b5a1-59d205ac6bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:50.492290 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ef703-772c-4636-b5a1-59d205ac6bfa admin admin] PATH_INFO: `/v3/projects/c31245b4ec5144a5b6b5e6e6e581957e` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:50.493683 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ef703-772c-4636-b5a1-59d205ac6bfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c31245b4ec5144a5b6b5e6e6e581957e)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:50.495818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ef703-772c-4636-b5a1-59d205ac6bfa admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:50.507182 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-24534efb-891b-4c7a-8dec-bddd84435f2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4086920bf3624371a3d0444d592feb47'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.516120 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1020/2035] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:50 2022] DELETE /identity/v3/users/4086920bf3624371a3d0444d592feb47 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:50.520415 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24534efb-891b-4c7a-8dec-bddd84435f2f admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:50.522477 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-24534efb-891b-4c7a-8dec-bddd84435f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:50.572659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5e1ef703-772c-4636-b5a1-59d205ac6bfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c31245b4ec5144a5b6b5e6e6e581957e', 'request_id': 'req-5e1ef703-772c-4636-b5a1-59d205ac6bfa'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.585502 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5e1ef703-772c-4636-b5a1-59d205ac6bfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c31245b4ec5144a5b6b5e6e6e581957e', 'request_id': 'req-5e1ef703-772c-4636-b5a1-59d205ac6bfa'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.593481 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5e1ef703-772c-4636-b5a1-59d205ac6bfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c31245b4ec5144a5b6b5e6e6e581957e', 'request_id': 'req-5e1ef703-772c-4636-b5a1-59d205ac6bfa'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.607493 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5e1ef703-772c-4636-b5a1-59d205ac6bfa admin admin] The token cache is being invalidate because project c31245b4ec5144a5b6b5e6e6e581957e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:50.607869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5e1ef703-772c-4636-b5a1-59d205ac6bfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.608484 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5e1ef703-772c-4636-b5a1-59d205ac6bfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.610803 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1016/2036] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:50 2022] DELETE /identity/v3/projects/c31245b4ec5144a5b6b5e6e6e581957e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:50.616140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:50.618431 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ef703-772c-4636-b5a1-59d205ac6bfa admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:50.620021 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24534efb-891b-4c7a-8dec-bddd84435f2f admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:50.620386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5e1ef703-772c-4636-b5a1-59d205ac6bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:50.737780 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae1c1b-7f83-42a6-99b5-cf0352b63873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:50.738703 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae1c1b-7f83-42a6-99b5-cf0352b63873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:50.739414 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae1c1b-7f83-42a6-99b5-cf0352b63873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:50.739932 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae1c1b-7f83-42a6-99b5-cf0352b63873 admin admin] PATH_INFO: `/v3/projects/2f69f78ac13c4fc0966eaae660a12fcf` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:50.741605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae1c1b-7f83-42a6-99b5-cf0352b63873 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f69f78ac13c4fc0966eaae660a12fcf)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:50.743666 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae1c1b-7f83-42a6-99b5-cf0352b63873 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:50.758703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ef703-772c-4636-b5a1-59d205ac6bfa admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:50.763135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628dcaf5-f93d-4de5-84f9-c5ca0b72b290 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9efd2ac7fc4a42558e8dc48c408ce525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:50.763905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628dcaf5-f93d-4de5-84f9-c5ca0b72b290 service placement] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:50.764286 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628dcaf5-f93d-4de5-84f9-c5ca0b72b290 service placement] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:50.764682 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628dcaf5-f93d-4de5-84f9-c5ca0b72b290 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:50.766761 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-628dcaf5-f93d-4de5-84f9-c5ca0b72b290 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:50.784546 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628dcaf5-f93d-4de5-84f9-c5ca0b72b290 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:50.788884 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628dcaf5-f93d-4de5-84f9-c5ca0b72b290 service placement] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:50.802181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1017/2037] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:50.803211 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218017e-5008-475c-bb27-95c61eb925e9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:50.803549 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218017e-5008-475c-bb27-95c61eb925e9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:50.804141 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218017e-5008-475c-bb27-95c61eb925e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:50.829988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-afae1c1b-7f83-42a6-99b5-cf0352b63873 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f69f78ac13c4fc0966eaae660a12fcf', 'request_id': 'req-afae1c1b-7f83-42a6-99b5-cf0352b63873'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.842846 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-afae1c1b-7f83-42a6-99b5-cf0352b63873 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f69f78ac13c4fc0966eaae660a12fcf', 'request_id': 'req-afae1c1b-7f83-42a6-99b5-cf0352b63873'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.845839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b218017e-5008-475c-bb27-95c61eb925e9 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:50.848103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b218017e-5008-475c-bb27-95c61eb925e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:50.853400 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-afae1c1b-7f83-42a6-99b5-cf0352b63873 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f69f78ac13c4fc0966eaae660a12fcf', 'request_id': 'req-afae1c1b-7f83-42a6-99b5-cf0352b63873'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.881851 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:50.883616 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-afae1c1b-7f83-42a6-99b5-cf0352b63873 admin admin] The token cache is being invalidate because project 2f69f78ac13c4fc0966eaae660a12fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:50.883918 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-afae1c1b-7f83-42a6-99b5-cf0352b63873 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.884785 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-afae1c1b-7f83-42a6-99b5-cf0352b63873 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:50.889180 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1021/2038] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:50 2022] DELETE /identity/v3/projects/2f69f78ac13c4fc0966eaae660a12fcf => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:50.890695 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae1c1b-7f83-42a6-99b5-cf0352b63873 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:50.894431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-afae1c1b-7f83-42a6-99b5-cf0352b63873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:51.029210 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1018/2039] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:51.029210 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d9f6b-30f6-4144-a581-46fd2ef67116 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.029210 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d9f6b-30f6-4144-a581-46fd2ef67116 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.029210 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d9f6b-30f6-4144-a581-46fd2ef67116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.029674 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae1c1b-7f83-42a6-99b5-cf0352b63873 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.037089 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7928fd-6b3e-429d-aaa4-0c18d127f5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.038542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7928fd-6b3e-429d-aaa4-0c18d127f5c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.039074 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7928fd-6b3e-429d-aaa4-0c18d127f5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.039773 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7928fd-6b3e-429d-aaa4-0c18d127f5c3 admin admin] PATH_INFO: `/v3/projects/45407588871f437e9ad620b9637cd08f` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.041460 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7928fd-6b3e-429d-aaa4-0c18d127f5c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45407588871f437e9ad620b9637cd08f)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.044670 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7928fd-6b3e-429d-aaa4-0c18d127f5c3 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.057490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-079d9f6b-30f6-4144-a581-46fd2ef67116 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:51.059334 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-079d9f6b-30f6-4144-a581-46fd2ef67116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:51.072028 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1019/2040] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:51.074071 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5a631-1ca4-4113-a111-de73991d3994 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.074537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5a631-1ca4-4113-a111-de73991d3994 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.075031 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5a631-1ca4-4113-a111-de73991d3994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.108126 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c1f5a631-1ca4-4113-a111-de73991d3994 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:51.110533 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c1f5a631-1ca4-4113-a111-de73991d3994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:51.122118 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:51.140925 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ed7928fd-6b3e-429d-aaa4-0c18d127f5c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45407588871f437e9ad620b9637cd08f', 'request_id': 'req-ed7928fd-6b3e-429d-aaa4-0c18d127f5c3'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:51.152622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ed7928fd-6b3e-429d-aaa4-0c18d127f5c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45407588871f437e9ad620b9637cd08f', 'request_id': 'req-ed7928fd-6b3e-429d-aaa4-0c18d127f5c3'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:51.160876 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ed7928fd-6b3e-429d-aaa4-0c18d127f5c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45407588871f437e9ad620b9637cd08f', 'request_id': 'req-ed7928fd-6b3e-429d-aaa4-0c18d127f5c3'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:51.178217 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ed7928fd-6b3e-429d-aaa4-0c18d127f5c3 admin admin] The token cache is being invalidate because project 45407588871f437e9ad620b9637cd08f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:51.178514 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ed7928fd-6b3e-429d-aaa4-0c18d127f5c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:51.179540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ed7928fd-6b3e-429d-aaa4-0c18d127f5c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:51.181194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1022/2041] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:50 2022] DELETE /identity/v3/projects/45407588871f437e9ad620b9637cd08f => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:51.182643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd8303-41df-49c9-ad50-b2e69ca89702 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.183015 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd8303-41df-49c9-ad50-b2e69ca89702 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.184020 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd8303-41df-49c9-ad50-b2e69ca89702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.197037 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1020/2042] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:51.198349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9f8a2-bcb1-4e34-9b25-210005a596eb None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.198834 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9f8a2-bcb1-4e34-9b25-210005a596eb None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.199109 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9f8a2-bcb1-4e34-9b25-210005a596eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.208398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-1afd8303-41df-49c9-ad50-b2e69ca89702 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:51.209790 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1afd8303-41df-49c9-ad50-b2e69ca89702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:51.218035 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1023/2043] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:51.219124 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd8303-41df-49c9-ad50-b2e69ca89702 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.219552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-fdb9f8a2-bcb1-4e34-9b25-210005a596eb None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:51.220734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fdb9f8a2-bcb1-4e34-9b25-210005a596eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:51.236262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1021/2044] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:51.236461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd8303-41df-49c9-ad50-b2e69ca89702 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.236570 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9f8a2-bcb1-4e34-9b25-210005a596eb None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.236690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e721b-54a7-4044-a685-d5a85925bd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.236690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e721b-54a7-4044-a685-d5a85925bd74 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.236690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e721b-54a7-4044-a685-d5a85925bd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.236690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e721b-54a7-4044-a685-d5a85925bd74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.237047 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e721b-54a7-4044-a685-d5a85925bd74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:51.237047 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e721b-54a7-4044-a685-d5a85925bd74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.238630 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e721b-54a7-4044-a685-d5a85925bd74 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.246989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9f8a2-bcb1-4e34-9b25-210005a596eb None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.252304 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08aeac7-1078-4a47-8432-809d0e1171a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.252918 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08aeac7-1078-4a47-8432-809d0e1171a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.253194 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08aeac7-1078-4a47-8432-809d0e1171a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.253459 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08aeac7-1078-4a47-8432-809d0e1171a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.254102 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08aeac7-1078-4a47-8432-809d0e1171a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:51.254398 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08aeac7-1078-4a47-8432-809d0e1171a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.258437 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1024/2045] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:51.258588 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08aeac7-1078-4a47-8432-809d0e1171a9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.258686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaae65-fc1a-4c99-a6d1-ae486b32a1e6 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.258686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaae65-fc1a-4c99-a6d1-ae486b32a1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.258686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaae65-fc1a-4c99-a6d1-ae486b32a1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.272114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1022/2046] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:51.276307 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08aeac7-1078-4a47-8432-809d0e1171a9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.283322 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-8caaae65-fc1a-4c99-a6d1-ae486b32a1e6 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:51.284686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8caaae65-fc1a-4c99-a6d1-ae486b32a1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:51.288960 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08aeac7-1078-4a47-8432-809d0e1171a9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.297475 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1025/2047] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:51.301021 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec97b0b-2359-43a8-95cf-3ccdb0980d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.301323 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caaae65-fc1a-4c99-a6d1-ae486b32a1e6 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.301647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec97b0b-2359-43a8-95cf-3ccdb0980d80 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.301647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec97b0b-2359-43a8-95cf-3ccdb0980d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.301647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec97b0b-2359-43a8-95cf-3ccdb0980d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.301647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec97b0b-2359-43a8-95cf-3ccdb0980d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.305298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec97b0b-2359-43a8-95cf-3ccdb0980d80 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.308421 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caaae65-fc1a-4c99-a6d1-ae486b32a1e6 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.316923 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81123959-6618-4290-935a-e96cd16616ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.317662 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81123959-6618-4290-935a-e96cd16616ba admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.318082 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81123959-6618-4290-935a-e96cd16616ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.318581 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81123959-6618-4290-935a-e96cd16616ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.319532 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81123959-6618-4290-935a-e96cd16616ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.321710 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81123959-6618-4290-935a-e96cd16616ba admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.340931 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1023/2048] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:51 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:51.340931 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec97b0b-2359-43a8-95cf-3ccdb0980d80 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.353007 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1026/2049] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:51 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:51.353704 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81123959-6618-4290-935a-e96cd16616ba admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.408718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec97b0b-2359-43a8-95cf-3ccdb0980d80 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.413331 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e3d17-0c32-4582-ae37-d7fe1b436fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.413984 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e3d17-0c32-4582-ae37-d7fe1b436fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.414265 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e3d17-0c32-4582-ae37-d7fe1b436fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.414638 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e3d17-0c32-4582-ae37-d7fe1b436fa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.415184 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e3d17-0c32-4582-ae37-d7fe1b436fa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:51.415526 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e3d17-0c32-4582-ae37-d7fe1b436fa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.416989 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81123959-6618-4290-935a-e96cd16616ba admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.417456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e3d17-0c32-4582-ae37-d7fe1b436fa9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.422064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f4ddc-cf39-4c5c-b7da-91b73d815667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.422674 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f4ddc-cf39-4c5c-b7da-91b73d815667 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.422946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f4ddc-cf39-4c5c-b7da-91b73d815667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.423212 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f4ddc-cf39-4c5c-b7da-91b73d815667 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.423894 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f4ddc-cf39-4c5c-b7da-91b73d815667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.425865 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f4ddc-cf39-4c5c-b7da-91b73d815667 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.433147 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1024/2050] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:51.433147 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e3d17-0c32-4582-ae37-d7fe1b436fa9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.442969 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:51.449152 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e3d17-0c32-4582-ae37-d7fe1b436fa9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.451812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1027/2051] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:51 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:51.453448 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f4ddc-cf39-4c5c-b7da-91b73d815667 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.458439 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48be373-7e88-4e73-81ac-8ccada100802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.459059 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48be373-7e88-4e73-81ac-8ccada100802 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.459428 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48be373-7e88-4e73-81ac-8ccada100802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.459757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48be373-7e88-4e73-81ac-8ccada100802 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.460351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48be373-7e88-4e73-81ac-8ccada100802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.462475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48be373-7e88-4e73-81ac-8ccada100802 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.464217 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f4ddc-cf39-4c5c-b7da-91b73d815667 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.469733 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed23b5-b008-463b-9bf9-145656dad2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.470408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed23b5-b008-463b-9bf9-145656dad2ed admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.470757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed23b5-b008-463b-9bf9-145656dad2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.471208 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed23b5-b008-463b-9bf9-145656dad2ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.472115 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed23b5-b008-463b-9bf9-145656dad2ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.474474 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed23b5-b008-463b-9bf9-145656dad2ed admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.484313 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1025/2052] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:51 2022] POST /identity/v3/users => generated 293 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:51.485202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48be373-7e88-4e73-81ac-8ccada100802 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.498284 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48be373-7e88-4e73-81ac-8ccada100802 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.503268 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cea66b-c7ab-48b9-b735-076fa333d62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.503937 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cea66b-c7ab-48b9-b735-076fa333d62b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.504227 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cea66b-c7ab-48b9-b735-076fa333d62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.504491 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cea66b-c7ab-48b9-b735-076fa333d62b admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.504967 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1028/2053] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:51 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:51.505130 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cea66b-c7ab-48b9-b735-076fa333d62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.505800 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed23b5-b008-463b-9bf9-145656dad2ed admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.506864 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cea66b-c7ab-48b9-b735-076fa333d62b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.519188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1026/2054] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:51.520035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cea66b-c7ab-48b9-b735-076fa333d62b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.530035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cea66b-c7ab-48b9-b735-076fa333d62b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.557592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:DELETE=5,keystone:SELECT=89,keystone:INSERT=6 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:51.578689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed23b5-b008-463b-9bf9-145656dad2ed admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.583430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a4fa1-033e-4210-840e-a9e8443ae67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.584072 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a4fa1-033e-4210-840e-a9e8443ae67f admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.584350 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a4fa1-033e-4210-840e-a9e8443ae67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.584620 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a4fa1-033e-4210-840e-a9e8443ae67f admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.585312 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a4fa1-033e-4210-840e-a9e8443ae67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.586932 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a4fa1-033e-4210-840e-a9e8443ae67f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.596006 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13622ea-7f4c-4b80-b509-71f1c9fec70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.596562 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13622ea-7f4c-4b80-b509-71f1c9fec70b admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.596889 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13622ea-7f4c-4b80-b509-71f1c9fec70b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.596996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1029/2055] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:51.597161 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13622ea-7f4c-4b80-b509-71f1c9fec70b admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.597736 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a4fa1-033e-4210-840e-a9e8443ae67f admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.597841 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13622ea-7f4c-4b80-b509-71f1c9fec70b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.599723 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13622ea-7f4c-4b80-b509-71f1c9fec70b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.608750 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a4fa1-033e-4210-840e-a9e8443ae67f admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.613662 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720248d2-90af-42e3-a090-3b7e441a4590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.614259 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720248d2-90af-42e3-a090-3b7e441a4590 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.614567 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720248d2-90af-42e3-a090-3b7e441a4590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.614967 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720248d2-90af-42e3-a090-3b7e441a4590 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.615637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720248d2-90af-42e3-a090-3b7e441a4590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.617262 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720248d2-90af-42e3-a090-3b7e441a4590 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.625426 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1027/2056] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:51 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:51.625426 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13622ea-7f4c-4b80-b509-71f1c9fec70b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.630841 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1030/2057] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:51.632004 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720248d2-90af-42e3-a090-3b7e441a4590 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.632825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13622ea-7f4c-4b80-b509-71f1c9fec70b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.637445 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a5e1e-8a99-4245-bcc0-c9d3892e128b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.638020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a5e1e-8a99-4245-bcc0-c9d3892e128b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.638299 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a5e1e-8a99-4245-bcc0-c9d3892e128b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.638612 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a5e1e-8a99-4245-bcc0-c9d3892e128b admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.639246 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a5e1e-8a99-4245-bcc0-c9d3892e128b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.640921 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a5e1e-8a99-4245-bcc0-c9d3892e128b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.642209 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720248d2-90af-42e3-a090-3b7e441a4590 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.646822 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad3b14-1db1-4b21-a598-996a99334699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.647444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad3b14-1db1-4b21-a598-996a99334699 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.647723 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad3b14-1db1-4b21-a598-996a99334699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.647994 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad3b14-1db1-4b21-a598-996a99334699 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.648621 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad3b14-1db1-4b21-a598-996a99334699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.650238 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad3b14-1db1-4b21-a598-996a99334699 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.651559 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1028/2058] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:51.652462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a5e1e-8a99-4245-bcc0-c9d3892e128b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.662497 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a5e1e-8a99-4245-bcc0-c9d3892e128b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.663533 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1031/2059] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:51.664342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad3b14-1db1-4b21-a598-996a99334699 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.670089 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919a10b-45e5-4182-9f42-90dd4fc3a58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.670739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919a10b-45e5-4182-9f42-90dd4fc3a58a admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.671024 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919a10b-45e5-4182-9f42-90dd4fc3a58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.671379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919a10b-45e5-4182-9f42-90dd4fc3a58a admin admin] PATH_INFO: `/v3/projects/3c715c3d62914bc4a64e8e275d4e89ea/users/d1c043c3f5014a00b7b87ebd41eab262/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.676305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad3b14-1db1-4b21-a598-996a99334699 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.680912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb13f7d-f019-4b60-9d93-64834ee9f91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.684381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb13f7d-f019-4b60-9d93-64834ee9f91e admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.685119 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb13f7d-f019-4b60-9d93-64834ee9f91e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.685542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb13f7d-f019-4b60-9d93-64834ee9f91e admin admin] PATH_INFO: `/v3/projects/024bd7ae7dd546efb302f04dc28a49eb/users/c6e72fea62a24e3fb7d75587752070db/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.687544 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919a10b-45e5-4182-9f42-90dd4fc3a58a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c715c3d62914bc4a64e8e275d4e89ea, user_id=d1c043c3f5014a00b7b87ebd41eab262, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.690241 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919a10b-45e5-4182-9f42-90dd4fc3a58a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.704238 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb13f7d-f019-4b60-9d93-64834ee9f91e admin admin] RBAC: Authorizing `identity:create_grant(project_id=024bd7ae7dd546efb302f04dc28a49eb, user_id=c6e72fea62a24e3fb7d75587752070db, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.714969 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1029/2060] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:51 2022] PUT /identity/v3/projects/3c715c3d62914bc4a64e8e275d4e89ea/users/d1c043c3f5014a00b7b87ebd41eab262/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:51.714969 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919a10b-45e5-4182-9f42-90dd4fc3a58a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.715257 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb13f7d-f019-4b60-9d93-64834ee9f91e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.729685 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1032/2061] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:51 2022] PUT /identity/v3/projects/024bd7ae7dd546efb302f04dc28a49eb/users/c6e72fea62a24e3fb7d75587752070db/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:51.731308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202d342-eb6a-4d9c-9fe8-3e91705fcd7f None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.731722 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202d342-eb6a-4d9c-9fe8-3e91705fcd7f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.732090 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202d342-eb6a-4d9c-9fe8-3e91705fcd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.769529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-b202d342-eb6a-4d9c-9fe8-3e91705fcd7f None None] MFA Rules not processed for user `d1c043c3f5014a00b7b87ebd41eab262`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:51.770895 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b202d342-eb6a-4d9c-9fe8-3e91705fcd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:51.797935 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919a10b-45e5-4182-9f42-90dd4fc3a58a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.848701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:51.860200 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1033/2062] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:51.866825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bc19c-91e4-48f3-9b97-06ffbd838801 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.867241 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bc19c-91e4-48f3-9b97-06ffbd838801 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.867642 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bc19c-91e4-48f3-9b97-06ffbd838801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.891551 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bedb47-1ca5-4e17-b50b-6fcedbecf4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.892183 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bedb47-1ca5-4e17-b50b-6fcedbecf4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.892461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bedb47-1ca5-4e17-b50b-6fcedbecf4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.892801 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bedb47-1ca5-4e17-b50b-6fcedbecf4f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.893401 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bedb47-1ca5-4e17-b50b-6fcedbecf4f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.894973 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bedb47-1ca5-4e17-b50b-6fcedbecf4f6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.909595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1030/2063] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:51.909595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bedb47-1ca5-4e17-b50b-6fcedbecf4f6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.909833 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-47bedb47-1ca5-4e17-b50b-6fcedbecf4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:51.910943 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-3c9bc19c-91e4-48f3-9b97-06ffbd838801 None None] MFA Rules not processed for user `c6e72fea62a24e3fb7d75587752070db`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:51.912272 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3c9bc19c-91e4-48f3-9b97-06ffbd838801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:51.971165 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bedb47-1ca5-4e17-b50b-6fcedbecf4f6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.974847 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535bd2f-c6bc-4a74-89bf-d0fe908716c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.975486 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535bd2f-c6bc-4a74-89bf-d0fe908716c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.975763 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535bd2f-c6bc-4a74-89bf-d0fe908716c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.976036 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535bd2f-c6bc-4a74-89bf-d0fe908716c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:51.980394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1034/2064] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:51.981355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bc19c-91e4-48f3-9b97-06ffbd838801 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.985111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535bd2f-c6bc-4a74-89bf-d0fe908716c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:51.986563 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535bd2f-c6bc-4a74-89bf-d0fe908716c7 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:51.992196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bc19c-91e4-48f3-9b97-06ffbd838801 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:51.996195 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1031/2065] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:51.996943 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535bd2f-c6bc-4a74-89bf-d0fe908716c7 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:51.997076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7da892-0908-4c28-bcbb-022aa3adc198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:51.997673 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7da892-0908-4c28-bcbb-022aa3adc198 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:51.997961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7da892-0908-4c28-bcbb-022aa3adc198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:51.998636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7da892-0908-4c28-bcbb-022aa3adc198 admin admin] PATH_INFO: `/v3/projects/aafe53bb59484750bc71eefc119cda8f/users/e7e71925d97c4227ba6e4835f56743e4/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.008918 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:52.009090 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535bd2f-c6bc-4a74-89bf-d0fe908716c7 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:52.014586 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64648903-8b40-4312-ab39-4ae74ffec734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:52.015288 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64648903-8b40-4312-ab39-4ae74ffec734 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.015987 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64648903-8b40-4312-ab39-4ae74ffec734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.015987 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64648903-8b40-4312-ab39-4ae74ffec734 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.016689 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64648903-8b40-4312-ab39-4ae74ffec734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:52.018804 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64648903-8b40-4312-ab39-4ae74ffec734 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:52.025851 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7da892-0908-4c28-bcbb-022aa3adc198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aafe53bb59484750bc71eefc119cda8f, user_id=e7e71925d97c4227ba6e4835f56743e4, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:52.029029 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7da892-0908-4c28-bcbb-022aa3adc198 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:52.046280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1035/2066] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:51 2022] PUT /identity/v3/projects/aafe53bb59484750bc71eefc119cda8f/users/e7e71925d97c4227ba6e4835f56743e4/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:52.054925 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1032/2067] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:51 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:52.056990 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aade78-d93e-42eb-85ef-d5fd36481aeb None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.057273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aade78-d93e-42eb-85ef-d5fd36481aeb None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.057544 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aade78-d93e-42eb-85ef-d5fd36481aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.058894 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64648903-8b40-4312-ab39-4ae74ffec734 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:52.090098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-c6aade78-d93e-42eb-85ef-d5fd36481aeb None None] MFA Rules not processed for user `e7e71925d97c4227ba6e4835f56743e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:52.091468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c6aade78-d93e-42eb-85ef-d5fd36481aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:52.142085 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64648903-8b40-4312-ab39-4ae74ffec734 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:52.147318 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4ac54-a752-4086-a87a-03a0c6f728eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:52.147967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4ac54-a752-4086-a87a-03a0c6f728eb admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.148247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4ac54-a752-4086-a87a-03a0c6f728eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.148521 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4ac54-a752-4086-a87a-03a0c6f728eb admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.149164 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4ac54-a752-4086-a87a-03a0c6f728eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:52.151300 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4ac54-a752-4086-a87a-03a0c6f728eb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:52.179526 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1033/2068] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:52 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:58:52.184087 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1036/2069] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:52.185397 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4ac54-a752-4086-a87a-03a0c6f728eb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:52.187107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aade78-d93e-42eb-85ef-d5fd36481aeb None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:52.198347 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4ac54-a752-4086-a87a-03a0c6f728eb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:52.200156 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aade78-d93e-42eb-85ef-d5fd36481aeb None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:52.205294 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c856b2-1a07-4c20-ab02-218d77eb12e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:52.206084 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c856b2-1a07-4c20-ab02-218d77eb12e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.206369 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb9105-3bd0-45a8-bd26-77715001b437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:52.206611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c856b2-1a07-4c20-ab02-218d77eb12e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.206830 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb9105-3bd0-45a8-bd26-77715001b437 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.207055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c856b2-1a07-4c20-ab02-218d77eb12e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.207168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb9105-3bd0-45a8-bd26-77715001b437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.207431 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb9105-3bd0-45a8-bd26-77715001b437 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.207905 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c856b2-1a07-4c20-ab02-218d77eb12e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:52.208208 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb9105-3bd0-45a8-bd26-77715001b437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:52.209806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb9105-3bd0-45a8-bd26-77715001b437 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:52.209966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c856b2-1a07-4c20-ab02-218d77eb12e2 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:52.221018 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1034/2070] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:52.225214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb9105-3bd0-45a8-bd26-77715001b437 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:52.238699 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb9105-3bd0-45a8-bd26-77715001b437 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:52.244166 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8862f-0608-40c5-8e4f-f6ea6c84bbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:52.245125 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8862f-0608-40c5-8e4f-f6ea6c84bbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.245125 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8862f-0608-40c5-8e4f-f6ea6c84bbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.245475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8862f-0608-40c5-8e4f-f6ea6c84bbe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.246720 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8862f-0608-40c5-8e4f-f6ea6c84bbe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:52.247429 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1037/2071] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:52 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:52.250615 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8862f-0608-40c5-8e4f-f6ea6c84bbe4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:52.251651 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c856b2-1a07-4c20-ab02-218d77eb12e2 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:52.267018 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1035/2072] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:58:52.268829 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8862f-0608-40c5-8e4f-f6ea6c84bbe4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:52.282760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8862f-0608-40c5-8e4f-f6ea6c84bbe4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:52.309409 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:52.344467 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c856b2-1a07-4c20-ab02-218d77eb12e2 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:52.359689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b8f5f-dc9c-4dd6-8b17-3eeb00982d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:52.360426 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b8f5f-dc9c-4dd6-8b17-3eeb00982d97 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.360770 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b8f5f-dc9c-4dd6-8b17-3eeb00982d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.361543 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b8f5f-dc9c-4dd6-8b17-3eeb00982d97 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.362809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b8f5f-dc9c-4dd6-8b17-3eeb00982d97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:52.368489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b8f5f-dc9c-4dd6-8b17-3eeb00982d97 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:52.391113 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcca279-bd6b-44e5-9672-eb187ab06739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:52.392189 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcca279-bd6b-44e5-9672-eb187ab06739 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.392438 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcca279-bd6b-44e5-9672-eb187ab06739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.392660 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcca279-bd6b-44e5-9672-eb187ab06739 admin admin] PATH_INFO: `/v3/projects/100dfc3581264ccc84ce8eb0263b85ab/users/2bb2d273548543829310c145a803cb4e/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.402595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1038/2073] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:52 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:52.404268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b8f5f-dc9c-4dd6-8b17-3eeb00982d97 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:52.412479 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcca279-bd6b-44e5-9672-eb187ab06739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100dfc3581264ccc84ce8eb0263b85ab, user_id=2bb2d273548543829310c145a803cb4e, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:52.417078 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcca279-bd6b-44e5-9672-eb187ab06739 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:52.420563 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b8f5f-dc9c-4dd6-8b17-3eeb00982d97 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:52.428969 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1bb8e-97d1-43c6-bd51-7821ba2cbbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:52.429914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1bb8e-97d1-43c6-bd51-7821ba2cbbea admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.429914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1bb8e-97d1-43c6-bd51-7821ba2cbbea admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.430271 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1bb8e-97d1-43c6-bd51-7821ba2cbbea admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.430802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1bb8e-97d1-43c6-bd51-7821ba2cbbea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:52.432725 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1bb8e-97d1-43c6-bd51-7821ba2cbbea admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:52.434799 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1036/2074] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:52 2022] PUT /identity/v3/projects/100dfc3581264ccc84ce8eb0263b85ab/users/2bb2d273548543829310c145a803cb4e/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:52.437218 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcca279-bd6b-44e5-9672-eb187ab06739 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:52.439513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fdcca279-bd6b-44e5-9672-eb187ab06739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:52.446245 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1039/2075] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:52.447566 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2335eb-5391-424d-bcd0-6c593ddd60bc None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.447845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2335eb-5391-424d-bcd0-6c593ddd60bc None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.448116 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2335eb-5391-424d-bcd0-6c593ddd60bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.476323 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-0d2335eb-5391-424d-bcd0-6c593ddd60bc None None] MFA Rules not processed for user `2bb2d273548543829310c145a803cb4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:52.477534 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0d2335eb-5391-424d-bcd0-6c593ddd60bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:52.499401 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:52.512651 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcca279-bd6b-44e5-9672-eb187ab06739 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:52.517741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc272887-3e4d-46d0-8852-04d558cd16fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:52.518376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc272887-3e4d-46d0-8852-04d558cd16fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.518655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc272887-3e4d-46d0-8852-04d558cd16fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.518930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc272887-3e4d-46d0-8852-04d558cd16fc admin admin] PATH_INFO: `/v3/users/3afc232a8a9748c4b3a7dc48f049b83b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.520059 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc272887-3e4d-46d0-8852-04d558cd16fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3afc232a8a9748c4b3a7dc48f049b83b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:52.522159 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc272887-3e4d-46d0-8852-04d558cd16fc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:52.545284 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1040/2076] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:52.546146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2335eb-5391-424d-bcd0-6c593ddd60bc None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:52.557359 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2335eb-5391-424d-bcd0-6c593ddd60bc None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:52.563445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907bc60-52f4-4451-9b84-070f1cf568be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:52.564108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907bc60-52f4-4451-9b84-070f1cf568be admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.564386 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907bc60-52f4-4451-9b84-070f1cf568be admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.564686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907bc60-52f4-4451-9b84-070f1cf568be admin admin] PATH_INFO: `/v3/projects/3f5d317681c341779eb808051c0440a6/users/68f52b51138d4e5dad7d413b4c9e29b6/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.578907 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cc272887-3e4d-46d0-8852-04d558cd16fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3afc232a8a9748c4b3a7dc48f049b83b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:52.580708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907bc60-52f4-4451-9b84-070f1cf568be admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5d317681c341779eb808051c0440a6, user_id=68f52b51138d4e5dad7d413b4c9e29b6, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:52.583796 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907bc60-52f4-4451-9b84-070f1cf568be admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:52.586187 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cc272887-3e4d-46d0-8852-04d558cd16fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3afc232a8a9748c4b3a7dc48f049b83b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:52.594117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cc272887-3e4d-46d0-8852-04d558cd16fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3afc232a8a9748c4b3a7dc48f049b83b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:52.601872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1041/2077] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:52 2022] PUT /identity/v3/projects/3f5d317681c341779eb808051c0440a6/users/68f52b51138d4e5dad7d413b4c9e29b6/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:52.601872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907bc60-52f4-4451-9b84-070f1cf568be admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:52.608158 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cc272887-3e4d-46d0-8852-04d558cd16fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3afc232a8a9748c4b3a7dc48f049b83b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:52.609042 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cc272887-3e4d-46d0-8852-04d558cd16fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3afc232a8a9748c4b3a7dc48f049b83b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:52.616762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1037/2078] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:52 2022] DELETE /identity/v3/users/3afc232a8a9748c4b3a7dc48f049b83b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:52.617348 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc272887-3e4d-46d0-8852-04d558cd16fc admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:52.618770 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cc272887-3e4d-46d0-8852-04d558cd16fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:52.647059 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:52.667099 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907bc60-52f4-4451-9b84-070f1cf568be admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:52.687002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc272887-3e4d-46d0-8852-04d558cd16fc admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:52.691541 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820a741-cf04-44b5-974e-c427fd556c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:52.692135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820a741-cf04-44b5-974e-c427fd556c90 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.692409 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820a741-cf04-44b5-974e-c427fd556c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.692675 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820a741-cf04-44b5-974e-c427fd556c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.693330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820a741-cf04-44b5-974e-c427fd556c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:52.694927 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820a741-cf04-44b5-974e-c427fd556c90 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:52.704966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1038/2079] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:52.706241 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ec22b-6d0f-4ddf-8f46-efaa1826d4c8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.706528 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ec22b-6d0f-4ddf-8f46-efaa1826d4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.706799 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ec22b-6d0f-4ddf-8f46-efaa1826d4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.723858 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d8403-4ea0-45fa-aa98-2cc47057850d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:52.724474 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8403-4ea0-45fa-aa98-2cc47057850d admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.724752 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8403-4ea0-45fa-aa98-2cc47057850d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.725022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8403-4ea0-45fa-aa98-2cc47057850d admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.725658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d8403-4ea0-45fa-aa98-2cc47057850d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:52.725749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-369ec22b-6d0f-4ddf-8f46-efaa1826d4c8 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:52.726897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-369ec22b-6d0f-4ddf-8f46-efaa1826d4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:52.727616 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d8403-4ea0-45fa-aa98-2cc47057850d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:52.734701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1039/2080] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:52.735230 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ec22b-6d0f-4ddf-8f46-efaa1826d4c8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:52.744560 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ec22b-6d0f-4ddf-8f46-efaa1826d4c8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:52.749356 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46d664-2ce3-4823-941c-d145f93b129f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:52.750038 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46d664-2ce3-4823-941c-d145f93b129f admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.750314 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46d664-2ce3-4823-941c-d145f93b129f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.750582 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46d664-2ce3-4823-941c-d145f93b129f admin admin] PATH_INFO: `/v3/projects/3f5d317681c341779eb808051c0440a6/users/68f52b51138d4e5dad7d413b4c9e29b6/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.752470 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46d664-2ce3-4823-941c-d145f93b129f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5d317681c341779eb808051c0440a6, user_id=68f52b51138d4e5dad7d413b4c9e29b6, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:52.757804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1042/2081] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:52 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:52.757984 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46d664-2ce3-4823-941c-d145f93b129f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:52.758100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d8403-4ea0-45fa-aa98-2cc47057850d admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:52.759344 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-313d8403-4ea0-45fa-aa98-2cc47057850d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:52.765832 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1040/2082] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:52 2022] PUT /identity/v3/projects/3f5d317681c341779eb808051c0440a6/users/68f52b51138d4e5dad7d413b4c9e29b6/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:52.766619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46d664-2ce3-4823-941c-d145f93b129f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:52.768341 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1e46d664-2ce3-4823-941c-d145f93b129f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:52.795469 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:52.820198 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d8403-4ea0-45fa-aa98-2cc47057850d admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:52.832296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46d664-2ce3-4823-941c-d145f93b129f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:52.837016 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca18ff-0945-4148-a0d4-b3091a470836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:52.837608 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca18ff-0945-4148-a0d4-b3091a470836 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.837885 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca18ff-0945-4148-a0d4-b3091a470836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.838169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca18ff-0945-4148-a0d4-b3091a470836 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.838796 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca18ff-0945-4148-a0d4-b3091a470836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:52.840754 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca18ff-0945-4148-a0d4-b3091a470836 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:52.862583 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1041/2083] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:52 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:52.864660 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf266212-eec6-4349-a396-4ca17e7f0939 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.865208 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf266212-eec6-4349-a396-4ca17e7f0939 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.865208 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf266212-eec6-4349-a396-4ca17e7f0939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.874095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92a09b-d583-4234-8200-88a463e3306c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:52.874683 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92a09b-d583-4234-8200-88a463e3306c service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.874962 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92a09b-d583-4234-8200-88a463e3306c service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.875238 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92a09b-d583-4234-8200-88a463e3306c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.888088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92a09b-d583-4234-8200-88a463e3306c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:52.889505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92a09b-d583-4234-8200-88a463e3306c service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:52.895366 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cf266212-eec6-4349-a396-4ca17e7f0939 None None] MFA Rules not processed for user `68f52b51138d4e5dad7d413b4c9e29b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:52.896806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cf266212-eec6-4349-a396-4ca17e7f0939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:52.900777 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1043/2084] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:52.901675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92a09b-d583-4234-8200-88a463e3306c service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:52.914122 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92a09b-d583-4234-8200-88a463e3306c service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:52.927551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1007c-c4a6-4cbb-8763-f8e52fdcc3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:52.928232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1007c-c4a6-4cbb-8763-f8e52fdcc3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.928512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1007c-c4a6-4cbb-8763-f8e52fdcc3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.928782 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1007c-c4a6-4cbb-8763-f8e52fdcc3f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.929458 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1007c-c4a6-4cbb-8763-f8e52fdcc3f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:52.931187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1007c-c4a6-4cbb-8763-f8e52fdcc3f1 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:52.946716 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1044/2085] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:52.950813 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1007c-c4a6-4cbb-8763-f8e52fdcc3f1 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:52.961182 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1007c-c4a6-4cbb-8763-f8e52fdcc3f1 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:52.966895 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d11f3-37ed-4aa1-b5e6-37e008aba99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:52.967598 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d11f3-37ed-4aa1-b5e6-37e008aba99e admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:52.967876 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d11f3-37ed-4aa1-b5e6-37e008aba99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:52.968189 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d11f3-37ed-4aa1-b5e6-37e008aba99e admin admin] PATH_INFO: `/v3/projects/96f77c2eba0d411784fbf55bdb25149a/users/a144b060402949d4b46a443be8d5abf8/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:52.986113 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1042/2086] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:52.986532 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d11f3-37ed-4aa1-b5e6-37e008aba99e admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f77c2eba0d411784fbf55bdb25149a, user_id=a144b060402949d4b46a443be8d5abf8, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:52.989328 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d11f3-37ed-4aa1-b5e6-37e008aba99e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:53.000914 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf266212-eec6-4349-a396-4ca17e7f0939 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:53.003391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cf266212-eec6-4349-a396-4ca17e7f0939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:53.009948 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1045/2087] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:52 2022] PUT /identity/v3/projects/96f77c2eba0d411784fbf55bdb25149a/users/a144b060402949d4b46a443be8d5abf8/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:53.016776 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d11f3-37ed-4aa1-b5e6-37e008aba99e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:53.039863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:53.100527 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d11f3-37ed-4aa1-b5e6-37e008aba99e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:53.110170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a32651-093a-43e8-b831-e4827418e484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:53.111132 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a32651-093a-43e8-b831-e4827418e484 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:53.111675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a32651-093a-43e8-b831-e4827418e484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:53.112090 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a32651-093a-43e8-b831-e4827418e484 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:53.113159 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a32651-093a-43e8-b831-e4827418e484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:53.115714 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a32651-093a-43e8-b831-e4827418e484 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:53.127495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf266212-eec6-4349-a396-4ca17e7f0939 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:53.139927 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1046/2088] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:58:53.141331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a32651-093a-43e8-b831-e4827418e484 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:53.162474 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a32651-093a-43e8-b831-e4827418e484 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:53.170085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048e574-9da7-4ceb-b4e2-9a1f80fa7065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:53.170822 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048e574-9da7-4ceb-b4e2-9a1f80fa7065 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:53.171231 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048e574-9da7-4ceb-b4e2-9a1f80fa7065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:53.172233 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048e574-9da7-4ceb-b4e2-9a1f80fa7065 admin admin] PATH_INFO: `/v3/projects/96f77c2eba0d411784fbf55bdb25149a/users/a144b060402949d4b46a443be8d5abf8/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:53.174972 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048e574-9da7-4ceb-b4e2-9a1f80fa7065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f77c2eba0d411784fbf55bdb25149a, user_id=a144b060402949d4b46a443be8d5abf8, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:53.188359 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048e574-9da7-4ceb-b4e2-9a1f80fa7065 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:53.209578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1047/2089] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:53 2022] PUT /identity/v3/projects/96f77c2eba0d411784fbf55bdb25149a/users/a144b060402949d4b46a443be8d5abf8/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:53.211411 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048e574-9da7-4ceb-b4e2-9a1f80fa7065 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:53.216105 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f048e574-9da7-4ceb-b4e2-9a1f80fa7065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:53.223572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff09794-b742-467d-9620-79873bbeab68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:53.224751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff09794-b742-467d-9620-79873bbeab68 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:53.225110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff09794-b742-467d-9620-79873bbeab68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:53.225449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff09794-b742-467d-9620-79873bbeab68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:53.268508 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:53.295852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff09794-b742-467d-9620-79873bbeab68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:53.297704 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048e574-9da7-4ceb-b4e2-9a1f80fa7065 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:53.299712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff09794-b742-467d-9620-79873bbeab68 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:53.307061 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cafcd-4ca2-4410-8d57-269775893a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:53.307828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cafcd-4ca2-4410-8d57-269775893a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:53.308165 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cafcd-4ca2-4410-8d57-269775893a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:53.308533 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cafcd-4ca2-4410-8d57-269775893a95 admin admin] PATH_INFO: `/v3/users/201e588e3d864503a4a6d1b2a66da436` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:53.309900 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cafcd-4ca2-4410-8d57-269775893a95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=201e588e3d864503a4a6d1b2a66da436)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:53.310620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1043/2090] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:53.312586 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52fca4-8ee3-4bdd-b860-2c102f41300a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:53.312996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52fca4-8ee3-4bdd-b860-2c102f41300a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:53.313261 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52fca4-8ee3-4bdd-b860-2c102f41300a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:53.315351 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cafcd-4ca2-4410-8d57-269775893a95 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:53.344099 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6d52fca4-8ee3-4bdd-b860-2c102f41300a None None] MFA Rules not processed for user `a144b060402949d4b46a443be8d5abf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:53.346282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6d52fca4-8ee3-4bdd-b860-2c102f41300a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:53.385585 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-038cafcd-4ca2-4410-8d57-269775893a95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '201e588e3d864503a4a6d1b2a66da436'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.395093 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-038cafcd-4ca2-4410-8d57-269775893a95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '201e588e3d864503a4a6d1b2a66da436'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.405432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-038cafcd-4ca2-4410-8d57-269775893a95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '201e588e3d864503a4a6d1b2a66da436'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.406368 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-038cafcd-4ca2-4410-8d57-269775893a95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '201e588e3d864503a4a6d1b2a66da436'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.423612 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-038cafcd-4ca2-4410-8d57-269775893a95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '201e588e3d864503a4a6d1b2a66da436'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.431718 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1048/2091] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:53 2022] DELETE /identity/v3/users/201e588e3d864503a4a6d1b2a66da436 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:53.432260 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1044/2092] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:53.432988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cafcd-4ca2-4410-8d57-269775893a95 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:53.434390 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-038cafcd-4ca2-4410-8d57-269775893a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:53.437885 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52fca4-8ee3-4bdd-b860-2c102f41300a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:53.440589 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6d52fca4-8ee3-4bdd-b860-2c102f41300a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:53.461992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:53.466999 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52fca4-8ee3-4bdd-b860-2c102f41300a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:53.511833 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cafcd-4ca2-4410-8d57-269775893a95 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:53.517551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab41a0-f870-4d46-bee3-c1957c7b33b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:53.518194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab41a0-f870-4d46-bee3-c1957c7b33b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:53.518503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab41a0-f870-4d46-bee3-c1957c7b33b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:53.518760 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab41a0-f870-4d46-bee3-c1957c7b33b1 admin admin] PATH_INFO: `/v3/projects/fbebb044d0924f7199df6ff1fd0eb4ca` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:53.519920 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab41a0-f870-4d46-bee3-c1957c7b33b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbebb044d0924f7199df6ff1fd0eb4ca)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:53.521839 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab41a0-f870-4d46-bee3-c1957c7b33b1 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:53.532827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea4179-f9a0-495b-a494-5bd9d22dea0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:53.533736 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea4179-f9a0-495b-a494-5bd9d22dea0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:53.534043 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea4179-f9a0-495b-a494-5bd9d22dea0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:53.534392 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea4179-f9a0-495b-a494-5bd9d22dea0a admin admin] PATH_INFO: `/v3/users/e7e71925d97c4227ba6e4835f56743e4` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:53.535760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea4179-f9a0-495b-a494-5bd9d22dea0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7e71925d97c4227ba6e4835f56743e4)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:53.538647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea4179-f9a0-495b-a494-5bd9d22dea0a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:53.581509 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1eab41a0-f870-4d46-bee3-c1957c7b33b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbebb044d0924f7199df6ff1fd0eb4ca', 'request_id': 'req-1eab41a0-f870-4d46-bee3-c1957c7b33b1'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.588026 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1eab41a0-f870-4d46-bee3-c1957c7b33b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbebb044d0924f7199df6ff1fd0eb4ca', 'request_id': 'req-1eab41a0-f870-4d46-bee3-c1957c7b33b1'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.594346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-70ea4179-f9a0-495b-a494-5bd9d22dea0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7e71925d97c4227ba6e4835f56743e4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.594587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:53.597151 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1eab41a0-f870-4d46-bee3-c1957c7b33b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbebb044d0924f7199df6ff1fd0eb4ca', 'request_id': 'req-1eab41a0-f870-4d46-bee3-c1957c7b33b1'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.608412 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-70ea4179-f9a0-495b-a494-5bd9d22dea0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7e71925d97c4227ba6e4835f56743e4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.618958 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-70ea4179-f9a0-495b-a494-5bd9d22dea0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7e71925d97c4227ba6e4835f56743e4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.624267 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1eab41a0-f870-4d46-bee3-c1957c7b33b1 admin admin] The token cache is being invalidate because project fbebb044d0924f7199df6ff1fd0eb4ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:53.624665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1eab41a0-f870-4d46-bee3-c1957c7b33b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.625790 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1eab41a0-f870-4d46-bee3-c1957c7b33b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.627908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1049/2093] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:53 2022] DELETE /identity/v3/projects/fbebb044d0924f7199df6ff1fd0eb4ca => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:53.632704 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd100b3f-480a-43f7-ab73-59487035d7eb None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:53.632967 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd100b3f-480a-43f7-ab73-59487035d7eb None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:53.633242 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd100b3f-480a-43f7-ab73-59487035d7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:53.662045 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-dd100b3f-480a-43f7-ab73-59487035d7eb None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:53.662272 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-70ea4179-f9a0-495b-a494-5bd9d22dea0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7e71925d97c4227ba6e4835f56743e4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.663080 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-70ea4179-f9a0-495b-a494-5bd9d22dea0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7e71925d97c4227ba6e4835f56743e4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.663346 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-dd100b3f-480a-43f7-ab73-59487035d7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:53.671560 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1045/2094] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:53 2022] DELETE /identity/v3/users/e7e71925d97c4227ba6e4835f56743e4 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:53.672471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea4179-f9a0-495b-a494-5bd9d22dea0a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:53.673954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-70ea4179-f9a0-495b-a494-5bd9d22dea0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:53.727776 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1050/2095] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:53.731718 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd100b3f-480a-43f7-ab73-59487035d7eb None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:53.733161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-dd100b3f-480a-43f7-ab73-59487035d7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:53.734866 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea4179-f9a0-495b-a494-5bd9d22dea0a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:53.738608 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478ee61-fa39-4c89-8955-26c168e89b3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:53.739293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478ee61-fa39-4c89-8955-26c168e89b3b service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:53.739657 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478ee61-fa39-4c89-8955-26c168e89b3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:53.739990 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478ee61-fa39-4c89-8955-26c168e89b3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:53.741740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4478ee61-fa39-4c89-8955-26c168e89b3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:53.745989 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd100b3f-480a-43f7-ab73-59487035d7eb None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:53.787143 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:53.807286 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab252dc-b06e-4fdc-a609-351cbfcee262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:53.808204 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab252dc-b06e-4fdc-a609-351cbfcee262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:53.808533 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab252dc-b06e-4fdc-a609-351cbfcee262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:53.808832 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478ee61-fa39-4c89-8955-26c168e89b3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:53.808969 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab252dc-b06e-4fdc-a609-351cbfcee262 admin admin] PATH_INFO: `/v3/users/c689916876134761af956502a23dac5a` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:53.810102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab252dc-b06e-4fdc-a609-351cbfcee262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c689916876134761af956502a23dac5a)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:53.810277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478ee61-fa39-4c89-8955-26c168e89b3b service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:53.812799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab252dc-b06e-4fdc-a609-351cbfcee262 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:53.819718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1046/2096] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:53.820952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a55d4-8c73-426b-894b-6b48fc332ab7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:53.821672 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a55d4-8c73-426b-894b-6b48fc332ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:53.821672 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a55d4-8c73-426b-894b-6b48fc332ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:53.840900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c01a55d4-8c73-426b-894b-6b48fc332ab7 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:53.842090 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c01a55d4-8c73-426b-894b-6b48fc332ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:53.851627 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1047/2097] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:53.855314 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a55d4-8c73-426b-894b-6b48fc332ab7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:53.855314 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c01a55d4-8c73-426b-894b-6b48fc332ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:53.877286 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0ab252dc-b06e-4fdc-a609-351cbfcee262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c689916876134761af956502a23dac5a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.889250 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0ab252dc-b06e-4fdc-a609-351cbfcee262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c689916876134761af956502a23dac5a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.901102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0ab252dc-b06e-4fdc-a609-351cbfcee262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c689916876134761af956502a23dac5a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.901964 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0ab252dc-b06e-4fdc-a609-351cbfcee262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c689916876134761af956502a23dac5a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.919426 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0ab252dc-b06e-4fdc-a609-351cbfcee262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c689916876134761af956502a23dac5a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:53.919692 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a55d4-8c73-426b-894b-6b48fc332ab7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:53.923927 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94e786-7c0d-4d72-aaf4-8bea38bcc7dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:53.924545 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94e786-7c0d-4d72-aaf4-8bea38bcc7dd service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:53.924818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94e786-7c0d-4d72-aaf4-8bea38bcc7dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:53.925084 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94e786-7c0d-4d72-aaf4-8bea38bcc7dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:53.926919 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1051/2098] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:53 2022] DELETE /identity/v3/users/c689916876134761af956502a23dac5a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:53.927066 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7f94e786-7c0d-4d72-aaf4-8bea38bcc7dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:53.927614 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab252dc-b06e-4fdc-a609-351cbfcee262 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:53.929120 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0ab252dc-b06e-4fdc-a609-351cbfcee262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:53.940398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:53.940948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94e786-7c0d-4d72-aaf4-8bea38bcc7dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:53.942395 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94e786-7c0d-4d72-aaf4-8bea38bcc7dd service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:53.958873 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1048/2099] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:54.020967 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab252dc-b06e-4fdc-a609-351cbfcee262 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:54.025200 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc088c-ea58-4f79-a7d5-eecc9275d9e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:54.026261 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc088c-ea58-4f79-a7d5-eecc9275d9e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:54.026540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc088c-ea58-4f79-a7d5-eecc9275d9e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:54.026861 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc088c-ea58-4f79-a7d5-eecc9275d9e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:54.029119 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6ffc088c-ea58-4f79-a7d5-eecc9275d9e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:54.111511 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc088c-ea58-4f79-a7d5-eecc9275d9e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:54.114964 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc088c-ea58-4f79-a7d5-eecc9275d9e2 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:54.130047 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1052/2100] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:54.442313 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94e786-7c0d-4d72-aaf4-8bea38bcc7dd service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:54.444516 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7f94e786-7c0d-4d72-aaf4-8bea38bcc7dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:54.457931 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94e786-7c0d-4d72-aaf4-8bea38bcc7dd service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:54.465890 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594774f-639a-4faa-bb5c-c7dc87dae31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:54.466912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594774f-639a-4faa-bb5c-c7dc87dae31e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:54.467682 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594774f-639a-4faa-bb5c-c7dc87dae31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:54.468236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594774f-639a-4faa-bb5c-c7dc87dae31e admin admin] PATH_INFO: `/v3/projects/6a7dc9f1225e4bf1be128dcec462721b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:54.469775 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594774f-639a-4faa-bb5c-c7dc87dae31e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a7dc9f1225e4bf1be128dcec462721b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:54.472299 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594774f-639a-4faa-bb5c-c7dc87dae31e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:54.515960 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc088c-ea58-4f79-a7d5-eecc9275d9e2 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:54.517782 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6ffc088c-ea58-4f79-a7d5-eecc9275d9e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:54.535125 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4594774f-639a-4faa-bb5c-c7dc87dae31e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a7dc9f1225e4bf1be128dcec462721b', 'request_id': 'req-4594774f-639a-4faa-bb5c-c7dc87dae31e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:54.546166 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4594774f-639a-4faa-bb5c-c7dc87dae31e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a7dc9f1225e4bf1be128dcec462721b', 'request_id': 'req-4594774f-639a-4faa-bb5c-c7dc87dae31e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:54.551065 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc088c-ea58-4f79-a7d5-eecc9275d9e2 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:54.557516 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4594774f-639a-4faa-bb5c-c7dc87dae31e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a7dc9f1225e4bf1be128dcec462721b', 'request_id': 'req-4594774f-639a-4faa-bb5c-c7dc87dae31e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:54.572738 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4594774f-639a-4faa-bb5c-c7dc87dae31e admin admin] The token cache is being invalidate because project 6a7dc9f1225e4bf1be128dcec462721b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:54.573032 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4594774f-639a-4faa-bb5c-c7dc87dae31e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:54.573697 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4594774f-639a-4faa-bb5c-c7dc87dae31e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:54.578134 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1049/2101] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:54 2022] DELETE /identity/v3/projects/6a7dc9f1225e4bf1be128dcec462721b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:54.579204 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594774f-639a-4faa-bb5c-c7dc87dae31e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:54.580724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4594774f-639a-4faa-bb5c-c7dc87dae31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:54.630063 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e781888-f248-49b6-b720-7ba4ab18b872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:54.631149 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e781888-f248-49b6-b720-7ba4ab18b872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:54.631955 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e781888-f248-49b6-b720-7ba4ab18b872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:54.632231 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e781888-f248-49b6-b720-7ba4ab18b872 admin admin] PATH_INFO: `/v3/projects/03ed88c3e9384a42a5ecb28a0860dc7e` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:54.634069 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e781888-f248-49b6-b720-7ba4ab18b872 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03ed88c3e9384a42a5ecb28a0860dc7e)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:54.636798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e781888-f248-49b6-b720-7ba4ab18b872 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:54.652036 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:54.656026 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594774f-639a-4faa-bb5c-c7dc87dae31e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:54.663403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9e50b-0e2a-46d9-9dda-9b68024c12c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:54.664045 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9e50b-0e2a-46d9-9dda-9b68024c12c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:54.664441 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9e50b-0e2a-46d9-9dda-9b68024c12c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:54.664723 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9e50b-0e2a-46d9-9dda-9b68024c12c1 admin admin] PATH_INFO: `/v3/users/6585b521c29a4315b12d955099c0e3b1` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:54.666266 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9e50b-0e2a-46d9-9dda-9b68024c12c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6585b521c29a4315b12d955099c0e3b1)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:54.668364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9e50b-0e2a-46d9-9dda-9b68024c12c1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:54.695908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9e781888-f248-49b6-b720-7ba4ab18b872 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ed88c3e9384a42a5ecb28a0860dc7e', 'request_id': 'req-9e781888-f248-49b6-b720-7ba4ab18b872'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:54.703802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9e781888-f248-49b6-b720-7ba4ab18b872 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ed88c3e9384a42a5ecb28a0860dc7e', 'request_id': 'req-9e781888-f248-49b6-b720-7ba4ab18b872'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:54.708089 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:54.710291 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9e781888-f248-49b6-b720-7ba4ab18b872 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ed88c3e9384a42a5ecb28a0860dc7e', 'request_id': 'req-9e781888-f248-49b6-b720-7ba4ab18b872'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:54.726937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9e781888-f248-49b6-b720-7ba4ab18b872 admin admin] The token cache is being invalidate because project 03ed88c3e9384a42a5ecb28a0860dc7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:54.727224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9e781888-f248-49b6-b720-7ba4ab18b872 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:54.728022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9e781888-f248-49b6-b720-7ba4ab18b872 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:54.729658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1053/2102] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:54 2022] DELETE /identity/v3/projects/03ed88c3e9384a42a5ecb28a0860dc7e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:54.732794 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e781888-f248-49b6-b720-7ba4ab18b872 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:54.732897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7df9e50b-0e2a-46d9-9dda-9b68024c12c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6585b521c29a4315b12d955099c0e3b1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:54.732981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9e781888-f248-49b6-b720-7ba4ab18b872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:54.740193 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7df9e50b-0e2a-46d9-9dda-9b68024c12c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6585b521c29a4315b12d955099c0e3b1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:54.749151 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7df9e50b-0e2a-46d9-9dda-9b68024c12c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6585b521c29a4315b12d955099c0e3b1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:54.766764 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7df9e50b-0e2a-46d9-9dda-9b68024c12c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6585b521c29a4315b12d955099c0e3b1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:54.767769 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7df9e50b-0e2a-46d9-9dda-9b68024c12c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6585b521c29a4315b12d955099c0e3b1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:54.775475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1050/2103] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:54 2022] DELETE /identity/v3/users/6585b521c29a4315b12d955099c0e3b1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:54.776146 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9e50b-0e2a-46d9-9dda-9b68024c12c1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:54.777488 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7df9e50b-0e2a-46d9-9dda-9b68024c12c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:54.822321 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e781888-f248-49b6-b720-7ba4ab18b872 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:54.875418 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9e50b-0e2a-46d9-9dda-9b68024c12c1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:54.881404 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e782af-4e04-49cf-bf73-345122c75d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:54.882578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e782af-4e04-49cf-bf73-345122c75d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:54.883016 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e782af-4e04-49cf-bf73-345122c75d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:54.883202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e782af-4e04-49cf-bf73-345122c75d93 admin admin] PATH_INFO: `/v3/users/d49bb40b904947358863ef8abee2799a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:54.884611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e782af-4e04-49cf-bf73-345122c75d93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d49bb40b904947358863ef8abee2799a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:54.887161 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e782af-4e04-49cf-bf73-345122c75d93 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:54.912204 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2ab94-06b2-4a2b-9fca-15aa27278cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:54.913123 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2ab94-06b2-4a2b-9fca-15aa27278cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:54.913762 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2ab94-06b2-4a2b-9fca-15aa27278cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:54.914179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2ab94-06b2-4a2b-9fca-15aa27278cc8 admin admin] PATH_INFO: `/v3/projects/aafe53bb59484750bc71eefc119cda8f` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:54.915728 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2ab94-06b2-4a2b-9fca-15aa27278cc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aafe53bb59484750bc71eefc119cda8f)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:54.918358 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2ab94-06b2-4a2b-9fca-15aa27278cc8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:54.961746 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d9e782af-4e04-49cf-bf73-345122c75d93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd49bb40b904947358863ef8abee2799a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:54.973322 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d9e782af-4e04-49cf-bf73-345122c75d93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd49bb40b904947358863ef8abee2799a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:54.986435 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d9e782af-4e04-49cf-bf73-345122c75d93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd49bb40b904947358863ef8abee2799a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:54.991057 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-61f2ab94-06b2-4a2b-9fca-15aa27278cc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aafe53bb59484750bc71eefc119cda8f', 'request_id': 'req-61f2ab94-06b2-4a2b-9fca-15aa27278cc8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.002847 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-61f2ab94-06b2-4a2b-9fca-15aa27278cc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aafe53bb59484750bc71eefc119cda8f', 'request_id': 'req-61f2ab94-06b2-4a2b-9fca-15aa27278cc8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.004856 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:55.007585 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d9e782af-4e04-49cf-bf73-345122c75d93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd49bb40b904947358863ef8abee2799a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.009505 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d9e782af-4e04-49cf-bf73-345122c75d93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd49bb40b904947358863ef8abee2799a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.013295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-61f2ab94-06b2-4a2b-9fca-15aa27278cc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aafe53bb59484750bc71eefc119cda8f', 'request_id': 'req-61f2ab94-06b2-4a2b-9fca-15aa27278cc8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.023450 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1051/2104] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:54 2022] DELETE /identity/v3/users/d49bb40b904947358863ef8abee2799a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:55.059040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-61f2ab94-06b2-4a2b-9fca-15aa27278cc8 admin admin] The token cache is being invalidate because project aafe53bb59484750bc71eefc119cda8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:55.059383 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-61f2ab94-06b2-4a2b-9fca-15aa27278cc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.060951 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-61f2ab94-06b2-4a2b-9fca-15aa27278cc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.071050 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1054/2105] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:54 2022] DELETE /identity/v3/projects/aafe53bb59484750bc71eefc119cda8f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:55.072239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e782af-4e04-49cf-bf73-345122c75d93 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:55.074992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d9e782af-4e04-49cf-bf73-345122c75d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:55.185766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e782af-4e04-49cf-bf73-345122c75d93 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:55.202866 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62771e4c-ca8b-49ca-b261-b22843122732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:55.203591 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62771e4c-ca8b-49ca-b261-b22843122732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:55.203875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62771e4c-ca8b-49ca-b261-b22843122732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:55.204146 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62771e4c-ca8b-49ca-b261-b22843122732 admin admin] PATH_INFO: `/v3/users/68f52b51138d4e5dad7d413b4c9e29b6` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:55.205311 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62771e4c-ca8b-49ca-b261-b22843122732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68f52b51138d4e5dad7d413b4c9e29b6)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:55.207251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62771e4c-ca8b-49ca-b261-b22843122732 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:55.220977 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2ab94-06b2-4a2b-9fca-15aa27278cc8 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:55.222611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-61f2ab94-06b2-4a2b-9fca-15aa27278cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:55.277157 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:55.299866 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-62771e4c-ca8b-49ca-b261-b22843122732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68f52b51138d4e5dad7d413b4c9e29b6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.307855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-62771e4c-ca8b-49ca-b261-b22843122732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68f52b51138d4e5dad7d413b4c9e29b6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.317626 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-62771e4c-ca8b-49ca-b261-b22843122732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68f52b51138d4e5dad7d413b4c9e29b6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.336824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-62771e4c-ca8b-49ca-b261-b22843122732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68f52b51138d4e5dad7d413b4c9e29b6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.337738 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-62771e4c-ca8b-49ca-b261-b22843122732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68f52b51138d4e5dad7d413b4c9e29b6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.347651 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1052/2106] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:55 2022] DELETE /identity/v3/users/68f52b51138d4e5dad7d413b4c9e29b6 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:55.387095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2ab94-06b2-4a2b-9fca-15aa27278cc8 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:55.434154 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62771e4c-ca8b-49ca-b261-b22843122732 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:55.435750 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-62771e4c-ca8b-49ca-b261-b22843122732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:55.556071 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62771e4c-ca8b-49ca-b261-b22843122732 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:55.565609 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27de92-6c4c-45ba-89a1-98aac1071115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:55.568454 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27de92-6c4c-45ba-89a1-98aac1071115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:55.568619 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27de92-6c4c-45ba-89a1-98aac1071115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:55.570208 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27de92-6c4c-45ba-89a1-98aac1071115 admin admin] PATH_INFO: `/v3/projects/0c81f5f4df2945cfaba5d9303271154e` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:55.574115 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27de92-6c4c-45ba-89a1-98aac1071115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c81f5f4df2945cfaba5d9303271154e)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:55.576230 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149619f-3cb5-4fb2-adc7-d577f57da07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:55.576898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149619f-3cb5-4fb2-adc7-d577f57da07c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:55.577235 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149619f-3cb5-4fb2-adc7-d577f57da07c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:55.578130 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149619f-3cb5-4fb2-adc7-d577f57da07c admin admin] PATH_INFO: `/v3/projects/67555e44780d411cab094b9532a6b02f` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:55.579285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149619f-3cb5-4fb2-adc7-d577f57da07c admin admin] RBAC: Authorizing `identity:delete_project(project_id=67555e44780d411cab094b9532a6b02f)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:55.583006 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27de92-6c4c-45ba-89a1-98aac1071115 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:55.592740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149619f-3cb5-4fb2-adc7-d577f57da07c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:55.631512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:55.678870 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c149619f-3cb5-4fb2-adc7-d577f57da07c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67555e44780d411cab094b9532a6b02f', 'request_id': 'req-c149619f-3cb5-4fb2-adc7-d577f57da07c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.683983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7f27de92-6c4c-45ba-89a1-98aac1071115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c81f5f4df2945cfaba5d9303271154e', 'request_id': 'req-7f27de92-6c4c-45ba-89a1-98aac1071115'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.691110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c149619f-3cb5-4fb2-adc7-d577f57da07c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67555e44780d411cab094b9532a6b02f', 'request_id': 'req-c149619f-3cb5-4fb2-adc7-d577f57da07c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.693125 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7f27de92-6c4c-45ba-89a1-98aac1071115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c81f5f4df2945cfaba5d9303271154e', 'request_id': 'req-7f27de92-6c4c-45ba-89a1-98aac1071115'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.700154 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c149619f-3cb5-4fb2-adc7-d577f57da07c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67555e44780d411cab094b9532a6b02f', 'request_id': 'req-c149619f-3cb5-4fb2-adc7-d577f57da07c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.714348 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7f27de92-6c4c-45ba-89a1-98aac1071115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c81f5f4df2945cfaba5d9303271154e', 'request_id': 'req-7f27de92-6c4c-45ba-89a1-98aac1071115'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.715323 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c149619f-3cb5-4fb2-adc7-d577f57da07c admin admin] The token cache is being invalidate because project 67555e44780d411cab094b9532a6b02f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:55.715649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c149619f-3cb5-4fb2-adc7-d577f57da07c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.716451 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c149619f-3cb5-4fb2-adc7-d577f57da07c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.719616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1053/2107] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:55 2022] DELETE /identity/v3/projects/67555e44780d411cab094b9532a6b02f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:55.723812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149619f-3cb5-4fb2-adc7-d577f57da07c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:55.725359 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c149619f-3cb5-4fb2-adc7-d577f57da07c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:55.730900 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7f27de92-6c4c-45ba-89a1-98aac1071115 admin admin] The token cache is being invalidate because project 0c81f5f4df2945cfaba5d9303271154e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:55.731265 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7f27de92-6c4c-45ba-89a1-98aac1071115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.742425 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7f27de92-6c4c-45ba-89a1-98aac1071115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.745653 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1055/2108] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:55 2022] DELETE /identity/v3/projects/0c81f5f4df2945cfaba5d9303271154e => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:58:55.758796 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9d7f4-6f39-4107-9f1d-87cc25571381 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:55.758796 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9d7f4-6f39-4107-9f1d-87cc25571381 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:55.758796 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9d7f4-6f39-4107-9f1d-87cc25571381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:55.776431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-54c9d7f4-6f39-4107-9f1d-87cc25571381 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:55.777939 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-54c9d7f4-6f39-4107-9f1d-87cc25571381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:55.799467 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149619f-3cb5-4fb2-adc7-d577f57da07c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:55.864405 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1056/2109] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:55.870828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c7d59-4efe-45ce-b460-6beca90bd1b1 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:55.870828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c7d59-4efe-45ce-b460-6beca90bd1b1 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:55.870828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c7d59-4efe-45ce-b460-6beca90bd1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:55.875398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:55.879730 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec49fd-6d4d-4207-a000-a4ea149357b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:55.880351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec49fd-6d4d-4207-a000-a4ea149357b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:55.880653 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec49fd-6d4d-4207-a000-a4ea149357b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:55.880955 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec49fd-6d4d-4207-a000-a4ea149357b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:55.882708 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4aec49fd-6d4d-4207-a000-a4ea149357b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:55.891693 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-672c7d59-4efe-45ce-b460-6beca90bd1b1 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:55.892975 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-672c7d59-4efe-45ce-b460-6beca90bd1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:55.900845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1057/2110] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:55.907595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c7d59-4efe-45ce-b460-6beca90bd1b1 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:55.907595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-672c7d59-4efe-45ce-b460-6beca90bd1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:55.914780 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c7d59-4efe-45ce-b460-6beca90bd1b1 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:55.919269 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772e311-6381-4d4b-a8d8-77a456813cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:55.919927 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772e311-6381-4d4b-a8d8-77a456813cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:55.920333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772e311-6381-4d4b-a8d8-77a456813cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:55.920606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772e311-6381-4d4b-a8d8-77a456813cb4 admin admin] PATH_INFO: `/v3/projects/3f5d317681c341779eb808051c0440a6` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:55.921809 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772e311-6381-4d4b-a8d8-77a456813cb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f5d317681c341779eb808051c0440a6)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:55.923758 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772e311-6381-4d4b-a8d8-77a456813cb4 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:55.946150 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec49fd-6d4d-4207-a000-a4ea149357b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:55.947701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec49fd-6d4d-4207-a000-a4ea149357b0 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:55.957856 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1054/2111] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:55.959103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00527d84-f2bd-428c-b89e-3221dc60250e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:55.959411 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00527d84-f2bd-428c-b89e-3221dc60250e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:55.959690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00527d84-f2bd-428c-b89e-3221dc60250e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:55.971762 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6772e311-6381-4d4b-a8d8-77a456813cb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f5d317681c341779eb808051c0440a6', 'request_id': 'req-6772e311-6381-4d4b-a8d8-77a456813cb4'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.977934 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6772e311-6381-4d4b-a8d8-77a456813cb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f5d317681c341779eb808051c0440a6', 'request_id': 'req-6772e311-6381-4d4b-a8d8-77a456813cb4'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.982923 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-00527d84-f2bd-428c-b89e-3221dc60250e None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:55.984580 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-00527d84-f2bd-428c-b89e-3221dc60250e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:55.985647 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6772e311-6381-4d4b-a8d8-77a456813cb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f5d317681c341779eb808051c0440a6', 'request_id': 'req-6772e311-6381-4d4b-a8d8-77a456813cb4'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:55.996760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:56.002850 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6772e311-6381-4d4b-a8d8-77a456813cb4 admin admin] The token cache is being invalidate because project 3f5d317681c341779eb808051c0440a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:56.003166 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6772e311-6381-4d4b-a8d8-77a456813cb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:56.004061 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6772e311-6381-4d4b-a8d8-77a456813cb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:56.005866 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1058/2112] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:55 2022] DELETE /identity/v3/projects/3f5d317681c341779eb808051c0440a6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:56.007046 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1c3e8-53db-408a-a202-75f54e09a919 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.007330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1c3e8-53db-408a-a202-75f54e09a919 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.007638 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1c3e8-53db-408a-a202-75f54e09a919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.029899 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-8bf1c3e8-53db-408a-a202-75f54e09a919 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:56.031505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8bf1c3e8-53db-408a-a202-75f54e09a919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:56.069989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1055/2113] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:56.069989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a1254-0371-4862-ae4e-db774985b9c2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.069989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a1254-0371-4862-ae4e-db774985b9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.069989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a1254-0371-4862-ae4e-db774985b9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.093890 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-db8a1254-0371-4862-ae4e-db774985b9c2 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:56.095586 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-db8a1254-0371-4862-ae4e-db774985b9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:56.111123 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1056/2114] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:56.111123 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a1254-0371-4862-ae4e-db774985b9c2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.111907 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1059/2115] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:56.114344 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe6888-762e-48fb-ade2-2aaa3a032ff4 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.114638 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe6888-762e-48fb-ade2-2aaa3a032ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.114912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe6888-762e-48fb-ade2-2aaa3a032ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.122422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a1254-0371-4862-ae4e-db774985b9c2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.127471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edfd18-b247-4db3-b520-e6195459115c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.128084 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edfd18-b247-4db3-b520-e6195459115c admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.128360 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edfd18-b247-4db3-b520-e6195459115c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.128634 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edfd18-b247-4db3-b520-e6195459115c admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.129272 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edfd18-b247-4db3-b520-e6195459115c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:56.129570 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edfd18-b247-4db3-b520-e6195459115c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.131163 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edfd18-b247-4db3-b520-e6195459115c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.142326 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-0dfe6888-762e-48fb-ade2-2aaa3a032ff4 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:56.143565 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0dfe6888-762e-48fb-ade2-2aaa3a032ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:56.146589 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1057/2116] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:56.147404 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edfd18-b247-4db3-b520-e6195459115c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.156890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1060/2117] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:56.157604 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe6888-762e-48fb-ade2-2aaa3a032ff4 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.163905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edfd18-b247-4db3-b520-e6195459115c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.169576 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe6888-762e-48fb-ade2-2aaa3a032ff4 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.170026 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e112b0-1efc-4fda-8fcb-89687c48ac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.170757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e112b0-1efc-4fda-8fcb-89687c48ac82 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.171190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e112b0-1efc-4fda-8fcb-89687c48ac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.171506 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e112b0-1efc-4fda-8fcb-89687c48ac82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.172397 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e112b0-1efc-4fda-8fcb-89687c48ac82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:56.172702 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e112b0-1efc-4fda-8fcb-89687c48ac82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.174312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e112b0-1efc-4fda-8fcb-89687c48ac82 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.174515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98230979-b4a5-4af3-a596-702255bd79cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.175128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98230979-b4a5-4af3-a596-702255bd79cb admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.175468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98230979-b4a5-4af3-a596-702255bd79cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.175740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98230979-b4a5-4af3-a596-702255bd79cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.176372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98230979-b4a5-4af3-a596-702255bd79cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.178289 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98230979-b4a5-4af3-a596-702255bd79cb admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.190398 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1058/2118] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:56.191337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e112b0-1efc-4fda-8fcb-89687c48ac82 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.205956 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e112b0-1efc-4fda-8fcb-89687c48ac82 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.216089 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51f02d-c478-4111-9fa6-34968ab12a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.216089 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51f02d-c478-4111-9fa6-34968ab12a2b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.216089 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51f02d-c478-4111-9fa6-34968ab12a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.216089 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51f02d-c478-4111-9fa6-34968ab12a2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.216511 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51f02d-c478-4111-9fa6-34968ab12a2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:56.216511 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51f02d-c478-4111-9fa6-34968ab12a2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.216793 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1061/2119] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:56 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:56.217596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51f02d-c478-4111-9fa6-34968ab12a2b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.217902 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98230979-b4a5-4af3-a596-702255bd79cb admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.230881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1059/2120] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:56.235023 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51f02d-c478-4111-9fa6-34968ab12a2b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.246365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51f02d-c478-4111-9fa6-34968ab12a2b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.279923 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:56.293459 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98230979-b4a5-4af3-a596-702255bd79cb admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.300144 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30506dcd-87d3-42dd-9aa6-df27f0de3325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.300753 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30506dcd-87d3-42dd-9aa6-df27f0de3325 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.301026 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30506dcd-87d3-42dd-9aa6-df27f0de3325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.301309 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30506dcd-87d3-42dd-9aa6-df27f0de3325 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.301961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30506dcd-87d3-42dd-9aa6-df27f0de3325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.304094 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30506dcd-87d3-42dd-9aa6-df27f0de3325 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.314592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b725a-6482-4efd-b335-8b5e141ba665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.315212 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b725a-6482-4efd-b335-8b5e141ba665 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.315542 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b725a-6482-4efd-b335-8b5e141ba665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.315822 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b725a-6482-4efd-b335-8b5e141ba665 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.316455 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b725a-6482-4efd-b335-8b5e141ba665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.318373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b725a-6482-4efd-b335-8b5e141ba665 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.332819 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1062/2121] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:56 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:56.336751 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30506dcd-87d3-42dd-9aa6-df27f0de3325 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.350399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1060/2122] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:56 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:56.351495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b725a-6482-4efd-b335-8b5e141ba665 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.363243 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b725a-6482-4efd-b335-8b5e141ba665 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.419119 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30506dcd-87d3-42dd-9aa6-df27f0de3325 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.426853 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691b869-02f2-43d2-ab32-b83ed591c6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.427459 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691b869-02f2-43d2-ab32-b83ed591c6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.427970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691b869-02f2-43d2-ab32-b83ed591c6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.428382 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691b869-02f2-43d2-ab32-b83ed591c6e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.429473 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691b869-02f2-43d2-ab32-b83ed591c6e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.433441 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107a59a-d1ae-4693-bfdc-f5dee737fdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.433593 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691b869-02f2-43d2-ab32-b83ed591c6e2 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.434099 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107a59a-d1ae-4693-bfdc-f5dee737fdd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.434386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107a59a-d1ae-4693-bfdc-f5dee737fdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.434700 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107a59a-d1ae-4693-bfdc-f5dee737fdd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.435347 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107a59a-d1ae-4693-bfdc-f5dee737fdd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.438171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107a59a-d1ae-4693-bfdc-f5dee737fdd6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.446453 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:56.464970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1061/2123] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:56 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:56.468645 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107a59a-d1ae-4693-bfdc-f5dee737fdd6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.474069 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1063/2124] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:56 2022] POST /identity/v3/projects => generated 393 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:56.474958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691b869-02f2-43d2-ab32-b83ed591c6e2 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.479569 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107a59a-d1ae-4693-bfdc-f5dee737fdd6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.545318 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691b869-02f2-43d2-ab32-b83ed591c6e2 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.549037 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf96ac-c173-4efa-b942-032fa04ef70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.549663 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf96ac-c173-4efa-b942-032fa04ef70e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.550062 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9e30c-da50-44a3-90f1-25aa785bca0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.550684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9e30c-da50-44a3-90f1-25aa785bca0f admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.550964 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9e30c-da50-44a3-90f1-25aa785bca0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.551343 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9e30c-da50-44a3-90f1-25aa785bca0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.551482 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf96ac-c173-4efa-b942-032fa04ef70e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.551699 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf96ac-c173-4efa-b942-032fa04ef70e admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.552014 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9e30c-da50-44a3-90f1-25aa785bca0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.552364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf96ac-c173-4efa-b942-032fa04ef70e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.553642 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9e30c-da50-44a3-90f1-25aa785bca0f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.554137 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf96ac-c173-4efa-b942-032fa04ef70e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.568104 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1064/2125] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:56.568104 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9e30c-da50-44a3-90f1-25aa785bca0f admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.574602 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1062/2126] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:56.574602 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf96ac-c173-4efa-b942-032fa04ef70e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.576492 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9e30c-da50-44a3-90f1-25aa785bca0f admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.581483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc95044-6128-4755-a3df-4accc0d9e71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.582121 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc95044-6128-4755-a3df-4accc0d9e71d admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.582373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc95044-6128-4755-a3df-4accc0d9e71d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.582645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc95044-6128-4755-a3df-4accc0d9e71d admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.583607 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc95044-6128-4755-a3df-4accc0d9e71d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.585370 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc95044-6128-4755-a3df-4accc0d9e71d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.586427 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf96ac-c173-4efa-b942-032fa04ef70e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.591292 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71f463-8376-40d4-9c39-48519d97d24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.592088 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71f463-8376-40d4-9c39-48519d97d24d admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.592437 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71f463-8376-40d4-9c39-48519d97d24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.592869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71f463-8376-40d4-9c39-48519d97d24d admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.593783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71f463-8376-40d4-9c39-48519d97d24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.595741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71f463-8376-40d4-9c39-48519d97d24d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.609071 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1063/2127] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:56.613509 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1065/2128] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:56 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:56.613509 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc95044-6128-4755-a3df-4accc0d9e71d admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.613682 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71f463-8376-40d4-9c39-48519d97d24d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.624315 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc95044-6128-4755-a3df-4accc0d9e71d admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.624488 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71f463-8376-40d4-9c39-48519d97d24d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.628924 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eada275-ee4d-4d75-b084-14d6eab5f2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.629530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eada275-ee4d-4d75-b084-14d6eab5f2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.629750 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a52173-45c7-417d-ae14-e98d9488bc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.629874 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eada275-ee4d-4d75-b084-14d6eab5f2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.630120 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eada275-ee4d-4d75-b084-14d6eab5f2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.630411 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a52173-45c7-417d-ae14-e98d9488bc7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.630687 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a52173-45c7-417d-ae14-e98d9488bc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.630814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eada275-ee4d-4d75-b084-14d6eab5f2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.630958 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a52173-45c7-417d-ae14-e98d9488bc7e admin admin] PATH_INFO: `/v3/projects/205c8405ecb84d20a5ba6c7b0e01e5c1/users/066b303d88a34a739b887eda9ca9baa5/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.632447 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eada275-ee4d-4d75-b084-14d6eab5f2f0 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.643284 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1066/2129] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:56.644107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eada275-ee4d-4d75-b084-14d6eab5f2f0 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.645672 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a52173-45c7-417d-ae14-e98d9488bc7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=205c8405ecb84d20a5ba6c7b0e01e5c1, user_id=066b303d88a34a739b887eda9ca9baa5, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.648443 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a52173-45c7-417d-ae14-e98d9488bc7e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.654208 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eada275-ee4d-4d75-b084-14d6eab5f2f0 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.662833 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1064/2130] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:56 2022] PUT /identity/v3/projects/205c8405ecb84d20a5ba6c7b0e01e5c1/users/066b303d88a34a739b887eda9ca9baa5/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:56.663400 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83462e61-4559-4ce8-9b26-82505719769c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.663755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a52173-45c7-417d-ae14-e98d9488bc7e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.663979 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83462e61-4559-4ce8-9b26-82505719769c admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.664260 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83462e61-4559-4ce8-9b26-82505719769c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.664537 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83462e61-4559-4ce8-9b26-82505719769c admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.665213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83462e61-4559-4ce8-9b26-82505719769c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.665821 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-12a52173-45c7-417d-ae14-e98d9488bc7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:56.666833 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83462e61-4559-4ce8-9b26-82505719769c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.679134 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1067/2131] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:56.680060 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83462e61-4559-4ce8-9b26-82505719769c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.695409 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83462e61-4559-4ce8-9b26-82505719769c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.711811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:56.739201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a52173-45c7-417d-ae14-e98d9488bc7e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.744227 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739141f-5492-4997-9cf8-02efa9745955 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.745200 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739141f-5492-4997-9cf8-02efa9745955 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.745486 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739141f-5492-4997-9cf8-02efa9745955 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.746513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739141f-5492-4997-9cf8-02efa9745955 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.748538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d739141f-5492-4997-9cf8-02efa9745955 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:56.766625 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5f1a6-26a7-4b73-9c46-a6652530ae72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.767332 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5f1a6-26a7-4b73-9c46-a6652530ae72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.767607 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5f1a6-26a7-4b73-9c46-a6652530ae72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.767878 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5f1a6-26a7-4b73-9c46-a6652530ae72 admin admin] PATH_INFO: `/v3/projects/7a7ddef4a77a480db1c4ecf5e1ad16bc/users/68f27885290a4b4184fc601314455f84/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.787653 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5f1a6-26a7-4b73-9c46-a6652530ae72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a7ddef4a77a480db1c4ecf5e1ad16bc, user_id=68f27885290a4b4184fc601314455f84, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.791121 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5f1a6-26a7-4b73-9c46-a6652530ae72 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.810417 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1068/2132] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:56 2022] PUT /identity/v3/projects/7a7ddef4a77a480db1c4ecf5e1ad16bc/users/68f27885290a4b4184fc601314455f84/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:56.812177 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15c1d3-dc71-4ade-8f50-7ace273e06f0 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.812833 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15c1d3-dc71-4ade-8f50-7ace273e06f0 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.812833 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15c1d3-dc71-4ade-8f50-7ace273e06f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.838704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739141f-5492-4997-9cf8-02efa9745955 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.841618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739141f-5492-4997-9cf8-02efa9745955 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.850480 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:56.859607 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1065/2133] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:56.860952 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-3e15c1d3-dc71-4ade-8f50-7ace273e06f0 None None] MFA Rules not processed for user `066b303d88a34a739b887eda9ca9baa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:56.861885 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739141f-5492-4997-9cf8-02efa9745955 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:56.863405 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3e15c1d3-dc71-4ade-8f50-7ace273e06f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:56.878519 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739141f-5492-4997-9cf8-02efa9745955 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:56.963697 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3cf34-c3ec-4896-bb46-32473671e032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:56.964369 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3cf34-c3ec-4896-bb46-32473671e032 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.964753 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3cf34-c3ec-4896-bb46-32473671e032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.965094 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3cf34-c3ec-4896-bb46-32473671e032 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.965866 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3cf34-c3ec-4896-bb46-32473671e032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:56.967567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3cf34-c3ec-4896-bb46-32473671e032 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:56.977668 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1069/2134] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:56.982657 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87021942-5112-4a09-8ebb-13bfd736ff2d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:56.982657 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87021942-5112-4a09-8ebb-13bfd736ff2d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:56.982657 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87021942-5112-4a09-8ebb-13bfd736ff2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:56.986509 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1066/2135] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:56.988443 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3cf34-c3ec-4896-bb46-32473671e032 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:57.000742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3cf34-c3ec-4896-bb46-32473671e032 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:57.007921 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6ac50-c45d-45c8-9827-74457ce03b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:57.008625 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6ac50-c45d-45c8-9827-74457ce03b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.008906 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6ac50-c45d-45c8-9827-74457ce03b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.009609 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6ac50-c45d-45c8-9827-74457ce03b6a admin admin] PATH_INFO: `/v3/projects/1b62804c1d684e7c8ede2a0de86d3733/users/b228ca43f49249bd815b0b34b4d4d172/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.013024 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-87021942-5112-4a09-8ebb-13bfd736ff2d None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:57.014379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-87021942-5112-4a09-8ebb-13bfd736ff2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:57.031424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1070/2136] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:57.031424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87021942-5112-4a09-8ebb-13bfd736ff2d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:57.033311 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6ac50-c45d-45c8-9827-74457ce03b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b62804c1d684e7c8ede2a0de86d3733, user_id=b228ca43f49249bd815b0b34b4d4d172, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:57.036740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6ac50-c45d-45c8-9827-74457ce03b6a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:57.050978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1067/2137] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:56 2022] PUT /identity/v3/projects/1b62804c1d684e7c8ede2a0de86d3733/users/b228ca43f49249bd815b0b34b4d4d172/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:57.051969 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6ac50-c45d-45c8-9827-74457ce03b6a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:57.053662 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d0a6ac50-c45d-45c8-9827-74457ce03b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:57.097503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87021942-5112-4a09-8ebb-13bfd736ff2d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:57.120268 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6ac50-c45d-45c8-9827-74457ce03b6a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:57.125927 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9e75b-7533-4be3-8b66-c50401c9ea52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:57.126621 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9e75b-7533-4be3-8b66-c50401c9ea52 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.126898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9e75b-7533-4be3-8b66-c50401c9ea52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.127615 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9e75b-7533-4be3-8b66-c50401c9ea52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.141953 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:57.155000 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005550d-f6ce-4298-9259-bed11b2bded5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:57.155834 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005550d-f6ce-4298-9259-bed11b2bded5 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.156111 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005550d-f6ce-4298-9259-bed11b2bded5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.156662 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005550d-f6ce-4298-9259-bed11b2bded5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.194096 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9e75b-7533-4be3-8b66-c50401c9ea52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:57.195665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9e75b-7533-4be3-8b66-c50401c9ea52 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:57.206640 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1068/2138] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:57.207796 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73cd7c-cb23-4e4c-ad3c-59cd9f19b6fe None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.208079 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73cd7c-cb23-4e4c-ad3c-59cd9f19b6fe None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.208354 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73cd7c-cb23-4e4c-ad3c-59cd9f19b6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.219543 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005550d-f6ce-4298-9259-bed11b2bded5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:57.221021 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005550d-f6ce-4298-9259-bed11b2bded5 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:57.233911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1071/2139] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:57.241462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-de73cd7c-cb23-4e4c-ad3c-59cd9f19b6fe None None] MFA Rules not processed for user `b228ca43f49249bd815b0b34b4d4d172`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:57.242802 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-de73cd7c-cb23-4e4c-ad3c-59cd9f19b6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:57.254153 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:57.330671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1069/2140] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:57.331976 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005550d-f6ce-4298-9259-bed11b2bded5 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:57.346402 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005550d-f6ce-4298-9259-bed11b2bded5 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:57.351921 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471575c0-c758-47c9-a2cf-79797571c2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:57.352542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471575c0-c758-47c9-a2cf-79797571c2ff admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.352817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471575c0-c758-47c9-a2cf-79797571c2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.353088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471575c0-c758-47c9-a2cf-79797571c2ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.353741 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471575c0-c758-47c9-a2cf-79797571c2ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:57.356523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471575c0-c758-47c9-a2cf-79797571c2ff admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:57.396933 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1072/2141] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:57 2022] POST /identity/v3/projects => generated 391 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:58:57.400564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73cd7c-cb23-4e4c-ad3c-59cd9f19b6fe None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:57.414897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73cd7c-cb23-4e4c-ad3c-59cd9f19b6fe None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:57.492374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef7e3e-ab2a-495f-9caf-42e1cf5419de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:57.493071 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef7e3e-ab2a-495f-9caf-42e1cf5419de admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.493417 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef7e3e-ab2a-495f-9caf-42e1cf5419de admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.493774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef7e3e-ab2a-495f-9caf-42e1cf5419de admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.494495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef7e3e-ab2a-495f-9caf-42e1cf5419de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:57.496530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef7e3e-ab2a-495f-9caf-42e1cf5419de admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:57.520749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1070/2142] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:57 2022] POST /identity/v3/users => generated 302 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:57.525046 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471575c0-c758-47c9-a2cf-79797571c2ff admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:57.545594 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471575c0-c758-47c9-a2cf-79797571c2ff admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:57.551516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef593d-8ece-4a52-b565-e5af67658dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:57.552261 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef593d-8ece-4a52-b565-e5af67658dcb admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.552536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef593d-8ece-4a52-b565-e5af67658dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.552810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef593d-8ece-4a52-b565-e5af67658dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.553905 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef593d-8ece-4a52-b565-e5af67658dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:57.555727 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef593d-8ece-4a52-b565-e5af67658dcb admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:57.591195 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef7e3e-ab2a-495f-9caf-42e1cf5419de admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:57.592202 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1073/2143] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:57.599480 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef7e3e-ab2a-495f-9caf-42e1cf5419de admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:57.606011 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb65c1-ea5f-424f-997a-c3b1aca354d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:57.606704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb65c1-ea5f-424f-997a-c3b1aca354d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.606987 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb65c1-ea5f-424f-997a-c3b1aca354d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.607259 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb65c1-ea5f-424f-997a-c3b1aca354d6 admin admin] PATH_INFO: `/v3/projects/32e29392b47a4a85988b38df2f9f750e/users/2958118adfe044f1b3860fc29e94ff70/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.627524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb65c1-ea5f-424f-997a-c3b1aca354d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32e29392b47a4a85988b38df2f9f750e, user_id=2958118adfe044f1b3860fc29e94ff70, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:57.630595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb65c1-ea5f-424f-997a-c3b1aca354d6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:57.651418 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1071/2144] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:57 2022] PUT /identity/v3/projects/32e29392b47a4a85988b38df2f9f750e/users/2958118adfe044f1b3860fc29e94ff70/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:57.655901 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef593d-8ece-4a52-b565-e5af67658dcb admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:57.666462 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef593d-8ece-4a52-b565-e5af67658dcb admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:57.726790 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a608141-c6d3-41a0-aeec-111654d188f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:57.727832 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a608141-c6d3-41a0-aeec-111654d188f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.728108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a608141-c6d3-41a0-aeec-111654d188f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.728377 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a608141-c6d3-41a0-aeec-111654d188f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.729010 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a608141-c6d3-41a0-aeec-111654d188f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:57.730752 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a608141-c6d3-41a0-aeec-111654d188f0 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:57.741197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1074/2145] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:57.745577 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb65c1-ea5f-424f-997a-c3b1aca354d6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:57.757046 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb65c1-ea5f-424f-997a-c3b1aca354d6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:57.762169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58620672-f3b3-460f-b1b1-ecb2470807b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:57.762930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58620672-f3b3-460f-b1b1-ecb2470807b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.763439 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58620672-f3b3-460f-b1b1-ecb2470807b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.763730 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58620672-f3b3-460f-b1b1-ecb2470807b5 admin admin] PATH_INFO: `/v3/projects/32e29392b47a4a85988b38df2f9f750e/users/2958118adfe044f1b3860fc29e94ff70/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.765878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58620672-f3b3-460f-b1b1-ecb2470807b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32e29392b47a4a85988b38df2f9f750e, user_id=2958118adfe044f1b3860fc29e94ff70, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:57.768559 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58620672-f3b3-460f-b1b1-ecb2470807b5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:57.779160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1072/2146] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:57 2022] PUT /identity/v3/projects/32e29392b47a4a85988b38df2f9f750e/users/2958118adfe044f1b3860fc29e94ff70/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:57.791082 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d9bb0-6aa5-4a9a-8631-0891f32649fa None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.791367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d9bb0-6aa5-4a9a-8631-0891f32649fa None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.791690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d9bb0-6aa5-4a9a-8631-0891f32649fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.821408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-fd1d9bb0-6aa5-4a9a-8631-0891f32649fa None None] MFA Rules not processed for user `2958118adfe044f1b3860fc29e94ff70`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:57.822378 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-fd1d9bb0-6aa5-4a9a-8631-0891f32649fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:57.863166 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58620672-f3b3-460f-b1b1-ecb2470807b5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:57.865124 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-58620672-f3b3-460f-b1b1-ecb2470807b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:57.889231 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:57.929504 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1075/2147] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:57 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:57.930806 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976526e-8cbf-4513-a54c-5f760408d1b1 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.930927 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976526e-8cbf-4513-a54c-5f760408d1b1 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.931280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976526e-8cbf-4513-a54c-5f760408d1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.961434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58620672-f3b3-460f-b1b1-ecb2470807b5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:57.966934 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c0a2a-fe23-44ac-87b1-19761b53644c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:57.968057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c0a2a-fe23-44ac-87b1-19761b53644c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:57.968383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c0a2a-fe23-44ac-87b1-19761b53644c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:57.968493 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-4976526e-8cbf-4513-a54c-5f760408d1b1 None None] MFA Rules not processed for user `68f27885290a4b4184fc601314455f84`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:57.968833 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c0a2a-fe23-44ac-87b1-19761b53644c admin admin] PATH_INFO: `/v3/users/d1c043c3f5014a00b7b87ebd41eab262` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:57.969635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4976526e-8cbf-4513-a54c-5f760408d1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:57.970235 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c0a2a-fe23-44ac-87b1-19761b53644c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c043c3f5014a00b7b87ebd41eab262)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:57.972320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c0a2a-fe23-44ac-87b1-19761b53644c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:57.978386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:58.064347 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-796c0a2a-fe23-44ac-87b1-19761b53644c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c043c3f5014a00b7b87ebd41eab262'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:58.082658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-796c0a2a-fe23-44ac-87b1-19761b53644c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c043c3f5014a00b7b87ebd41eab262'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:58.100064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1076/2148] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:58.104793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-796c0a2a-fe23-44ac-87b1-19761b53644c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c043c3f5014a00b7b87ebd41eab262'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:58.106268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976526e-8cbf-4513-a54c-5f760408d1b1 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:58.107763 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4976526e-8cbf-4513-a54c-5f760408d1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:58.136381 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-796c0a2a-fe23-44ac-87b1-19761b53644c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c043c3f5014a00b7b87ebd41eab262'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:58.137350 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-796c0a2a-fe23-44ac-87b1-19761b53644c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c043c3f5014a00b7b87ebd41eab262'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:58.145354 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1073/2149] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:57 2022] DELETE /identity/v3/users/d1c043c3f5014a00b7b87ebd41eab262 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:58.146674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c0a2a-fe23-44ac-87b1-19761b53644c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:58.148577 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-796c0a2a-fe23-44ac-87b1-19761b53644c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:58.181990 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976526e-8cbf-4513-a54c-5f760408d1b1 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:58.227343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c0a2a-fe23-44ac-87b1-19761b53644c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:58.232383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3fa83-2fc1-4a0f-8e63-0e75784213dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:58.232816 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3fa83-2fc1-4a0f-8e63-0e75784213dd admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:58.233100 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3fa83-2fc1-4a0f-8e63-0e75784213dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:58.233472 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3fa83-2fc1-4a0f-8e63-0e75784213dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:58.234435 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3fa83-2fc1-4a0f-8e63-0e75784213dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:58.236347 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3fa83-2fc1-4a0f-8e63-0e75784213dd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:58.236529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b354d40-ce0a-4b29-bf27-c5277757ebbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:58.237408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b354d40-ce0a-4b29-bf27-c5277757ebbf service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:58.238038 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b354d40-ce0a-4b29-bf27-c5277757ebbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:58.238152 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b354d40-ce0a-4b29-bf27-c5277757ebbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:58.240864 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0b354d40-ce0a-4b29-bf27-c5277757ebbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:58.267731 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1074/2150] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:58 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:58.269339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f3179-9a70-4284-b309-3cd0d2c5b5c0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:58.269627 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f3179-9a70-4284-b309-3cd0d2c5b5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:58.269903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f3179-9a70-4284-b309-3cd0d2c5b5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:58.292085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:58.293283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-064f3179-9a70-4284-b309-3cd0d2c5b5c0 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:58.294610 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-064f3179-9a70-4284-b309-3cd0d2c5b5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:58.319273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b354d40-ce0a-4b29-bf27-c5277757ebbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:58.320847 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b354d40-ce0a-4b29-bf27-c5277757ebbf service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:58.334083 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1077/2151] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:58 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:58.335505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b354d40-ce0a-4b29-bf27-c5277757ebbf service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:58.348389 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b354d40-ce0a-4b29-bf27-c5277757ebbf service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:58.380584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1075/2152] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:58.387419 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f3179-9a70-4284-b309-3cd0d2c5b5c0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:58.389072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-064f3179-9a70-4284-b309-3cd0d2c5b5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:58.408044 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:58.447151 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadc05f-06a8-41de-87ac-3db1fb471c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:58.447802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadc05f-06a8-41de-87ac-3db1fb471c52 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:58.448092 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadc05f-06a8-41de-87ac-3db1fb471c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:58.448347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadc05f-06a8-41de-87ac-3db1fb471c52 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:58.448988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadc05f-06a8-41de-87ac-3db1fb471c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:58.451112 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadc05f-06a8-41de-87ac-3db1fb471c52 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:58.467875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f3179-9a70-4284-b309-3cd0d2c5b5c0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:58.472028 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477dfa1d-c32a-4115-9950-7eb137a34104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:58.472720 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dfa1d-c32a-4115-9950-7eb137a34104 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:58.473013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dfa1d-c32a-4115-9950-7eb137a34104 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:58.473269 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dfa1d-c32a-4115-9950-7eb137a34104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:58.475127 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1078/2153] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:58 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:58.476070 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadc05f-06a8-41de-87ac-3db1fb471c52 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:58.477676 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6fadc05f-06a8-41de-87ac-3db1fb471c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:58.485537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477dfa1d-c32a-4115-9950-7eb137a34104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:58.486914 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477dfa1d-c32a-4115-9950-7eb137a34104 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:58.496867 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1076/2154] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:58.500657 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477dfa1d-c32a-4115-9950-7eb137a34104 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:58.512110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477dfa1d-c32a-4115-9950-7eb137a34104 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:58.517625 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a53ecb-e009-4a47-a34b-c385d77acb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:58.518312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a53ecb-e009-4a47-a34b-c385d77acb46 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:58.518682 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a53ecb-e009-4a47-a34b-c385d77acb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:58.519083 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a53ecb-e009-4a47-a34b-c385d77acb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:58.519898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a53ecb-e009-4a47-a34b-c385d77acb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:58.521552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a53ecb-e009-4a47-a34b-c385d77acb46 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:58.534399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1077/2155] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:58.538827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a53ecb-e009-4a47-a34b-c385d77acb46 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:58.542688 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadc05f-06a8-41de-87ac-3db1fb471c52 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:58.546738 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192647c-fd1e-4e0a-9a80-03699a74b364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:58.547542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192647c-fd1e-4e0a-9a80-03699a74b364 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:58.547773 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192647c-fd1e-4e0a-9a80-03699a74b364 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:58.548036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192647c-fd1e-4e0a-9a80-03699a74b364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:58.550062 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2192647c-fd1e-4e0a-9a80-03699a74b364 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:58.551025 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a53ecb-e009-4a47-a34b-c385d77acb46 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:58.556380 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780841b6-9d59-4ff8-9cd1-d81f2d679dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:58.557346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780841b6-9d59-4ff8-9cd1-d81f2d679dd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:58.557770 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780841b6-9d59-4ff8-9cd1-d81f2d679dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:58.558070 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780841b6-9d59-4ff8-9cd1-d81f2d679dd7 admin admin] PATH_INFO: `/v3/projects/414936f6387b4836ba1dbcd96b6dbe3d/users/690052887c3c44e3aab2eb1b839ec5f1/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:58.578266 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780841b6-9d59-4ff8-9cd1-d81f2d679dd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=414936f6387b4836ba1dbcd96b6dbe3d, user_id=690052887c3c44e3aab2eb1b839ec5f1, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:58.581032 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780841b6-9d59-4ff8-9cd1-d81f2d679dd7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:58.599682 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1078/2156] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:58 2022] PUT /identity/v3/projects/414936f6387b4836ba1dbcd96b6dbe3d/users/690052887c3c44e3aab2eb1b839ec5f1/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:58.604807 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780841b6-9d59-4ff8-9cd1-d81f2d679dd7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:58.622932 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192647c-fd1e-4e0a-9a80-03699a74b364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:58.625097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192647c-fd1e-4e0a-9a80-03699a74b364 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:58.637774 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1079/2157] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:58 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:58.713982 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780841b6-9d59-4ff8-9cd1-d81f2d679dd7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:58.719853 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991a196-41e5-47ef-aebf-3023bd4f819b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:58.720833 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991a196-41e5-47ef-aebf-3023bd4f819b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:58.721309 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991a196-41e5-47ef-aebf-3023bd4f819b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:58.721650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991a196-41e5-47ef-aebf-3023bd4f819b admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:58.722417 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991a196-41e5-47ef-aebf-3023bd4f819b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:58.724960 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991a196-41e5-47ef-aebf-3023bd4f819b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:58.747790 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1079/2158] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:58:58.753336 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192647c-fd1e-4e0a-9a80-03699a74b364 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:58.769595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192647c-fd1e-4e0a-9a80-03699a74b364 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:58.782520 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ba9a3-baec-4553-96b4-ad7b089cdfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:58.783859 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ba9a3-baec-4553-96b4-ad7b089cdfac admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:58.784190 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ba9a3-baec-4553-96b4-ad7b089cdfac admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:58.784820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ba9a3-baec-4553-96b4-ad7b089cdfac admin admin] PATH_INFO: `/v3/projects/414936f6387b4836ba1dbcd96b6dbe3d/users/690052887c3c44e3aab2eb1b839ec5f1/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:58.786805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ba9a3-baec-4553-96b4-ad7b089cdfac admin admin] RBAC: Authorizing `identity:create_grant(project_id=414936f6387b4836ba1dbcd96b6dbe3d, user_id=690052887c3c44e3aab2eb1b839ec5f1, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:58.790156 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ba9a3-baec-4553-96b4-ad7b089cdfac admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:58.805393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1080/2159] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:58 2022] PUT /identity/v3/projects/414936f6387b4836ba1dbcd96b6dbe3d/users/690052887c3c44e3aab2eb1b839ec5f1/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:58.852389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991a196-41e5-47ef-aebf-3023bd4f819b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:58.854413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3991a196-41e5-47ef-aebf-3023bd4f819b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:58.869596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991a196-41e5-47ef-aebf-3023bd4f819b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:58.958284 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e093b9e-9e02-457f-a88b-5d659b52fe55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:58.958936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e093b9e-9e02-457f-a88b-5d659b52fe55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:58.959216 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e093b9e-9e02-457f-a88b-5d659b52fe55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:58.959548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e093b9e-9e02-457f-a88b-5d659b52fe55 admin admin] PATH_INFO: `/v3/projects/3c715c3d62914bc4a64e8e275d4e89ea` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:58.960679 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e093b9e-9e02-457f-a88b-5d659b52fe55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c715c3d62914bc4a64e8e275d4e89ea)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:58.962590 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e093b9e-9e02-457f-a88b-5d659b52fe55 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:58.989955 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:59.076206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6e093b9e-9e02-457f-a88b-5d659b52fe55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c715c3d62914bc4a64e8e275d4e89ea', 'request_id': 'req-6e093b9e-9e02-457f-a88b-5d659b52fe55'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:59.087116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6e093b9e-9e02-457f-a88b-5d659b52fe55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c715c3d62914bc4a64e8e275d4e89ea', 'request_id': 'req-6e093b9e-9e02-457f-a88b-5d659b52fe55'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:59.095206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6e093b9e-9e02-457f-a88b-5d659b52fe55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c715c3d62914bc4a64e8e275d4e89ea', 'request_id': 'req-6e093b9e-9e02-457f-a88b-5d659b52fe55'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:59.124895 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6e093b9e-9e02-457f-a88b-5d659b52fe55 admin admin] The token cache is being invalidate because project 3c715c3d62914bc4a64e8e275d4e89ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:58:59.125416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6e093b9e-9e02-457f-a88b-5d659b52fe55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:59.126278 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6e093b9e-9e02-457f-a88b-5d659b52fe55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:58:59.128911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1080/2160] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:58:58 2022] DELETE /identity/v3/projects/3c715c3d62914bc4a64e8e275d4e89ea => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:59.134270 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7495caf-17b5-4c5f-875f-d8675e63ce09 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:59.134603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7495caf-17b5-4c5f-875f-d8675e63ce09 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:59.134869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7495caf-17b5-4c5f-875f-d8675e63ce09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:59.157956 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-c7495caf-17b5-4c5f-875f-d8675e63ce09 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:59.158978 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c7495caf-17b5-4c5f-875f-d8675e63ce09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:59.163902 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:59.253437 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1081/2161] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:59.261163 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93151416-3fd7-4ae4-9664-a20ef275d3d1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:59.261694 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93151416-3fd7-4ae4-9664-a20ef275d3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:59.262003 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93151416-3fd7-4ae4-9664-a20ef275d3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:59.285349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-93151416-3fd7-4ae4-9664-a20ef275d3d1 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:59.286581 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-93151416-3fd7-4ae4-9664-a20ef275d3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:59.295474 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1081/2162] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:58:59.300212 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7495caf-17b5-4c5f-875f-d8675e63ce09 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:59.310354 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7495caf-17b5-4c5f-875f-d8675e63ce09 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:59.316141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447eced7-e3e5-4f27-a941-baa6fa0ded29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:59.316794 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447eced7-e3e5-4f27-a941-baa6fa0ded29 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:59.317104 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447eced7-e3e5-4f27-a941-baa6fa0ded29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:59.317456 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447eced7-e3e5-4f27-a941-baa6fa0ded29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:59.318114 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447eced7-e3e5-4f27-a941-baa6fa0ded29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:58:59.318424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447eced7-e3e5-4f27-a941-baa6fa0ded29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:59.320127 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447eced7-e3e5-4f27-a941-baa6fa0ded29 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:59.334322 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1082/2163] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:58:59.339391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93151416-3fd7-4ae4-9664-a20ef275d3d1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:59.349746 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93151416-3fd7-4ae4-9664-a20ef275d3d1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:59.355053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44a39a-1d32-4c9e-a339-d5514795b6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:59.355848 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44a39a-1d32-4c9e-a339-d5514795b6fa admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:59.356241 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44a39a-1d32-4c9e-a339-d5514795b6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:59.356687 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44a39a-1d32-4c9e-a339-d5514795b6fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:59.357409 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44a39a-1d32-4c9e-a339-d5514795b6fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:59.359578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44a39a-1d32-4c9e-a339-d5514795b6fa admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:59.391090 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1082/2164] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:58:59 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:59.396820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447eced7-e3e5-4f27-a941-baa6fa0ded29 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:59.410184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447eced7-e3e5-4f27-a941-baa6fa0ded29 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:59.481453 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0f9bb-6fdd-40e7-9320-00aef40b76af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:59.482235 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0f9bb-6fdd-40e7-9320-00aef40b76af admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:59.482489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0f9bb-6fdd-40e7-9320-00aef40b76af admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:59.482732 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0f9bb-6fdd-40e7-9320-00aef40b76af admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:59.483629 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0f9bb-6fdd-40e7-9320-00aef40b76af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:59.485615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0f9bb-6fdd-40e7-9320-00aef40b76af admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:59.515046 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1083/2165] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:58:59 2022] POST /identity/v3/users => generated 285 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:58:59.516244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44a39a-1d32-4c9e-a339-d5514795b6fa admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:59.527493 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44a39a-1d32-4c9e-a339-d5514795b6fa admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:59.532798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b1220-275d-4bcb-bb07-a1e1ab706fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:59.533517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b1220-275d-4bcb-bb07-a1e1ab706fec admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:59.533855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b1220-275d-4bcb-bb07-a1e1ab706fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:59.534313 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b1220-275d-4bcb-bb07-a1e1ab706fec admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:59.535032 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b1220-275d-4bcb-bb07-a1e1ab706fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:59.536754 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b1220-275d-4bcb-bb07-a1e1ab706fec admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:59.553157 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1083/2166] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:58:59.554557 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0f9bb-6fdd-40e7-9320-00aef40b76af admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:59.567190 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0f9bb-6fdd-40e7-9320-00aef40b76af admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:59.573113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469027e7-bb9b-4e6d-a6fc-2c4704d3f5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:59.573336 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469027e7-bb9b-4e6d-a6fc-2c4704d3f5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:59.573537 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469027e7-bb9b-4e6d-a6fc-2c4704d3f5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:59.573786 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469027e7-bb9b-4e6d-a6fc-2c4704d3f5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:59.574506 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469027e7-bb9b-4e6d-a6fc-2c4704d3f5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:59.576490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469027e7-bb9b-4e6d-a6fc-2c4704d3f5a3 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:59.593034 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1084/2167] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:58:59.595272 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b1220-275d-4bcb-bb07-a1e1ab706fec admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:59.606034 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b1220-275d-4bcb-bb07-a1e1ab706fec admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:59.615013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a7236-7d56-4043-a30d-845dc6cc7056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:59.615808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a7236-7d56-4043-a30d-845dc6cc7056 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:59.616152 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a7236-7d56-4043-a30d-845dc6cc7056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:59.616487 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a7236-7d56-4043-a30d-845dc6cc7056 admin admin] PATH_INFO: `/v3/projects/ecd18821255f4de3a6dddb4d126238a4/users/63cb366e9cab4f448ba2095d24b18d37/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:59.637360 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a7236-7d56-4043-a30d-845dc6cc7056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd18821255f4de3a6dddb4d126238a4, user_id=63cb366e9cab4f448ba2095d24b18d37, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:59.640143 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a7236-7d56-4043-a30d-845dc6cc7056 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:59.660289 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1084/2168] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:58:59 2022] PUT /identity/v3/projects/ecd18821255f4de3a6dddb4d126238a4/users/63cb366e9cab4f448ba2095d24b18d37/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:58:59.670561 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef2462-bdb0-4a7a-988a-0401d3410a3d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:59.671192 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef2462-bdb0-4a7a-988a-0401d3410a3d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:59.671494 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef2462-bdb0-4a7a-988a-0401d3410a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:59.702797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-feef2462-bdb0-4a7a-988a-0401d3410a3d None None] MFA Rules not processed for user `63cb366e9cab4f448ba2095d24b18d37`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:59.704453 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-feef2462-bdb0-4a7a-988a-0401d3410a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:59.794756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1085/2169] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:58:59.805682 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a7236-7d56-4043-a30d-845dc6cc7056 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:59.807990 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-399a7236-7d56-4043-a30d-845dc6cc7056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:59.893326 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a7236-7d56-4043-a30d-845dc6cc7056 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:58:59.897220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0a663-62af-48b7-8822-49ba40f34b1f None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:59.897951 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0a663-62af-48b7-8822-49ba40f34b1f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:59.897951 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0a663-62af-48b7-8822-49ba40f34b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:59.900709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df82d16-bbe1-4294-a314-49cc7e3c644d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6682c22be8c4bdca4be33a93e802409', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:58:59.901575 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df82d16-bbe1-4294-a314-49cc7e3c644d service glance] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:58:59.902161 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df82d16-bbe1-4294-a314-49cc7e3c644d service glance] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:58:59.902507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df82d16-bbe1-4294-a314-49cc7e3c644d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:58:59.907776 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:58:59.917111 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df82d16-bbe1-4294-a314-49cc7e3c644d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:58:59.918934 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df82d16-bbe1-4294-a314-49cc7e3c644d service glance] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:58:59.932851 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-dee0a663-62af-48b7-8822-49ba40f34b1f None None] MFA Rules not processed for user `690052887c3c44e3aab2eb1b839ec5f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:58:59.934111 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-dee0a663-62af-48b7-8822-49ba40f34b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:58:59.956359 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1085/2170] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:58:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:58:59.974571 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df82d16-bbe1-4294-a314-49cc7e3c644d service glance] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:58:59.976516 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6df82d16-bbe1-4294-a314-49cc7e3c644d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:00.060300 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:00.085308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1086/2171] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:58:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:59:00.100292 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41228df7-842d-4d4b-9de1-d7be029672c7 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:00.100793 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41228df7-842d-4d4b-9de1-d7be029672c7 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:00.101292 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41228df7-842d-4d4b-9de1-d7be029672c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:00.124633 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df82d16-bbe1-4294-a314-49cc7e3c644d service glance] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:00.130524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa961903-d094-4c9f-8ce7-dea35c23d301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:00.131291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa961903-d094-4c9f-8ce7-dea35c23d301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:00.131645 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa961903-d094-4c9f-8ce7-dea35c23d301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:00.131918 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa961903-d094-4c9f-8ce7-dea35c23d301 admin admin] PATH_INFO: `/v3/users/066b303d88a34a739b887eda9ca9baa5` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:00.133198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa961903-d094-4c9f-8ce7-dea35c23d301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=066b303d88a34a739b887eda9ca9baa5)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:00.135643 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa961903-d094-4c9f-8ce7-dea35c23d301 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:00.146150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-41228df7-842d-4d4b-9de1-d7be029672c7 None None] MFA Rules not processed for user `68f27885290a4b4184fc601314455f84`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:00.148620 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-41228df7-842d-4d4b-9de1-d7be029672c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:00.224318 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fa961903-d094-4c9f-8ce7-dea35c23d301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '066b303d88a34a739b887eda9ca9baa5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:00.233530 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1087/2172] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:00.233783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fa961903-d094-4c9f-8ce7-dea35c23d301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '066b303d88a34a739b887eda9ca9baa5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:00.243914 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fa961903-d094-4c9f-8ce7-dea35c23d301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '066b303d88a34a739b887eda9ca9baa5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:00.246374 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41228df7-842d-4d4b-9de1-d7be029672c7 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:00.248065 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-41228df7-842d-4d4b-9de1-d7be029672c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:00.268258 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fa961903-d094-4c9f-8ce7-dea35c23d301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '066b303d88a34a739b887eda9ca9baa5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:00.269012 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fa961903-d094-4c9f-8ce7-dea35c23d301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '066b303d88a34a739b887eda9ca9baa5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:00.277028 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1086/2173] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:58:59 2022] DELETE /identity/v3/users/066b303d88a34a739b887eda9ca9baa5 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:00.282297 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee327e0-1d62-4fb9-ba8a-dd3bba343c93 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:00.282562 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee327e0-1d62-4fb9-ba8a-dd3bba343c93 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:00.282958 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee327e0-1d62-4fb9-ba8a-dd3bba343c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:00.306405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bee327e0-1d62-4fb9-ba8a-dd3bba343c93 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:00.308299 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bee327e0-1d62-4fb9-ba8a-dd3bba343c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:00.352227 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41228df7-842d-4d4b-9de1-d7be029672c7 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:00.390900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1087/2174] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:59:00.392867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:00.398017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee327e0-1d62-4fb9-ba8a-dd3bba343c93 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:00.402356 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bee327e0-1d62-4fb9-ba8a-dd3bba343c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:00.435310 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0573f17-de15-4ad8-adf1-fcd192b7e6e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:00.436795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0573f17-de15-4ad8-adf1-fcd192b7e6e9 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:00.436919 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0573f17-de15-4ad8-adf1-fcd192b7e6e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:00.437234 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0573f17-de15-4ad8-adf1-fcd192b7e6e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:00.439728 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e0573f17-de15-4ad8-adf1-fcd192b7e6e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:00.492984 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee327e0-1d62-4fb9-ba8a-dd3bba343c93 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:00.499206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b740047-de7e-489a-8f27-60667593b154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:00.500453 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b740047-de7e-489a-8f27-60667593b154 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:00.500907 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b740047-de7e-489a-8f27-60667593b154 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:00.502073 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b740047-de7e-489a-8f27-60667593b154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:00.516976 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b740047-de7e-489a-8f27-60667593b154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:00.518694 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b740047-de7e-489a-8f27-60667593b154 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:00.520160 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0573f17-de15-4ad8-adf1-fcd192b7e6e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:00.522278 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0573f17-de15-4ad8-adf1-fcd192b7e6e9 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:00.533925 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1088/2175] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:00.534237 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1088/2176] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:00.932923 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0573f17-de15-4ad8-adf1-fcd192b7e6e9 service nova] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:00.935028 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e0573f17-de15-4ad8-adf1-fcd192b7e6e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:00.954687 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0573f17-de15-4ad8-adf1-fcd192b7e6e9 service nova] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:00.959820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b551f1-2f55-4140-9962-a600b6cf0d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:00.971672 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b551f1-2f55-4140-9962-a600b6cf0d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:00.972671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b551f1-2f55-4140-9962-a600b6cf0d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:00.972954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b551f1-2f55-4140-9962-a600b6cf0d54 admin admin] PATH_INFO: `/v3/projects/205c8405ecb84d20a5ba6c7b0e01e5c1` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:00.983007 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b551f1-2f55-4140-9962-a600b6cf0d54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=205c8405ecb84d20a5ba6c7b0e01e5c1)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:00.988785 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b551f1-2f55-4140-9962-a600b6cf0d54 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:01.058991 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d3b551f1-2f55-4140-9962-a600b6cf0d54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '205c8405ecb84d20a5ba6c7b0e01e5c1', 'request_id': 'req-d3b551f1-2f55-4140-9962-a600b6cf0d54'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.070338 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d3b551f1-2f55-4140-9962-a600b6cf0d54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '205c8405ecb84d20a5ba6c7b0e01e5c1', 'request_id': 'req-d3b551f1-2f55-4140-9962-a600b6cf0d54'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.079228 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d3b551f1-2f55-4140-9962-a600b6cf0d54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '205c8405ecb84d20a5ba6c7b0e01e5c1', 'request_id': 'req-d3b551f1-2f55-4140-9962-a600b6cf0d54'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.091784 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b740047-de7e-489a-8f27-60667593b154 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:01.097715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0b740047-de7e-489a-8f27-60667593b154 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:01.114496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:01.115082 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d3b551f1-2f55-4140-9962-a600b6cf0d54 admin admin] The token cache is being invalidate because project 205c8405ecb84d20a5ba6c7b0e01e5c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:01.115669 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d3b551f1-2f55-4140-9962-a600b6cf0d54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.117015 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d3b551f1-2f55-4140-9962-a600b6cf0d54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.121579 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b740047-de7e-489a-8f27-60667593b154 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:01.124401 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1089/2177] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:00 2022] DELETE /identity/v3/projects/205c8405ecb84d20a5ba6c7b0e01e5c1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:01.130358 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dadc0-b003-4497-a16f-ecb2de6883bd None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:01.130651 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dadc0-b003-4497-a16f-ecb2de6883bd None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:01.130954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dadc0-b003-4497-a16f-ecb2de6883bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:01.156753 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f88dadc0-b003-4497-a16f-ecb2de6883bd None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:01.171168 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f88dadc0-b003-4497-a16f-ecb2de6883bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:01.216393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b505569-f08e-4f18-9cdb-ec0539483d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:01.217303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b505569-f08e-4f18-9cdb-ec0539483d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:01.217745 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b505569-f08e-4f18-9cdb-ec0539483d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:01.218165 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b505569-f08e-4f18-9cdb-ec0539483d72 admin admin] PATH_INFO: `/v3/users/c6e72fea62a24e3fb7d75587752070db` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:01.220200 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b505569-f08e-4f18-9cdb-ec0539483d72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e72fea62a24e3fb7d75587752070db)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:01.225161 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b505569-f08e-4f18-9cdb-ec0539483d72 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:01.258401 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:01.277604 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1090/2178] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:01.287290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c7389-06a4-43e4-b6a0-f064e5b6c063 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:01.288214 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c7389-06a4-43e4-b6a0-f064e5b6c063 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:01.288766 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c7389-06a4-43e4-b6a0-f064e5b6c063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:01.289382 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4b505569-f08e-4f18-9cdb-ec0539483d72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e72fea62a24e3fb7d75587752070db'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.298263 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4b505569-f08e-4f18-9cdb-ec0539483d72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e72fea62a24e3fb7d75587752070db'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.324150 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4b505569-f08e-4f18-9cdb-ec0539483d72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e72fea62a24e3fb7d75587752070db'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.347401 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-7c4c7389-06a4-43e4-b6a0-f064e5b6c063 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:01.350989 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7c4c7389-06a4-43e4-b6a0-f064e5b6c063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:01.359401 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4b505569-f08e-4f18-9cdb-ec0539483d72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e72fea62a24e3fb7d75587752070db'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.361054 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4b505569-f08e-4f18-9cdb-ec0539483d72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e72fea62a24e3fb7d75587752070db'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:01.371877 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1091/2179] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:59:01.376563 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c7389-06a4-43e4-b6a0-f064e5b6c063 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:01.376799 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1089/2180] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:01 2022] DELETE /identity/v3/users/c6e72fea62a24e3fb7d75587752070db => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:01.381678 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400fa40-5015-4b2c-a39f-3565e05f628a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:01.381863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400fa40-5015-4b2c-a39f-3565e05f628a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:01.382103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400fa40-5015-4b2c-a39f-3565e05f628a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:01.389558 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c7389-06a4-43e4-b6a0-f064e5b6c063 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:01.406126 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b400fa40-5015-4b2c-a39f-3565e05f628a None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:01.407474 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b400fa40-5015-4b2c-a39f-3565e05f628a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:01.488405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1090/2181] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:59:01.498458 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400fa40-5015-4b2c-a39f-3565e05f628a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:01.500586 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b400fa40-5015-4b2c-a39f-3565e05f628a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:01.504568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b40837-16b5-460b-8822-81e261e5f9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:01.505366 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b40837-16b5-460b-8822-81e261e5f9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:01.505701 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b40837-16b5-460b-8822-81e261e5f9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:01.506033 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b40837-16b5-460b-8822-81e261e5f9a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:01.506747 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b40837-16b5-460b-8822-81e261e5f9a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:59:01.507108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b40837-16b5-460b-8822-81e261e5f9a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:01.508898 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b40837-16b5-460b-8822-81e261e5f9a7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:01.526787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1092/2182] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:59:01.527905 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b40837-16b5-460b-8822-81e261e5f9a7 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:01.529949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d7b40837-16b5-460b-8822-81e261e5f9a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:01.535927 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:01.544514 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b40837-16b5-460b-8822-81e261e5f9a7 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:01.557455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb14684-529d-4c3a-a684-234054068ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:01.558170 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb14684-529d-4c3a-a684-234054068ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:01.558498 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb14684-529d-4c3a-a684-234054068ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:01.558659 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb14684-529d-4c3a-a684-234054068ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:01.560096 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb14684-529d-4c3a-a684-234054068ea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:01.562475 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb14684-529d-4c3a-a684-234054068ea0 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:01.571952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400fa40-5015-4b2c-a39f-3565e05f628a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:01.575766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10811911-cf74-47f4-9492-fc7e357d0a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:01.576491 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10811911-cf74-47f4-9492-fc7e357d0a4f service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:01.576921 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10811911-cf74-47f4-9492-fc7e357d0a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:01.577441 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10811911-cf74-47f4-9492-fc7e357d0a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:01.587871 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10811911-cf74-47f4-9492-fc7e357d0a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:01.589547 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10811911-cf74-47f4-9492-fc7e357d0a4f service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:01.602057 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1093/2183] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:01 2022] POST /identity/v3/projects => generated 365 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:01.606501 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb14684-529d-4c3a-a684-234054068ea0 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:01.609643 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1091/2184] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:59:01.703413 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb14684-529d-4c3a-a684-234054068ea0 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:01.708958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca13e77-7acd-4747-bd9e-c396274407eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:01.709646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca13e77-7acd-4747-bd9e-c396274407eb admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:01.710053 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca13e77-7acd-4747-bd9e-c396274407eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:01.710238 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca13e77-7acd-4747-bd9e-c396274407eb admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:01.710891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca13e77-7acd-4747-bd9e-c396274407eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:01.712881 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca13e77-7acd-4747-bd9e-c396274407eb admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:01.744928 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1094/2185] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:01 2022] POST /identity/v3/users => generated 283 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:59:01.749043 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10811911-cf74-47f4-9492-fc7e357d0a4f service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:01.758734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10811911-cf74-47f4-9492-fc7e357d0a4f service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:01.764499 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01862c-159c-4fbd-8580-670a3a6ec82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:01.765381 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01862c-159c-4fbd-8580-670a3a6ec82b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:01.765582 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01862c-159c-4fbd-8580-670a3a6ec82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:01.765851 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01862c-159c-4fbd-8580-670a3a6ec82b admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:01.766481 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01862c-159c-4fbd-8580-670a3a6ec82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:01.768351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01862c-159c-4fbd-8580-670a3a6ec82b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:01.778989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1092/2186] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:01.783167 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca13e77-7acd-4747-bd9e-c396274407eb admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:01.795913 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca13e77-7acd-4747-bd9e-c396274407eb admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:01.803535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b20511-b2d9-439c-b986-02d395e013db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:01.804317 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b20511-b2d9-439c-b986-02d395e013db admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:01.804958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b20511-b2d9-439c-b986-02d395e013db admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:01.804958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b20511-b2d9-439c-b986-02d395e013db admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:01.805764 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b20511-b2d9-439c-b986-02d395e013db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:01.807226 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b20511-b2d9-439c-b986-02d395e013db admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:01.826505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1095/2187] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:01.826702 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01862c-159c-4fbd-8580-670a3a6ec82b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:01.835140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01862c-159c-4fbd-8580-670a3a6ec82b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:01.840062 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734f9f1-6132-4b74-836d-43e4e6d2de13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:01.840742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734f9f1-6132-4b74-836d-43e4e6d2de13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:01.841051 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734f9f1-6132-4b74-836d-43e4e6d2de13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:01.841343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734f9f1-6132-4b74-836d-43e4e6d2de13 admin admin] PATH_INFO: `/v3/projects/8ebfd3acf2a34c559fa11ceffe591b38/users/f7fe04b5cb8a49039413692514aa0bbd/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:01.860370 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734f9f1-6132-4b74-836d-43e4e6d2de13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ebfd3acf2a34c559fa11ceffe591b38, user_id=f7fe04b5cb8a49039413692514aa0bbd, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:01.864408 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734f9f1-6132-4b74-836d-43e4e6d2de13 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:01.883846 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1093/2188] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:01 2022] PUT /identity/v3/projects/8ebfd3acf2a34c559fa11ceffe591b38/users/f7fe04b5cb8a49039413692514aa0bbd/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:01.895058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f77d90-44b8-4bf0-88fc-11a4070d1faf None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:01.895648 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f77d90-44b8-4bf0-88fc-11a4070d1faf None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:01.896198 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f77d90-44b8-4bf0-88fc-11a4070d1faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:01.953451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d3f77d90-44b8-4bf0-88fc-11a4070d1faf None None] MFA Rules not processed for user `f7fe04b5cb8a49039413692514aa0bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:01.955616 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d3f77d90-44b8-4bf0-88fc-11a4070d1faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:01.960667 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734f9f1-6132-4b74-836d-43e4e6d2de13 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:01.966861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b734f9f1-6132-4b74-836d-43e4e6d2de13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:02.002779 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:02.054165 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1096/2189] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:02.068329 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f77d90-44b8-4bf0-88fc-11a4070d1faf None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:02.070190 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d3f77d90-44b8-4bf0-88fc-11a4070d1faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:02.071904 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734f9f1-6132-4b74-836d-43e4e6d2de13 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:02.083259 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fef208-30e1-4952-a3a7-104cecfcabc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:02.083963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fef208-30e1-4952-a3a7-104cecfcabc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:02.084559 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fef208-30e1-4952-a3a7-104cecfcabc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:02.084846 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fef208-30e1-4952-a3a7-104cecfcabc1 admin admin] PATH_INFO: `/v3/projects/024bd7ae7dd546efb302f04dc28a49eb` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:02.087538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fef208-30e1-4952-a3a7-104cecfcabc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=024bd7ae7dd546efb302f04dc28a49eb)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:02.090089 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fef208-30e1-4952-a3a7-104cecfcabc1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:02.151226 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f77d90-44b8-4bf0-88fc-11a4070d1faf None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:02.159382 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a4fef208-30e1-4952-a3a7-104cecfcabc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '024bd7ae7dd546efb302f04dc28a49eb', 'request_id': 'req-a4fef208-30e1-4952-a3a7-104cecfcabc1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:02.167868 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a4fef208-30e1-4952-a3a7-104cecfcabc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '024bd7ae7dd546efb302f04dc28a49eb', 'request_id': 'req-a4fef208-30e1-4952-a3a7-104cecfcabc1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:02.174918 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a4fef208-30e1-4952-a3a7-104cecfcabc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '024bd7ae7dd546efb302f04dc28a49eb', 'request_id': 'req-a4fef208-30e1-4952-a3a7-104cecfcabc1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:02.188039 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a4fef208-30e1-4952-a3a7-104cecfcabc1 admin admin] The token cache is being invalidate because project 024bd7ae7dd546efb302f04dc28a49eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:02.188328 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a4fef208-30e1-4952-a3a7-104cecfcabc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:02.189006 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a4fef208-30e1-4952-a3a7-104cecfcabc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:02.190948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1094/2190] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:01 2022] DELETE /identity/v3/projects/024bd7ae7dd546efb302f04dc28a49eb => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:02.200727 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fef208-30e1-4952-a3a7-104cecfcabc1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:02.205722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a4fef208-30e1-4952-a3a7-104cecfcabc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:02.210896 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040a301-a32c-4ea0-8028-99fc4216f84d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:02.211858 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040a301-a32c-4ea0-8028-99fc4216f84d service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:02.212146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040a301-a32c-4ea0-8028-99fc4216f84d service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:02.212406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040a301-a32c-4ea0-8028-99fc4216f84d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:02.214917 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8040a301-a32c-4ea0-8028-99fc4216f84d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:02.239990 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:02.285407 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040a301-a32c-4ea0-8028-99fc4216f84d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:02.286916 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040a301-a32c-4ea0-8028-99fc4216f84d service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:02.293875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fef208-30e1-4952-a3a7-104cecfcabc1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:02.296855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1097/2191] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:02.298808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573170a5-def9-4bec-a0f9-457d8bbcab77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:02.299501 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573170a5-def9-4bec-a0f9-457d8bbcab77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:02.299916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573170a5-def9-4bec-a0f9-457d8bbcab77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:02.300131 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573170a5-def9-4bec-a0f9-457d8bbcab77 admin admin] PATH_INFO: `/v3/users/2bb2d273548543829310c145a803cb4e` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:02.301269 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573170a5-def9-4bec-a0f9-457d8bbcab77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb2d273548543829310c145a803cb4e)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:02.303208 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573170a5-def9-4bec-a0f9-457d8bbcab77 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:02.361085 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-573170a5-def9-4bec-a0f9-457d8bbcab77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb2d273548543829310c145a803cb4e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:02.369288 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-573170a5-def9-4bec-a0f9-457d8bbcab77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb2d273548543829310c145a803cb4e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:02.377974 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-573170a5-def9-4bec-a0f9-457d8bbcab77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb2d273548543829310c145a803cb4e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:02.393780 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-573170a5-def9-4bec-a0f9-457d8bbcab77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb2d273548543829310c145a803cb4e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:02.394949 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-573170a5-def9-4bec-a0f9-457d8bbcab77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb2d273548543829310c145a803cb4e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:02.404107 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1095/2192] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:02 2022] DELETE /identity/v3/users/2bb2d273548543829310c145a803cb4e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:02.603693 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040a301-a32c-4ea0-8028-99fc4216f84d service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:02.609022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8040a301-a32c-4ea0-8028-99fc4216f84d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:02.628571 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040a301-a32c-4ea0-8028-99fc4216f84d service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:02.675616 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:02.710000 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b992d-7f84-4f5b-8fd6-555cfac1d7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:02.710935 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b992d-7f84-4f5b-8fd6-555cfac1d7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:02.711289 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b992d-7f84-4f5b-8fd6-555cfac1d7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:02.711663 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b992d-7f84-4f5b-8fd6-555cfac1d7b6 admin admin] PATH_INFO: `/v3/users/b228ca43f49249bd815b0b34b4d4d172` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:02.712970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b992d-7f84-4f5b-8fd6-555cfac1d7b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b228ca43f49249bd815b0b34b4d4d172)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:02.716399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b992d-7f84-4f5b-8fd6-555cfac1d7b6 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:02.803691 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ae3b992d-7f84-4f5b-8fd6-555cfac1d7b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b228ca43f49249bd815b0b34b4d4d172'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:02.818536 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573170a5-def9-4bec-a0f9-457d8bbcab77 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:02.820064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-573170a5-def9-4bec-a0f9-457d8bbcab77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:02.824943 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ae3b992d-7f84-4f5b-8fd6-555cfac1d7b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b228ca43f49249bd815b0b34b4d4d172'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:02.835686 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573170a5-def9-4bec-a0f9-457d8bbcab77 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:02.840784 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ae3b992d-7f84-4f5b-8fd6-555cfac1d7b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b228ca43f49249bd815b0b34b4d4d172'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:02.841293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d133a1f-16f8-4bce-bd1b-66944be51ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:02.842091 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d133a1f-16f8-4bce-bd1b-66944be51ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:02.842511 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d133a1f-16f8-4bce-bd1b-66944be51ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:02.842819 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ae3b992d-7f84-4f5b-8fd6-555cfac1d7b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b228ca43f49249bd815b0b34b4d4d172'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:02.842930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d133a1f-16f8-4bce-bd1b-66944be51ce1 admin admin] PATH_INFO: `/v3/projects/100dfc3581264ccc84ce8eb0263b85ab` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:02.844170 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d133a1f-16f8-4bce-bd1b-66944be51ce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=100dfc3581264ccc84ce8eb0263b85ab)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:02.846329 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d133a1f-16f8-4bce-bd1b-66944be51ce1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:02.862694 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ae3b992d-7f84-4f5b-8fd6-555cfac1d7b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b228ca43f49249bd815b0b34b4d4d172'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:02.869716 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1098/2193] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:02 2022] DELETE /identity/v3/users/b228ca43f49249bd815b0b34b4d4d172 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:02.875636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e941f8-bbd9-4261-bd76-281dc5a6b283 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:02.876004 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e941f8-bbd9-4261-bd76-281dc5a6b283 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:02.876353 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e941f8-bbd9-4261-bd76-281dc5a6b283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:02.904585 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-13e941f8-bbd9-4261-bd76-281dc5a6b283 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:02.906557 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-13e941f8-bbd9-4261-bd76-281dc5a6b283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:02.913996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7d133a1f-16f8-4bce-bd1b-66944be51ce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100dfc3581264ccc84ce8eb0263b85ab', 'request_id': 'req-7d133a1f-16f8-4bce-bd1b-66944be51ce1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:02.926272 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7d133a1f-16f8-4bce-bd1b-66944be51ce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100dfc3581264ccc84ce8eb0263b85ab', 'request_id': 'req-7d133a1f-16f8-4bce-bd1b-66944be51ce1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:02.935831 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7d133a1f-16f8-4bce-bd1b-66944be51ce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100dfc3581264ccc84ce8eb0263b85ab', 'request_id': 'req-7d133a1f-16f8-4bce-bd1b-66944be51ce1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:02.955457 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7d133a1f-16f8-4bce-bd1b-66944be51ce1 admin admin] The token cache is being invalidate because project 100dfc3581264ccc84ce8eb0263b85ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:02.956035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7d133a1f-16f8-4bce-bd1b-66944be51ce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:02.957010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7d133a1f-16f8-4bce-bd1b-66944be51ce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:02.959077 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1096/2194] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:02 2022] DELETE /identity/v3/projects/100dfc3581264ccc84ce8eb0263b85ab => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:02.963057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d133a1f-16f8-4bce-bd1b-66944be51ce1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:02.964918 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7d133a1f-16f8-4bce-bd1b-66944be51ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:02.986032 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1099/2195] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:59:03.007879 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e941f8-bbd9-4261-bd76-281dc5a6b283 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:03.009518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-13e941f8-bbd9-4261-bd76-281dc5a6b283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:03.017414 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:03.077306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d133a1f-16f8-4bce-bd1b-66944be51ce1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:03.082557 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ce69c-04e6-4663-8625-6202ed9804cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:03.083390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ce69c-04e6-4663-8625-6202ed9804cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:03.083772 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ce69c-04e6-4663-8625-6202ed9804cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:03.084901 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ce69c-04e6-4663-8625-6202ed9804cf admin admin] PATH_INFO: `/v3/users/a144b060402949d4b46a443be8d5abf8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:03.086141 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ce69c-04e6-4663-8625-6202ed9804cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a144b060402949d4b46a443be8d5abf8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:03.089145 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ce69c-04e6-4663-8625-6202ed9804cf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:03.092770 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e941f8-bbd9-4261-bd76-281dc5a6b283 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:03.098334 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d9ecf-a827-4202-8056-f09a44296de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:03.098894 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d9ecf-a827-4202-8056-f09a44296de8 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:03.099177 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d9ecf-a827-4202-8056-f09a44296de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:03.099497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d9ecf-a827-4202-8056-f09a44296de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:03.116188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d9ecf-a827-4202-8056-f09a44296de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:03.118565 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d9ecf-a827-4202-8056-f09a44296de8 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:03.128267 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:03.135557 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1100/2196] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:59:03.163870 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-064ce69c-04e6-4663-8625-6202ed9804cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a144b060402949d4b46a443be8d5abf8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:03.176660 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-064ce69c-04e6-4663-8625-6202ed9804cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a144b060402949d4b46a443be8d5abf8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:03.193165 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-064ce69c-04e6-4663-8625-6202ed9804cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a144b060402949d4b46a443be8d5abf8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:03.216446 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-064ce69c-04e6-4663-8625-6202ed9804cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a144b060402949d4b46a443be8d5abf8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:03.218183 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-064ce69c-04e6-4663-8625-6202ed9804cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a144b060402949d4b46a443be8d5abf8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:03.229368 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1097/2197] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:02 2022] DELETE /identity/v3/users/a144b060402949d4b46a443be8d5abf8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:03.732036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d9ecf-a827-4202-8056-f09a44296de8 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:03.745315 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-050d9ecf-a827-4202-8056-f09a44296de8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:03.812524 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d9ecf-a827-4202-8056-f09a44296de8 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:03.923782 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e72ad9-fe8c-4849-adb0-c2a3846b030b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:03.924430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e72ad9-fe8c-4849-adb0-c2a3846b030b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:03.924703 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e72ad9-fe8c-4849-adb0-c2a3846b030b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:03.924971 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e72ad9-fe8c-4849-adb0-c2a3846b030b admin admin] PATH_INFO: `/v3/projects/1b62804c1d684e7c8ede2a0de86d3733` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:03.926147 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e72ad9-fe8c-4849-adb0-c2a3846b030b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b62804c1d684e7c8ede2a0de86d3733)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:03.928110 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e72ad9-fe8c-4849-adb0-c2a3846b030b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:03.971847 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ce69c-04e6-4663-8625-6202ed9804cf admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:03.973733 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-064ce69c-04e6-4663-8625-6202ed9804cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:04.007142 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ce69c-04e6-4663-8625-6202ed9804cf admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:04.007958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c5e72ad9-fe8c-4849-adb0-c2a3846b030b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b62804c1d684e7c8ede2a0de86d3733', 'request_id': 'req-c5e72ad9-fe8c-4849-adb0-c2a3846b030b'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:04.024575 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c5e72ad9-fe8c-4849-adb0-c2a3846b030b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b62804c1d684e7c8ede2a0de86d3733', 'request_id': 'req-c5e72ad9-fe8c-4849-adb0-c2a3846b030b'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:04.045962 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c5e72ad9-fe8c-4849-adb0-c2a3846b030b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b62804c1d684e7c8ede2a0de86d3733', 'request_id': 'req-c5e72ad9-fe8c-4849-adb0-c2a3846b030b'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:04.086085 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23797d6b-cbb0-46da-90ca-d2cc7f358f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:04.086789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c5e72ad9-fe8c-4849-adb0-c2a3846b030b admin admin] The token cache is being invalidate because project 1b62804c1d684e7c8ede2a0de86d3733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:04.087007 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23797d6b-cbb0-46da-90ca-d2cc7f358f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:04.087104 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23797d6b-cbb0-46da-90ca-d2cc7f358f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:04.087465 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23797d6b-cbb0-46da-90ca-d2cc7f358f43 admin admin] PATH_INFO: `/v3/projects/96f77c2eba0d411784fbf55bdb25149a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:04.087830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c5e72ad9-fe8c-4849-adb0-c2a3846b030b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:04.088775 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23797d6b-cbb0-46da-90ca-d2cc7f358f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96f77c2eba0d411784fbf55bdb25149a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:04.089167 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c5e72ad9-fe8c-4849-adb0-c2a3846b030b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:04.090860 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23797d6b-cbb0-46da-90ca-d2cc7f358f43 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:04.092138 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1101/2198] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:03 2022] DELETE /identity/v3/projects/1b62804c1d684e7c8ede2a0de86d3733 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:04.096027 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e72ad9-fe8c-4849-adb0-c2a3846b030b admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:04.098217 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c5e72ad9-fe8c-4849-adb0-c2a3846b030b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:04.128528 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e72ad9-fe8c-4849-adb0-c2a3846b030b admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:04.140788 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62a280-c29f-48e2-bb19-5c2dcfaf8ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:04.141495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62a280-c29f-48e2-bb19-5c2dcfaf8ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:04.141889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62a280-c29f-48e2-bb19-5c2dcfaf8ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:04.142109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62a280-c29f-48e2-bb19-5c2dcfaf8ee3 admin admin] PATH_INFO: `/v3/users/2958118adfe044f1b3860fc29e94ff70` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:04.144226 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62a280-c29f-48e2-bb19-5c2dcfaf8ee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2958118adfe044f1b3860fc29e94ff70)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:04.146454 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62a280-c29f-48e2-bb19-5c2dcfaf8ee3 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:04.182700 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:04.186631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-23797d6b-cbb0-46da-90ca-d2cc7f358f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96f77c2eba0d411784fbf55bdb25149a', 'request_id': 'req-23797d6b-cbb0-46da-90ca-d2cc7f358f43'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:04.201416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-23797d6b-cbb0-46da-90ca-d2cc7f358f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96f77c2eba0d411784fbf55bdb25149a', 'request_id': 'req-23797d6b-cbb0-46da-90ca-d2cc7f358f43'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:04.211840 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-23797d6b-cbb0-46da-90ca-d2cc7f358f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96f77c2eba0d411784fbf55bdb25149a', 'request_id': 'req-23797d6b-cbb0-46da-90ca-d2cc7f358f43'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:04.227948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-23797d6b-cbb0-46da-90ca-d2cc7f358f43 admin admin] The token cache is being invalidate because project 96f77c2eba0d411784fbf55bdb25149a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:04.228590 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-23797d6b-cbb0-46da-90ca-d2cc7f358f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:04.229557 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-23797d6b-cbb0-46da-90ca-d2cc7f358f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:04.234773 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1098/2199] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:03 2022] DELETE /identity/v3/projects/96f77c2eba0d411784fbf55bdb25149a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:04.236900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6aa8f7-401d-4472-b104-1589e7a3c638 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:04.237395 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6aa8f7-401d-4472-b104-1589e7a3c638 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:04.237685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6aa8f7-401d-4472-b104-1589e7a3c638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:04.243882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8c62a280-c29f-48e2-bb19-5c2dcfaf8ee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2958118adfe044f1b3860fc29e94ff70'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:04.261208 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8c62a280-c29f-48e2-bb19-5c2dcfaf8ee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2958118adfe044f1b3860fc29e94ff70'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:04.266283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7c6aa8f7-401d-4472-b104-1589e7a3c638 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:04.267645 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7c6aa8f7-401d-4472-b104-1589e7a3c638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:04.274525 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8c62a280-c29f-48e2-bb19-5c2dcfaf8ee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2958118adfe044f1b3860fc29e94ff70'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:04.276133 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8c62a280-c29f-48e2-bb19-5c2dcfaf8ee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2958118adfe044f1b3860fc29e94ff70'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:04.305834 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8c62a280-c29f-48e2-bb19-5c2dcfaf8ee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2958118adfe044f1b3860fc29e94ff70'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:04.316184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1102/2200] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:04 2022] DELETE /identity/v3/users/2958118adfe044f1b3860fc29e94ff70 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:04.347426 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1099/2201] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:04.357371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745f12a-c695-46a7-b453-bf51595f5ed3 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:04.358007 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745f12a-c695-46a7-b453-bf51595f5ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:04.358286 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745f12a-c695-46a7-b453-bf51595f5ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:04.375933 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:04.397379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d745f12a-c695-46a7-b453-bf51595f5ed3 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:04.399622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d745f12a-c695-46a7-b453-bf51595f5ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:04.504516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1103/2202] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:04.508725 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6aa8f7-401d-4472-b104-1589e7a3c638 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:04.525643 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6aa8f7-401d-4472-b104-1589e7a3c638 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:04.552493 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3cc03-5c2f-4725-8694-72656fcdecf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:04.553143 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3cc03-5c2f-4725-8694-72656fcdecf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:04.553428 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3cc03-5c2f-4725-8694-72656fcdecf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:04.553705 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3cc03-5c2f-4725-8694-72656fcdecf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:04.554517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3cc03-5c2f-4725-8694-72656fcdecf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:59:04.554830 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3cc03-5c2f-4725-8694-72656fcdecf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:04.557972 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3cc03-5c2f-4725-8694-72656fcdecf3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:04.593746 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1100/2203] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:59:04.598532 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745f12a-c695-46a7-b453-bf51595f5ed3 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:04.616575 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745f12a-c695-46a7-b453-bf51595f5ed3 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:04.622744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bf70e-e283-49a4-acc0-3de212cc33c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:04.624299 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bf70e-e283-49a4-acc0-3de212cc33c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:04.624764 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bf70e-e283-49a4-acc0-3de212cc33c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:04.625565 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bf70e-e283-49a4-acc0-3de212cc33c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:04.626370 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14bf70e-e283-49a4-acc0-3de212cc33c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:04.629168 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14bf70e-e283-49a4-acc0-3de212cc33c5 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:04.691455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1104/2204] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:04 2022] POST /identity/v3/projects => generated 367 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:04.694870 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3cc03-5c2f-4725-8694-72656fcdecf3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:04.708356 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3cc03-5c2f-4725-8694-72656fcdecf3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:04.799525 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c69655-0520-47f9-b068-81bc3464dfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:04.800870 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c69655-0520-47f9-b068-81bc3464dfc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:04.801271 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c69655-0520-47f9-b068-81bc3464dfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:04.801674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c69655-0520-47f9-b068-81bc3464dfc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:04.802476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c69655-0520-47f9-b068-81bc3464dfc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:04.806405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c69655-0520-47f9-b068-81bc3464dfc9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:04.841510 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bf70e-e283-49a4-acc0-3de212cc33c5 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:04.843943 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b14bf70e-e283-49a4-acc0-3de212cc33c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:04.857033 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1101/2205] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:04 2022] POST /identity/v3/users => generated 284 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:04.867178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bf70e-e283-49a4-acc0-3de212cc33c5 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:04.869512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c69655-0520-47f9-b068-81bc3464dfc9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:04.876408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054febf9-d47a-492c-945e-a3fc546fb3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:04.877194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054febf9-d47a-492c-945e-a3fc546fb3d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:04.877312 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054febf9-d47a-492c-945e-a3fc546fb3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:04.877675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054febf9-d47a-492c-945e-a3fc546fb3d6 admin admin] PATH_INFO: `/v3/projects/32e29392b47a4a85988b38df2f9f750e` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:04.879005 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054febf9-d47a-492c-945e-a3fc546fb3d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32e29392b47a4a85988b38df2f9f750e)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:04.881332 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054febf9-d47a-492c-945e-a3fc546fb3d6 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:04.903532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c69655-0520-47f9-b068-81bc3464dfc9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:04.910198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013da6e-ac4d-424b-9a2a-0fc2de6140b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:04.910859 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013da6e-ac4d-424b-9a2a-0fc2de6140b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:04.911553 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013da6e-ac4d-424b-9a2a-0fc2de6140b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:04.911553 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013da6e-ac4d-424b-9a2a-0fc2de6140b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:04.912424 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013da6e-ac4d-424b-9a2a-0fc2de6140b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:04.914128 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013da6e-ac4d-424b-9a2a-0fc2de6140b6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:04.934890 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1102/2206] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:04.937063 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013da6e-ac4d-424b-9a2a-0fc2de6140b6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:04.952988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013da6e-ac4d-424b-9a2a-0fc2de6140b6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:04.980746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-054febf9-d47a-492c-945e-a3fc546fb3d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32e29392b47a4a85988b38df2f9f750e', 'request_id': 'req-054febf9-d47a-492c-945e-a3fc546fb3d6'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:04.988803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-054febf9-d47a-492c-945e-a3fc546fb3d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32e29392b47a4a85988b38df2f9f750e', 'request_id': 'req-054febf9-d47a-492c-945e-a3fc546fb3d6'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:05.001091 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-054febf9-d47a-492c-945e-a3fc546fb3d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32e29392b47a4a85988b38df2f9f750e', 'request_id': 'req-054febf9-d47a-492c-945e-a3fc546fb3d6'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:05.020079 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:05.023613 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-054febf9-d47a-492c-945e-a3fc546fb3d6 admin admin] The token cache is being invalidate because project 32e29392b47a4a85988b38df2f9f750e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:05.024124 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-054febf9-d47a-492c-945e-a3fc546fb3d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:05.024566 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-054febf9-d47a-492c-945e-a3fc546fb3d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:05.026375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1105/2207] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:04 2022] DELETE /identity/v3/projects/32e29392b47a4a85988b38df2f9f750e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:05.032627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c716d-fde4-4bf3-8a8a-036e3fec6107 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:05.033851 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c716d-fde4-4bf3-8a8a-036e3fec6107 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:05.034129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c716d-fde4-4bf3-8a8a-036e3fec6107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:05.051436 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7b67a-d9c9-4efd-a758-36cb8d8203de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:05.053382 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7b67a-d9c9-4efd-a758-36cb8d8203de admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:05.053731 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7b67a-d9c9-4efd-a758-36cb8d8203de admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:05.054073 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7b67a-d9c9-4efd-a758-36cb8d8203de admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:05.055005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7b67a-d9c9-4efd-a758-36cb8d8203de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:05.056990 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7b67a-d9c9-4efd-a758-36cb8d8203de admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:05.060133 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-fc6c716d-fde4-4bf3-8a8a-036e3fec6107 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:05.062258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-fc6c716d-fde4-4bf3-8a8a-036e3fec6107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:05.075634 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1106/2208] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:05.081321 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491dd35-ed8b-4008-810f-5aee70a37080 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:05.081888 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491dd35-ed8b-4008-810f-5aee70a37080 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:05.082360 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491dd35-ed8b-4008-810f-5aee70a37080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:05.083868 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1103/2209] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:59:05.085339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7b67a-d9c9-4efd-a758-36cb8d8203de admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:05.087582 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5ee7b67a-d9c9-4efd-a758-36cb8d8203de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:05.108836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7b67a-d9c9-4efd-a758-36cb8d8203de admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:05.112077 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-7491dd35-ed8b-4008-810f-5aee70a37080 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:05.113637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7491dd35-ed8b-4008-810f-5aee70a37080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:05.117374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694d37a-576b-45c9-a26d-a29e7b960a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:05.118058 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694d37a-576b-45c9-a26d-a29e7b960a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:05.118336 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694d37a-576b-45c9-a26d-a29e7b960a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:05.118611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694d37a-576b-45c9-a26d-a29e7b960a81 admin admin] PATH_INFO: `/v3/projects/c1eec21ca5d144a9a173707203352e8d/users/855b160002eb42bdbacbd99777e783a6/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:05.127454 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1107/2210] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:59:05.131567 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491dd35-ed8b-4008-810f-5aee70a37080 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:05.136981 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694d37a-576b-45c9-a26d-a29e7b960a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1eec21ca5d144a9a173707203352e8d, user_id=855b160002eb42bdbacbd99777e783a6, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:05.140958 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694d37a-576b-45c9-a26d-a29e7b960a81 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:05.141623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491dd35-ed8b-4008-810f-5aee70a37080 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:05.148146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8e215-23d7-4d91-a46a-a790c898a669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:05.148933 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8e215-23d7-4d91-a46a-a790c898a669 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:05.149331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8e215-23d7-4d91-a46a-a790c898a669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:05.149717 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8e215-23d7-4d91-a46a-a790c898a669 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:05.150732 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8e215-23d7-4d91-a46a-a790c898a669 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:59:05.151204 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8e215-23d7-4d91-a46a-a790c898a669 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:05.153232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8e215-23d7-4d91-a46a-a790c898a669 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:05.161852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1104/2211] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:05 2022] PUT /identity/v3/projects/c1eec21ca5d144a9a173707203352e8d/users/855b160002eb42bdbacbd99777e783a6/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:05.171507 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1108/2212] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:59:05.172613 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8e215-23d7-4d91-a46a-a790c898a669 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:05.173383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea228c64-634d-4024-9d36-7a87a22125bb None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:05.173733 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea228c64-634d-4024-9d36-7a87a22125bb None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:05.174076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea228c64-634d-4024-9d36-7a87a22125bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:05.182581 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8e215-23d7-4d91-a46a-a790c898a669 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:05.207329 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ea228c64-634d-4024-9d36-7a87a22125bb None None] MFA Rules not processed for user `855b160002eb42bdbacbd99777e783a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:05.208582 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ea228c64-634d-4024-9d36-7a87a22125bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:05.220252 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:05.256793 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7c9d4-9859-4da2-b50b-d46f4d143b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:05.257726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7c9d4-9859-4da2-b50b-d46f4d143b0b admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:05.258755 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7c9d4-9859-4da2-b50b-d46f4d143b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:05.259192 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7c9d4-9859-4da2-b50b-d46f4d143b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:05.260019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7c9d4-9859-4da2-b50b-d46f4d143b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:05.262270 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7c9d4-9859-4da2-b50b-d46f4d143b0b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:05.285924 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1105/2213] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:05.295431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1109/2214] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:05 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:05.297653 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea228c64-634d-4024-9d36-7a87a22125bb None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:05.298253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7c9d4-9859-4da2-b50b-d46f4d143b0b admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:05.299946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-14b7c9d4-9859-4da2-b50b-d46f4d143b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:05.310734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea228c64-634d-4024-9d36-7a87a22125bb None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:05.379968 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7c9d4-9859-4da2-b50b-d46f4d143b0b admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:05.384250 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607c44d-1055-4977-a852-027de8d028e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6682c22be8c4bdca4be33a93e802409', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:05.385026 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607c44d-1055-4977-a852-027de8d028e0 service glance] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:05.385304 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607c44d-1055-4977-a852-027de8d028e0 service glance] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:05.385570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607c44d-1055-4977-a852-027de8d028e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:05.387105 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99924ab-d03f-4874-8876-6e1103046446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:05.387753 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99924ab-d03f-4874-8876-6e1103046446 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:05.388035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99924ab-d03f-4874-8876-6e1103046446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:05.388331 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99924ab-d03f-4874-8876-6e1103046446 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:05.388982 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99924ab-d03f-4874-8876-6e1103046446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:05.391294 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99924ab-d03f-4874-8876-6e1103046446 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:05.419120 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1106/2215] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:05 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:05.425901 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99924ab-d03f-4874-8876-6e1103046446 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:05.437014 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99924ab-d03f-4874-8876-6e1103046446 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:05.443725 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450b48e-79d4-45d1-b338-cfad6f1a7942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:05.444337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450b48e-79d4-45d1-b338-cfad6f1a7942 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:05.444611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450b48e-79d4-45d1-b338-cfad6f1a7942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:05.444878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450b48e-79d4-45d1-b338-cfad6f1a7942 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:05.445517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450b48e-79d4-45d1-b338-cfad6f1a7942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:05.447112 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450b48e-79d4-45d1-b338-cfad6f1a7942 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:05.459275 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1107/2216] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:05.463630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450b48e-79d4-45d1-b338-cfad6f1a7942 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:05.470068 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607c44d-1055-4977-a852-027de8d028e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:05.471568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607c44d-1055-4977-a852-027de8d028e0 service glance] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:05.480138 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450b48e-79d4-45d1-b338-cfad6f1a7942 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:05.481891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1110/2217] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:59:05.490952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a80cd-f21a-488d-91e5-c07ccf109117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:05.491630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a80cd-f21a-488d-91e5-c07ccf109117 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:05.491916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a80cd-f21a-488d-91e5-c07ccf109117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:05.492192 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a80cd-f21a-488d-91e5-c07ccf109117 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:05.492845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a80cd-f21a-488d-91e5-c07ccf109117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:05.494613 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a80cd-f21a-488d-91e5-c07ccf109117 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:05.509931 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1108/2218] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:59:05.511046 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607c44d-1055-4977-a852-027de8d028e0 service glance] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:05.522703 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607c44d-1055-4977-a852-027de8d028e0 service glance] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:05.527544 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1314085-37c9-46c8-8b37-4b1b590cb699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:05.528288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1314085-37c9-46c8-8b37-4b1b590cb699 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:05.528837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1314085-37c9-46c8-8b37-4b1b590cb699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:05.529182 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1314085-37c9-46c8-8b37-4b1b590cb699 admin admin] PATH_INFO: `/v3/projects/01a3cdae98044a9fab284f92aa6dd727/users/b4bd3a59a2a240c990f374a80efe8468/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:05.547502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1314085-37c9-46c8-8b37-4b1b590cb699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a3cdae98044a9fab284f92aa6dd727, user_id=b4bd3a59a2a240c990f374a80efe8468, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:05.550848 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1314085-37c9-46c8-8b37-4b1b590cb699 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:05.578921 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1111/2219] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:05 2022] PUT /identity/v3/projects/01a3cdae98044a9fab284f92aa6dd727/users/b4bd3a59a2a240c990f374a80efe8468/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:05.589486 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2531103-cc7b-4968-b561-9f7f718c0989 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:05.589770 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2531103-cc7b-4968-b561-9f7f718c0989 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:05.590044 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2531103-cc7b-4968-b561-9f7f718c0989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:05.611795 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:05.624967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f2531103-cc7b-4968-b561-9f7f718c0989 None None] MFA Rules not processed for user `b4bd3a59a2a240c990f374a80efe8468`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:05.628257 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f2531103-cc7b-4968-b561-9f7f718c0989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:05.712671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1109/2220] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:59:05.723573 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1314085-37c9-46c8-8b37-4b1b590cb699 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:05.800895 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:05.814852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1314085-37c9-46c8-8b37-4b1b590cb699 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:05.820477 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbb2a9-9c79-42c0-aa81-995491d4ac04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:05.821095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbb2a9-9c79-42c0-aa81-995491d4ac04 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:05.821404 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbb2a9-9c79-42c0-aa81-995491d4ac04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:05.821792 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbb2a9-9c79-42c0-aa81-995491d4ac04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:05.822479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbb2a9-9c79-42c0-aa81-995491d4ac04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:05.824745 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbb2a9-9c79-42c0-aa81-995491d4ac04 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:05.874532 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1112/2221] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:05 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:05.881300 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2531103-cc7b-4968-b561-9f7f718c0989 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:05.898465 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2531103-cc7b-4968-b561-9f7f718c0989 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:05.981297 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b21263-cdd2-45fc-9296-1f50f9ad7472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:05.982050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b21263-cdd2-45fc-9296-1f50f9ad7472 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:05.982996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b21263-cdd2-45fc-9296-1f50f9ad7472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:05.983289 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b21263-cdd2-45fc-9296-1f50f9ad7472 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:05.984000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b21263-cdd2-45fc-9296-1f50f9ad7472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:05.986474 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b21263-cdd2-45fc-9296-1f50f9ad7472 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:06.037795 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1110/2222] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:05 2022] POST /identity/v3/users => generated 300 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:06.039225 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbb2a9-9c79-42c0-aa81-995491d4ac04 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:06.055676 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbb2a9-9c79-42c0-aa81-995491d4ac04 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:06.065268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fcdaf-1476-4b81-8a83-030daa8adc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:06.066246 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fcdaf-1476-4b81-8a83-030daa8adc31 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:06.066605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fcdaf-1476-4b81-8a83-030daa8adc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:06.066966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fcdaf-1476-4b81-8a83-030daa8adc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:06.067708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fcdaf-1476-4b81-8a83-030daa8adc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:06.069342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fcdaf-1476-4b81-8a83-030daa8adc31 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:06.081970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1113/2223] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:06.086841 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b21263-cdd2-45fc-9296-1f50f9ad7472 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:06.097032 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b21263-cdd2-45fc-9296-1f50f9ad7472 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:06.102370 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a6fcf-2a5f-4a88-b1f6-0b9486055f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:06.115189 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a6fcf-2a5f-4a88-b1f6-0b9486055f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:06.115189 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a6fcf-2a5f-4a88-b1f6-0b9486055f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:06.115189 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a6fcf-2a5f-4a88-b1f6-0b9486055f51 admin admin] PATH_INFO: `/v3/projects/503190cca87d46d180705e13114769c5/users/37fd8dcfc25342e597e20acaa840631e/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:06.127349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a6fcf-2a5f-4a88-b1f6-0b9486055f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=503190cca87d46d180705e13114769c5, user_id=37fd8dcfc25342e597e20acaa840631e, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:06.130425 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a6fcf-2a5f-4a88-b1f6-0b9486055f51 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:06.147474 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1111/2224] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:06 2022] PUT /identity/v3/projects/503190cca87d46d180705e13114769c5/users/37fd8dcfc25342e597e20acaa840631e/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:06.148859 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fcdaf-1476-4b81-8a83-030daa8adc31 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:06.160482 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fcdaf-1476-4b81-8a83-030daa8adc31 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:06.221718 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea56ec-a833-4319-a1d1-5a8ba88c4e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:06.222326 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea56ec-a833-4319-a1d1-5a8ba88c4e49 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:06.222602 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea56ec-a833-4319-a1d1-5a8ba88c4e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:06.222868 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea56ec-a833-4319-a1d1-5a8ba88c4e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:06.223543 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea56ec-a833-4319-a1d1-5a8ba88c4e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:06.225153 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea56ec-a833-4319-a1d1-5a8ba88c4e49 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:06.235052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1114/2225] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:06.239912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a6fcf-2a5f-4a88-b1f6-0b9486055f51 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:06.252173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a6fcf-2a5f-4a88-b1f6-0b9486055f51 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:06.258719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468299f-0213-47a1-813f-ff8e3b52375b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:06.260220 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468299f-0213-47a1-813f-ff8e3b52375b admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:06.260665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468299f-0213-47a1-813f-ff8e3b52375b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:06.261156 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468299f-0213-47a1-813f-ff8e3b52375b admin admin] PATH_INFO: `/v3/projects/503190cca87d46d180705e13114769c5/users/37fd8dcfc25342e597e20acaa840631e/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:06.263388 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468299f-0213-47a1-813f-ff8e3b52375b admin admin] RBAC: Authorizing `identity:create_grant(project_id=503190cca87d46d180705e13114769c5, user_id=37fd8dcfc25342e597e20acaa840631e, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:06.266434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468299f-0213-47a1-813f-ff8e3b52375b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:06.278201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1112/2226] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:06 2022] PUT /identity/v3/projects/503190cca87d46d180705e13114769c5/users/37fd8dcfc25342e597e20acaa840631e/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:06.290790 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f22a9-31af-45ba-8a31-0ef2a06a2522 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:06.291101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f22a9-31af-45ba-8a31-0ef2a06a2522 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:06.292029 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f22a9-31af-45ba-8a31-0ef2a06a2522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:06.329979 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-657f22a9-31af-45ba-8a31-0ef2a06a2522 None None] MFA Rules not processed for user `37fd8dcfc25342e597e20acaa840631e`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:06.331220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-657f22a9-31af-45ba-8a31-0ef2a06a2522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:06.404951 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1115/2227] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:06.415896 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468299f-0213-47a1-813f-ff8e3b52375b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:06.417578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6468299f-0213-47a1-813f-ff8e3b52375b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:06.489216 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468299f-0213-47a1-813f-ff8e3b52375b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:06.492862 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bb8a7-8cc3-4c9b-ab91-3857c5d63e7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:06.493480 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bb8a7-8cc3-4c9b-ab91-3857c5d63e7f service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:06.493760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bb8a7-8cc3-4c9b-ab91-3857c5d63e7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:06.494160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bb8a7-8cc3-4c9b-ab91-3857c5d63e7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:06.500524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:06.505114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bb8a7-8cc3-4c9b-ab91-3857c5d63e7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:06.507371 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bb8a7-8cc3-4c9b-ab91-3857c5d63e7f service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:06.518561 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1113/2228] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:06.663782 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f22a9-31af-45ba-8a31-0ef2a06a2522 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:06.717757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:06.735660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f22a9-31af-45ba-8a31-0ef2a06a2522 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:06.740233 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0792700-8ba6-4a6e-b8de-5c0d68bf9d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:06.740871 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0792700-8ba6-4a6e-b8de-5c0d68bf9d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:06.741145 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0792700-8ba6-4a6e-b8de-5c0d68bf9d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:06.741415 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0792700-8ba6-4a6e-b8de-5c0d68bf9d87 admin admin] PATH_INFO: `/v3/users/b4bd3a59a2a240c990f374a80efe8468` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:06.742532 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0792700-8ba6-4a6e-b8de-5c0d68bf9d87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4bd3a59a2a240c990f374a80efe8468)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:06.744515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0792700-8ba6-4a6e-b8de-5c0d68bf9d87 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:06.793249 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a0792700-8ba6-4a6e-b8de-5c0d68bf9d87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4bd3a59a2a240c990f374a80efe8468'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:06.800870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a0792700-8ba6-4a6e-b8de-5c0d68bf9d87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4bd3a59a2a240c990f374a80efe8468'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:06.816047 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a0792700-8ba6-4a6e-b8de-5c0d68bf9d87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4bd3a59a2a240c990f374a80efe8468'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:06.816778 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a0792700-8ba6-4a6e-b8de-5c0d68bf9d87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4bd3a59a2a240c990f374a80efe8468'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:06.832972 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a0792700-8ba6-4a6e-b8de-5c0d68bf9d87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4bd3a59a2a240c990f374a80efe8468'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:06.842626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1116/2229] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:06 2022] DELETE /identity/v3/users/b4bd3a59a2a240c990f374a80efe8468 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:06.844945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa2ccf-89fc-4467-bd66-9b6cd4a501b0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:06.845539 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa2ccf-89fc-4467-bd66-9b6cd4a501b0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:06.845962 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa2ccf-89fc-4467-bd66-9b6cd4a501b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:06.867488 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-67fa2ccf-89fc-4467-bd66-9b6cd4a501b0 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:06.868737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-67fa2ccf-89fc-4467-bd66-9b6cd4a501b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:06.944617 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1114/2230] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:06.954805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0792700-8ba6-4a6e-b8de-5c0d68bf9d87 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:06.956549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a0792700-8ba6-4a6e-b8de-5c0d68bf9d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:07.019019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0792700-8ba6-4a6e-b8de-5c0d68bf9d87 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:07.022735 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201129cd-1ed6-4412-96d7-4528bc98c4bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:07.023400 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201129cd-1ed6-4412-96d7-4528bc98c4bf service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:07.023676 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201129cd-1ed6-4412-96d7-4528bc98c4bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:07.023948 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201129cd-1ed6-4412-96d7-4528bc98c4bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:07.034673 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201129cd-1ed6-4412-96d7-4528bc98c4bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:07.036304 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201129cd-1ed6-4412-96d7-4528bc98c4bf service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:07.048271 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1117/2231] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:07.360144 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa2ccf-89fc-4467-bd66-9b6cd4a501b0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:07.361718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-67fa2ccf-89fc-4467-bd66-9b6cd4a501b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:07.377235 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa2ccf-89fc-4467-bd66-9b6cd4a501b0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:07.382787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb471e6-bc56-40a7-8b63-00eb7b5d8e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:07.384025 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb471e6-bc56-40a7-8b63-00eb7b5d8e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:07.384674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb471e6-bc56-40a7-8b63-00eb7b5d8e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:07.384969 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb471e6-bc56-40a7-8b63-00eb7b5d8e3d admin admin] PATH_INFO: `/v3/projects/01a3cdae98044a9fab284f92aa6dd727` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:07.386586 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb471e6-bc56-40a7-8b63-00eb7b5d8e3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=01a3cdae98044a9fab284f92aa6dd727)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:07.388762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb471e6-bc56-40a7-8b63-00eb7b5d8e3d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:07.453482 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fdb471e6-bc56-40a7-8b63-00eb7b5d8e3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a3cdae98044a9fab284f92aa6dd727', 'request_id': 'req-fdb471e6-bc56-40a7-8b63-00eb7b5d8e3d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:07.463021 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fdb471e6-bc56-40a7-8b63-00eb7b5d8e3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a3cdae98044a9fab284f92aa6dd727', 'request_id': 'req-fdb471e6-bc56-40a7-8b63-00eb7b5d8e3d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:07.469251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fdb471e6-bc56-40a7-8b63-00eb7b5d8e3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a3cdae98044a9fab284f92aa6dd727', 'request_id': 'req-fdb471e6-bc56-40a7-8b63-00eb7b5d8e3d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:07.480664 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fdb471e6-bc56-40a7-8b63-00eb7b5d8e3d admin admin] The token cache is being invalidate because project 01a3cdae98044a9fab284f92aa6dd727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:07.480940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fdb471e6-bc56-40a7-8b63-00eb7b5d8e3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:07.482547 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fdb471e6-bc56-40a7-8b63-00eb7b5d8e3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:07.484136 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1115/2232] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:07 2022] DELETE /identity/v3/projects/01a3cdae98044a9fab284f92aa6dd727 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:07.488284 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201129cd-1ed6-4412-96d7-4528bc98c4bf service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:07.498027 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201129cd-1ed6-4412-96d7-4528bc98c4bf service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:07.563057 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ace2fb-f85d-4bf8-ad0f-5d40800d4574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:07.564061 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ace2fb-f85d-4bf8-ad0f-5d40800d4574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:07.564376 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ace2fb-f85d-4bf8-ad0f-5d40800d4574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:07.564932 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ace2fb-f85d-4bf8-ad0f-5d40800d4574 admin admin] PATH_INFO: `/v3/users/37fd8dcfc25342e597e20acaa840631e` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:07.566518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ace2fb-f85d-4bf8-ad0f-5d40800d4574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37fd8dcfc25342e597e20acaa840631e)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:07.568561 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ace2fb-f85d-4bf8-ad0f-5d40800d4574 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:07.582635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:07.620700 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-55ace2fb-f85d-4bf8-ad0f-5d40800d4574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37fd8dcfc25342e597e20acaa840631e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:07.628038 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-55ace2fb-f85d-4bf8-ad0f-5d40800d4574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37fd8dcfc25342e597e20acaa840631e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:07.641044 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-55ace2fb-f85d-4bf8-ad0f-5d40800d4574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37fd8dcfc25342e597e20acaa840631e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:07.641986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-55ace2fb-f85d-4bf8-ad0f-5d40800d4574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37fd8dcfc25342e597e20acaa840631e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:07.658283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-55ace2fb-f85d-4bf8-ad0f-5d40800d4574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37fd8dcfc25342e597e20acaa840631e'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:07.664427 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1118/2233] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:07 2022] DELETE /identity/v3/users/37fd8dcfc25342e597e20acaa840631e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:07.963128 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb471e6-bc56-40a7-8b63-00eb7b5d8e3d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:07.964718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fdb471e6-bc56-40a7-8b63-00eb7b5d8e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:07.980420 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb471e6-bc56-40a7-8b63-00eb7b5d8e3d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:08.041957 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36a3a8-a0ed-4503-8eef-ed822a77c766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:08.042603 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36a3a8-a0ed-4503-8eef-ed822a77c766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:08.042877 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36a3a8-a0ed-4503-8eef-ed822a77c766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:08.043151 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36a3a8-a0ed-4503-8eef-ed822a77c766 admin admin] PATH_INFO: `/v3/projects/503190cca87d46d180705e13114769c5` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:08.044291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36a3a8-a0ed-4503-8eef-ed822a77c766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=503190cca87d46d180705e13114769c5)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:08.046466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36a3a8-a0ed-4503-8eef-ed822a77c766 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:08.071189 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:08.108836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2f36a3a8-a0ed-4503-8eef-ed822a77c766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '503190cca87d46d180705e13114769c5', 'request_id': 'req-2f36a3a8-a0ed-4503-8eef-ed822a77c766'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:08.118837 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2f36a3a8-a0ed-4503-8eef-ed822a77c766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '503190cca87d46d180705e13114769c5', 'request_id': 'req-2f36a3a8-a0ed-4503-8eef-ed822a77c766'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:08.126731 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2f36a3a8-a0ed-4503-8eef-ed822a77c766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '503190cca87d46d180705e13114769c5', 'request_id': 'req-2f36a3a8-a0ed-4503-8eef-ed822a77c766'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:08.153450 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2f36a3a8-a0ed-4503-8eef-ed822a77c766 admin admin] The token cache is being invalidate because project 503190cca87d46d180705e13114769c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:08.153768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2f36a3a8-a0ed-4503-8eef-ed822a77c766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:08.154684 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2f36a3a8-a0ed-4503-8eef-ed822a77c766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:08.161616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1116/2234] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:07 2022] DELETE /identity/v3/projects/503190cca87d46d180705e13114769c5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:08.166475 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bdfe3-6a1f-45ab-9528-0b328cebc07c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:08.166958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bdfe3-6a1f-45ab-9528-0b328cebc07c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:08.167040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bdfe3-6a1f-45ab-9528-0b328cebc07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:08.191889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-864bdfe3-6a1f-45ab-9528-0b328cebc07c None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:08.193159 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-864bdfe3-6a1f-45ab-9528-0b328cebc07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:08.265354 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1119/2235] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:08.273588 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85b64d-fd03-44cb-bf24-9178ac72b699 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:08.274184 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85b64d-fd03-44cb-bf24-9178ac72b699 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:08.274398 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85b64d-fd03-44cb-bf24-9178ac72b699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:08.300968 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3c85b64d-fd03-44cb-bf24-9178ac72b699 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:08.302367 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3c85b64d-fd03-44cb-bf24-9178ac72b699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:08.312422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1117/2236] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:08.317319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bdfe3-6a1f-45ab-9528-0b328cebc07c None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:08.328358 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bdfe3-6a1f-45ab-9528-0b328cebc07c None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:08.333865 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbdda0-428e-4d1b-889e-40b2d0ba7d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:08.334580 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbdda0-428e-4d1b-889e-40b2d0ba7d63 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:08.335048 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbdda0-428e-4d1b-889e-40b2d0ba7d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:08.335460 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbdda0-428e-4d1b-889e-40b2d0ba7d63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:08.336332 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cbdda0-428e-4d1b-889e-40b2d0ba7d63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:59:08.336701 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cbdda0-428e-4d1b-889e-40b2d0ba7d63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:08.338387 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cbdda0-428e-4d1b-889e-40b2d0ba7d63 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:08.358610 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1120/2237] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:59:08.365506 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85b64d-fd03-44cb-bf24-9178ac72b699 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:08.381239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85b64d-fd03-44cb-bf24-9178ac72b699 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:08.386776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f13a6-0093-4add-b997-0bbd3cc1a02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:08.387460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f13a6-0093-4add-b997-0bbd3cc1a02e admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:08.387743 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f13a6-0093-4add-b997-0bbd3cc1a02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:08.388011 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f13a6-0093-4add-b997-0bbd3cc1a02e admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:08.388655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f13a6-0093-4add-b997-0bbd3cc1a02e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:08.390621 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f13a6-0093-4add-b997-0bbd3cc1a02e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:08.427761 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1118/2238] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:08 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:08.431782 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbdda0-428e-4d1b-889e-40b2d0ba7d63 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:08.443291 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbdda0-428e-4d1b-889e-40b2d0ba7d63 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:08.503617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262445a-f2d3-4103-a7d6-a507a7f1a07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:08.504265 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262445a-f2d3-4103-a7d6-a507a7f1a07b admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:08.504614 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262445a-f2d3-4103-a7d6-a507a7f1a07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:08.504964 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262445a-f2d3-4103-a7d6-a507a7f1a07b admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:08.505677 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262445a-f2d3-4103-a7d6-a507a7f1a07b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:08.508133 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262445a-f2d3-4103-a7d6-a507a7f1a07b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:08.535596 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1121/2239] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:08 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:59:08.539851 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f13a6-0093-4add-b997-0bbd3cc1a02e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:08.550610 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f13a6-0093-4add-b997-0bbd3cc1a02e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:08.555925 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ce736-320d-47bc-9861-e6f119de60d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:08.556626 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ce736-320d-47bc-9861-e6f119de60d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:08.557064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ce736-320d-47bc-9861-e6f119de60d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:08.557342 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ce736-320d-47bc-9861-e6f119de60d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:08.558086 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ce736-320d-47bc-9861-e6f119de60d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:08.560216 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ce736-320d-47bc-9861-e6f119de60d4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:08.574110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1119/2240] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:08.578622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262445a-f2d3-4103-a7d6-a507a7f1a07b admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:08.591100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262445a-f2d3-4103-a7d6-a507a7f1a07b admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:08.596244 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc921a-8e41-4991-b94e-7b5adc4ce390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:08.596882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc921a-8e41-4991-b94e-7b5adc4ce390 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:08.597159 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc921a-8e41-4991-b94e-7b5adc4ce390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:08.597430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc921a-8e41-4991-b94e-7b5adc4ce390 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:08.598073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc921a-8e41-4991-b94e-7b5adc4ce390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:08.599804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc921a-8e41-4991-b94e-7b5adc4ce390 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:08.601259 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:08.615436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1122/2241] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:08.617389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ce736-320d-47bc-9861-e6f119de60d4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:08.628179 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ce736-320d-47bc-9861-e6f119de60d4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:08.633302 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3828e-504b-4cf1-9813-5d19d158c37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:08.633971 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3828e-504b-4cf1-9813-5d19d158c37e admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:08.634251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3828e-504b-4cf1-9813-5d19d158c37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:08.634564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3828e-504b-4cf1-9813-5d19d158c37e admin admin] PATH_INFO: `/v3/projects/b762508f3f724d7fb6630e5fc06940e8/users/9b0733a640e245caa9df5c9e0e0d3551/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:08.650027 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3828e-504b-4cf1-9813-5d19d158c37e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b762508f3f724d7fb6630e5fc06940e8, user_id=9b0733a640e245caa9df5c9e0e0d3551, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:08.652745 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3828e-504b-4cf1-9813-5d19d158c37e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:08.667445 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1120/2242] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:08 2022] PUT /identity/v3/projects/b762508f3f724d7fb6630e5fc06940e8/users/9b0733a640e245caa9df5c9e0e0d3551/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:08.678136 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b9461-cfb1-4ba4-a1d5-34299838ee43 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:08.678419 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b9461-cfb1-4ba4-a1d5-34299838ee43 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:08.678684 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b9461-cfb1-4ba4-a1d5-34299838ee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:08.707373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-651b9461-cfb1-4ba4-a1d5-34299838ee43 None None] MFA Rules not processed for user `9b0733a640e245caa9df5c9e0e0d3551`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:08.708708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-651b9461-cfb1-4ba4-a1d5-34299838ee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:08.781462 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1123/2243] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:08.786374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3828e-504b-4cf1-9813-5d19d158c37e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:08.850716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3828e-504b-4cf1-9813-5d19d158c37e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:08.856221 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50fe18-13bc-4d0b-a677-2566d4d49941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:08.856828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50fe18-13bc-4d0b-a677-2566d4d49941 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:08.857108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50fe18-13bc-4d0b-a677-2566d4d49941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:08.857383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50fe18-13bc-4d0b-a677-2566d4d49941 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:08.858336 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50fe18-13bc-4d0b-a677-2566d4d49941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:08.860214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50fe18-13bc-4d0b-a677-2566d4d49941 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:08.890551 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1121/2244] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:08 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:08.894715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b9461-cfb1-4ba4-a1d5-34299838ee43 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:08.905981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b9461-cfb1-4ba4-a1d5-34299838ee43 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:08.973264 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0703d-72b1-4311-8517-18cd36e321c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:08.973875 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0703d-72b1-4311-8517-18cd36e321c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:08.974151 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0703d-72b1-4311-8517-18cd36e321c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:08.974420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0703d-72b1-4311-8517-18cd36e321c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:08.975058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0703d-72b1-4311-8517-18cd36e321c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:08.977076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0703d-72b1-4311-8517-18cd36e321c9 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:09.000572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1124/2245] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:08 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:09.005012 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50fe18-13bc-4d0b-a677-2566d4d49941 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:09.016002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50fe18-13bc-4d0b-a677-2566d4d49941 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:09.021558 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f17ff-6012-465d-b878-c43a538848b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:09.022190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f17ff-6012-465d-b878-c43a538848b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:09.022469 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f17ff-6012-465d-b878-c43a538848b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:09.022739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f17ff-6012-465d-b878-c43a538848b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:09.023386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f17ff-6012-465d-b878-c43a538848b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:09.025060 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f17ff-6012-465d-b878-c43a538848b6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:09.036950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1122/2246] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:09.040968 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0703d-72b1-4311-8517-18cd36e321c9 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:09.051677 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0703d-72b1-4311-8517-18cd36e321c9 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:09.057192 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f27f62-5513-4047-991e-a8e2be65a8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:09.058160 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f27f62-5513-4047-991e-a8e2be65a8ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:09.058557 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f27f62-5513-4047-991e-a8e2be65a8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:09.058966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f27f62-5513-4047-991e-a8e2be65a8ee admin admin] PATH_INFO: `/v3/projects/9a55254a94b3448eb698ba814b6c7847/users/4bbfe477bae8499bb0aee6b1ec387008/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:09.078758 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f27f62-5513-4047-991e-a8e2be65a8ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a55254a94b3448eb698ba814b6c7847, user_id=4bbfe477bae8499bb0aee6b1ec387008, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:09.081515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f27f62-5513-4047-991e-a8e2be65a8ee admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:09.096950 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1125/2247] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:09 2022] PUT /identity/v3/projects/9a55254a94b3448eb698ba814b6c7847/users/4bbfe477bae8499bb0aee6b1ec387008/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:09.101356 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f17ff-6012-465d-b878-c43a538848b6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:09.112199 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f17ff-6012-465d-b878-c43a538848b6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:09.125860 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:09.178362 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3197d6-328f-4ee9-90e0-aa89a3f0d6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:09.178983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3197d6-328f-4ee9-90e0-aa89a3f0d6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:09.179247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3197d6-328f-4ee9-90e0-aa89a3f0d6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:09.179578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3197d6-328f-4ee9-90e0-aa89a3f0d6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:09.180218 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3197d6-328f-4ee9-90e0-aa89a3f0d6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:09.181838 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3197d6-328f-4ee9-90e0-aa89a3f0d6e6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:09.192858 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1123/2248] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:09.199581 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f27f62-5513-4047-991e-a8e2be65a8ee admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:09.214437 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f27f62-5513-4047-991e-a8e2be65a8ee admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:09.227414 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2b6ba-0768-40e6-bad6-f71275023d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:09.227414 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2b6ba-0768-40e6-bad6-f71275023d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:09.227615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2b6ba-0768-40e6-bad6-f71275023d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:09.230804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2b6ba-0768-40e6-bad6-f71275023d5e admin admin] PATH_INFO: `/v3/projects/9a55254a94b3448eb698ba814b6c7847/users/4bbfe477bae8499bb0aee6b1ec387008/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:09.235700 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2b6ba-0768-40e6-bad6-f71275023d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a55254a94b3448eb698ba814b6c7847, user_id=4bbfe477bae8499bb0aee6b1ec387008, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:09.238498 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2b6ba-0768-40e6-bad6-f71275023d5e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:09.256483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1126/2249] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:09 2022] PUT /identity/v3/projects/9a55254a94b3448eb698ba814b6c7847/users/4bbfe477bae8499bb0aee6b1ec387008/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:09.261565 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7eaba-26e2-495e-a9b4-66682cf64245 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:09.261825 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7eaba-26e2-495e-a9b4-66682cf64245 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:09.262106 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7eaba-26e2-495e-a9b4-66682cf64245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:09.290707 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-90b7eaba-26e2-495e-a9b4-66682cf64245 None None] MFA Rules not processed for user `4bbfe477bae8499bb0aee6b1ec387008`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:09.291991 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-90b7eaba-26e2-495e-a9b4-66682cf64245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:09.366208 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1124/2250] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:59:09.377334 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2b6ba-0768-40e6-bad6-f71275023d5e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:09.379105 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-fad2b6ba-0768-40e6-bad6-f71275023d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:09.440680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:09.467392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2b6ba-0768-40e6-bad6-f71275023d5e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:09.468223 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fba853-9b73-4438-86d6-ad16527292c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:09.469902 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fba853-9b73-4438-86d6-ad16527292c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:09.469902 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fba853-9b73-4438-86d6-ad16527292c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:09.469902 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fba853-9b73-4438-86d6-ad16527292c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:09.480611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fba853-9b73-4438-86d6-ad16527292c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:09.482126 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fba853-9b73-4438-86d6-ad16527292c2 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:09.492579 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1127/2251] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:59:10.050190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7eaba-26e2-495e-a9b4-66682cf64245 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:10.115773 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7eaba-26e2-495e-a9b4-66682cf64245 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:10.121389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202cd5f-0797-46c4-91ca-80e3d6831baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:10.122060 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202cd5f-0797-46c4-91ca-80e3d6831baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:10.122338 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202cd5f-0797-46c4-91ca-80e3d6831baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:10.122602 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202cd5f-0797-46c4-91ca-80e3d6831baa admin admin] PATH_INFO: `/v3/users/9b0733a640e245caa9df5c9e0e0d3551` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:10.123971 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202cd5f-0797-46c4-91ca-80e3d6831baa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b0733a640e245caa9df5c9e0e0d3551)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:10.125913 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202cd5f-0797-46c4-91ca-80e3d6831baa admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:10.170422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:10.177065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a202cd5f-0797-46c4-91ca-80e3d6831baa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b0733a640e245caa9df5c9e0e0d3551'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:10.185252 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a202cd5f-0797-46c4-91ca-80e3d6831baa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b0733a640e245caa9df5c9e0e0d3551'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:10.194992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a202cd5f-0797-46c4-91ca-80e3d6831baa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b0733a640e245caa9df5c9e0e0d3551'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:10.208669 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a202cd5f-0797-46c4-91ca-80e3d6831baa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b0733a640e245caa9df5c9e0e0d3551'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:10.209390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a202cd5f-0797-46c4-91ca-80e3d6831baa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b0733a640e245caa9df5c9e0e0d3551'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:10.215448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1125/2252] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:10 2022] DELETE /identity/v3/users/9b0733a640e245caa9df5c9e0e0d3551 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:10.220380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264cac4-5f82-49bf-8fe2-04a6454f8253 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:10.220882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264cac4-5f82-49bf-8fe2-04a6454f8253 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:10.220997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264cac4-5f82-49bf-8fe2-04a6454f8253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:10.242341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-1264cac4-5f82-49bf-8fe2-04a6454f8253 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:10.243608 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1264cac4-5f82-49bf-8fe2-04a6454f8253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:10.315163 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1128/2253] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:10.325203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202cd5f-0797-46c4-91ca-80e3d6831baa admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:10.326808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a202cd5f-0797-46c4-91ca-80e3d6831baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:10.388035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202cd5f-0797-46c4-91ca-80e3d6831baa admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:10.391940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8eeb5-7037-4708-aa0b-1c67ebaed84d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:10.392717 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8eeb5-7037-4708-aa0b-1c67ebaed84d service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:10.392997 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8eeb5-7037-4708-aa0b-1c67ebaed84d service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:10.393274 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8eeb5-7037-4708-aa0b-1c67ebaed84d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:10.402391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8eeb5-7037-4708-aa0b-1c67ebaed84d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:10.403881 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8eeb5-7037-4708-aa0b-1c67ebaed84d service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:10.413888 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1126/2254] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:10.725670 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264cac4-5f82-49bf-8fe2-04a6454f8253 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:10.727275 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1264cac4-5f82-49bf-8fe2-04a6454f8253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:10.754941 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264cac4-5f82-49bf-8fe2-04a6454f8253 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:10.759981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe4d15-0528-460e-b63b-c9ddaf41ec69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:10.760671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe4d15-0528-460e-b63b-c9ddaf41ec69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:10.761118 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe4d15-0528-460e-b63b-c9ddaf41ec69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:10.761357 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe4d15-0528-460e-b63b-c9ddaf41ec69 admin admin] PATH_INFO: `/v3/projects/b762508f3f724d7fb6630e5fc06940e8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:10.762965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe4d15-0528-460e-b63b-c9ddaf41ec69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b762508f3f724d7fb6630e5fc06940e8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:10.765060 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe4d15-0528-460e-b63b-c9ddaf41ec69 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:10.815800 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-affe4d15-0528-460e-b63b-c9ddaf41ec69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b762508f3f724d7fb6630e5fc06940e8', 'request_id': 'req-affe4d15-0528-460e-b63b-c9ddaf41ec69'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:10.822190 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-affe4d15-0528-460e-b63b-c9ddaf41ec69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b762508f3f724d7fb6630e5fc06940e8', 'request_id': 'req-affe4d15-0528-460e-b63b-c9ddaf41ec69'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:10.833777 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-affe4d15-0528-460e-b63b-c9ddaf41ec69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b762508f3f724d7fb6630e5fc06940e8', 'request_id': 'req-affe4d15-0528-460e-b63b-c9ddaf41ec69'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:10.847717 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-affe4d15-0528-460e-b63b-c9ddaf41ec69 admin admin] The token cache is being invalidate because project b762508f3f724d7fb6630e5fc06940e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:10.848003 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-affe4d15-0528-460e-b63b-c9ddaf41ec69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:10.848626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-affe4d15-0528-460e-b63b-c9ddaf41ec69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:10.850168 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1129/2255] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:10 2022] DELETE /identity/v3/projects/b762508f3f724d7fb6630e5fc06940e8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:10.854587 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8eeb5-7037-4708-aa0b-1c67ebaed84d service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:10.865582 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8eeb5-7037-4708-aa0b-1c67ebaed84d service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:10.928165 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b8728-42b9-4799-9bc8-aee2e9974ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:10.928930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b8728-42b9-4799-9bc8-aee2e9974ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:10.929211 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b8728-42b9-4799-9bc8-aee2e9974ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:10.929488 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b8728-42b9-4799-9bc8-aee2e9974ecb admin admin] PATH_INFO: `/v3/users/4bbfe477bae8499bb0aee6b1ec387008` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:10.931814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b8728-42b9-4799-9bc8-aee2e9974ecb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bbfe477bae8499bb0aee6b1ec387008)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:10.933739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b8728-42b9-4799-9bc8-aee2e9974ecb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:11.006460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0d2b8728-42b9-4799-9bc8-aee2e9974ecb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bbfe477bae8499bb0aee6b1ec387008'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:11.013706 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0d2b8728-42b9-4799-9bc8-aee2e9974ecb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bbfe477bae8499bb0aee6b1ec387008'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:11.023549 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0d2b8728-42b9-4799-9bc8-aee2e9974ecb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bbfe477bae8499bb0aee6b1ec387008'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:11.026061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:11.043946 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0d2b8728-42b9-4799-9bc8-aee2e9974ecb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bbfe477bae8499bb0aee6b1ec387008'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:11.046182 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0d2b8728-42b9-4799-9bc8-aee2e9974ecb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bbfe477bae8499bb0aee6b1ec387008'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:11.055995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1127/2256] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:10 2022] DELETE /identity/v3/users/4bbfe477bae8499bb0aee6b1ec387008 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:11.414700 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe4d15-0528-460e-b63b-c9ddaf41ec69 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:11.416432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-affe4d15-0528-460e-b63b-c9ddaf41ec69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:11.439226 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe4d15-0528-460e-b63b-c9ddaf41ec69 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:11.532851 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ee912-a902-473f-b8e1-69c2cc8806da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:11.533673 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ee912-a902-473f-b8e1-69c2cc8806da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:11.534041 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ee912-a902-473f-b8e1-69c2cc8806da admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:11.534372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ee912-a902-473f-b8e1-69c2cc8806da admin admin] PATH_INFO: `/v3/projects/9a55254a94b3448eb698ba814b6c7847` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:11.535785 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ee912-a902-473f-b8e1-69c2cc8806da admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a55254a94b3448eb698ba814b6c7847)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:11.539287 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ee912-a902-473f-b8e1-69c2cc8806da admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:11.547327 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:11.660330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-461ee912-a902-473f-b8e1-69c2cc8806da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a55254a94b3448eb698ba814b6c7847', 'request_id': 'req-461ee912-a902-473f-b8e1-69c2cc8806da'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:11.671604 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-461ee912-a902-473f-b8e1-69c2cc8806da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a55254a94b3448eb698ba814b6c7847', 'request_id': 'req-461ee912-a902-473f-b8e1-69c2cc8806da'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:11.682293 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-461ee912-a902-473f-b8e1-69c2cc8806da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a55254a94b3448eb698ba814b6c7847', 'request_id': 'req-461ee912-a902-473f-b8e1-69c2cc8806da'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:11.697219 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-461ee912-a902-473f-b8e1-69c2cc8806da admin admin] The token cache is being invalidate because project 9a55254a94b3448eb698ba814b6c7847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:11.697322 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-461ee912-a902-473f-b8e1-69c2cc8806da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:11.697944 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-461ee912-a902-473f-b8e1-69c2cc8806da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:11.700208 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1130/2257] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:11 2022] DELETE /identity/v3/projects/9a55254a94b3448eb698ba814b6c7847 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:11.706880 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353b13d-d30c-4ba5-ba5d-44aeb3d65c7f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:11.707579 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353b13d-d30c-4ba5-ba5d-44aeb3d65c7f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:11.707579 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353b13d-d30c-4ba5-ba5d-44aeb3d65c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:11.729114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3353b13d-d30c-4ba5-ba5d-44aeb3d65c7f None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:11.730330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3353b13d-d30c-4ba5-ba5d-44aeb3d65c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:11.795100 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1128/2258] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:11.803025 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3785c-b47f-45de-a1ce-56d49a750c70 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:11.803308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3785c-b47f-45de-a1ce-56d49a750c70 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:11.803610 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3785c-b47f-45de-a1ce-56d49a750c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:11.828094 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-33e3785c-b47f-45de-a1ce-56d49a750c70 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:11.829337 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-33e3785c-b47f-45de-a1ce-56d49a750c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:11.837620 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1131/2259] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:11.842082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353b13d-d30c-4ba5-ba5d-44aeb3d65c7f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:11.852128 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353b13d-d30c-4ba5-ba5d-44aeb3d65c7f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:11.857673 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe609cdb-8753-4c8e-a6e0-3d7783a6684a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:11.858336 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe609cdb-8753-4c8e-a6e0-3d7783a6684a admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:11.858729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe609cdb-8753-4c8e-a6e0-3d7783a6684a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:11.859003 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe609cdb-8753-4c8e-a6e0-3d7783a6684a admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:11.859687 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe609cdb-8753-4c8e-a6e0-3d7783a6684a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:59:11.859990 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe609cdb-8753-4c8e-a6e0-3d7783a6684a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:11.861593 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe609cdb-8753-4c8e-a6e0-3d7783a6684a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:11.874879 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1129/2260] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:59:11.879378 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3785c-b47f-45de-a1ce-56d49a750c70 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:11.888865 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3785c-b47f-45de-a1ce-56d49a750c70 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:11.893713 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbda75-f7a9-4caa-bc9c-30eef16917dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:11.894308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbda75-f7a9-4caa-bc9c-30eef16917dc admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:11.894581 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbda75-f7a9-4caa-bc9c-30eef16917dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:11.894848 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbda75-f7a9-4caa-bc9c-30eef16917dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:11.895510 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bbda75-f7a9-4caa-bc9c-30eef16917dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:11.897430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bbda75-f7a9-4caa-bc9c-30eef16917dc admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:11.929953 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1132/2261] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:11 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:11.934953 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe609cdb-8753-4c8e-a6e0-3d7783a6684a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:11.951309 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe609cdb-8753-4c8e-a6e0-3d7783a6684a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:12.015588 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b52eb-9e9d-4868-a1dd-f7193714990e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:12.016320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b52eb-9e9d-4868-a1dd-f7193714990e admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:12.016656 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b52eb-9e9d-4868-a1dd-f7193714990e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:12.016993 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b52eb-9e9d-4868-a1dd-f7193714990e admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:12.017731 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b52eb-9e9d-4868-a1dd-f7193714990e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:12.019857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b52eb-9e9d-4868-a1dd-f7193714990e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:12.043139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1130/2262] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:11 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:12.047989 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbda75-f7a9-4caa-bc9c-30eef16917dc admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:12.059420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbda75-f7a9-4caa-bc9c-30eef16917dc admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:12.065222 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bd97a-ba54-42c8-8453-b87a25b30563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:12.065838 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bd97a-ba54-42c8-8453-b87a25b30563 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:12.066117 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bd97a-ba54-42c8-8453-b87a25b30563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:12.066430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bd97a-ba54-42c8-8453-b87a25b30563 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:12.067083 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bd97a-ba54-42c8-8453-b87a25b30563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:12.068737 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bd97a-ba54-42c8-8453-b87a25b30563 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:12.080245 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1133/2263] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:12.084476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b52eb-9e9d-4868-a1dd-f7193714990e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:12.095625 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b52eb-9e9d-4868-a1dd-f7193714990e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:12.101201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a90c7-5a58-4236-aa08-9b8a618b25bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:12.102044 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a90c7-5a58-4236-aa08-9b8a618b25bb admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:12.102477 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a90c7-5a58-4236-aa08-9b8a618b25bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:12.107420 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a90c7-5a58-4236-aa08-9b8a618b25bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:12.108666 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a90c7-5a58-4236-aa08-9b8a618b25bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:12.113518 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a90c7-5a58-4236-aa08-9b8a618b25bb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:12.134614 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1131/2264] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:59:12.138781 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bd97a-ba54-42c8-8453-b87a25b30563 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:12.149423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bd97a-ba54-42c8-8453-b87a25b30563 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:12.153990 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12960a64-a204-4849-9b96-03b52b2f5f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:12.154831 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12960a64-a204-4849-9b96-03b52b2f5f48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:12.155106 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12960a64-a204-4849-9b96-03b52b2f5f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:12.155393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12960a64-a204-4849-9b96-03b52b2f5f48 admin admin] PATH_INFO: `/v3/projects/b4ea5c09dd4a4d11963a32f14c6dfaba/users/db6c3cdb37aa427682551bb09af2b520/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:12.173178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12960a64-a204-4849-9b96-03b52b2f5f48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ea5c09dd4a4d11963a32f14c6dfaba, user_id=db6c3cdb37aa427682551bb09af2b520, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:12.175984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12960a64-a204-4849-9b96-03b52b2f5f48 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:12.191464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1134/2265] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:12 2022] PUT /identity/v3/projects/b4ea5c09dd4a4d11963a32f14c6dfaba/users/db6c3cdb37aa427682551bb09af2b520/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:12.203512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e83490-c58d-403e-b767-d771411c448d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:12.203799 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e83490-c58d-403e-b767-d771411c448d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:12.204143 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e83490-c58d-403e-b767-d771411c448d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:12.233192 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e7e83490-c58d-403e-b767-d771411c448d None None] MFA Rules not processed for user `db6c3cdb37aa427682551bb09af2b520`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:12.234365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e7e83490-c58d-403e-b767-d771411c448d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:12.279468 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:12.312206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1132/2266] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:59:12.316927 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12960a64-a204-4849-9b96-03b52b2f5f48 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:12.382358 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12960a64-a204-4849-9b96-03b52b2f5f48 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:12.387568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564060cc-8fe5-4d84-898e-67dd123599fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:12.388257 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564060cc-8fe5-4d84-898e-67dd123599fc admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:12.388535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564060cc-8fe5-4d84-898e-67dd123599fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:12.388856 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564060cc-8fe5-4d84-898e-67dd123599fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:12.389779 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564060cc-8fe5-4d84-898e-67dd123599fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:12.392011 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564060cc-8fe5-4d84-898e-67dd123599fc admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:12.423581 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1135/2267] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:12 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:59:12.427990 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e83490-c58d-403e-b767-d771411c448d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:12.439849 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e83490-c58d-403e-b767-d771411c448d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:12.499741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b19375-e81e-4ed7-b67b-5e27a921f58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:12.500390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b19375-e81e-4ed7-b67b-5e27a921f58f admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:12.500770 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b19375-e81e-4ed7-b67b-5e27a921f58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:12.500930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b19375-e81e-4ed7-b67b-5e27a921f58f admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:12.501602 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b19375-e81e-4ed7-b67b-5e27a921f58f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:12.503564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b19375-e81e-4ed7-b67b-5e27a921f58f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:12.527343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1133/2268] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:12 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:59:12.531597 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564060cc-8fe5-4d84-898e-67dd123599fc admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:12.542754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564060cc-8fe5-4d84-898e-67dd123599fc admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:12.548677 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4f66d-22fc-4249-bad2-4ef116b326f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:12.549297 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4f66d-22fc-4249-bad2-4ef116b326f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:12.549586 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4f66d-22fc-4249-bad2-4ef116b326f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:12.549852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4f66d-22fc-4249-bad2-4ef116b326f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:12.550943 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4f66d-22fc-4249-bad2-4ef116b326f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:12.552604 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4f66d-22fc-4249-bad2-4ef116b326f3 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:12.568289 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1136/2269] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:12.572566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b19375-e81e-4ed7-b67b-5e27a921f58f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:12.584166 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b19375-e81e-4ed7-b67b-5e27a921f58f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:12.589620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d86e6-e003-46a0-977b-f3d43697f056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:12.590292 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d86e6-e003-46a0-977b-f3d43697f056 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:12.590573 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d86e6-e003-46a0-977b-f3d43697f056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:12.590834 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d86e6-e003-46a0-977b-f3d43697f056 admin admin] PATH_INFO: `/v3/projects/77a2a57d8636484ea764f704208ae2b6/users/17dc4121a8ba46809fdfff433ba41b73/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:12.606735 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d86e6-e003-46a0-977b-f3d43697f056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a2a57d8636484ea764f704208ae2b6, user_id=17dc4121a8ba46809fdfff433ba41b73, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:12.609477 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d86e6-e003-46a0-977b-f3d43697f056 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:12.625005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1134/2270] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:12 2022] PUT /identity/v3/projects/77a2a57d8636484ea764f704208ae2b6/users/17dc4121a8ba46809fdfff433ba41b73/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:12.629398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4f66d-22fc-4249-bad2-4ef116b326f3 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:12.637761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:12.644258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4f66d-22fc-4249-bad2-4ef116b326f3 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:12.709589 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cfb88-81dc-4fff-919b-9998c3ff1300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:12.710243 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cfb88-81dc-4fff-919b-9998c3ff1300 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:12.710514 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cfb88-81dc-4fff-919b-9998c3ff1300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:12.710791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cfb88-81dc-4fff-919b-9998c3ff1300 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:12.711538 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cfb88-81dc-4fff-919b-9998c3ff1300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:12.713142 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cfb88-81dc-4fff-919b-9998c3ff1300 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:12.727259 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1137/2271] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:12.735385 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d86e6-e003-46a0-977b-f3d43697f056 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:12.745945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d86e6-e003-46a0-977b-f3d43697f056 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:12.750922 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af29fa-554e-438f-b744-9c3f0652af0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:12.751618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af29fa-554e-438f-b744-9c3f0652af0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:12.751897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af29fa-554e-438f-b744-9c3f0652af0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:12.752167 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af29fa-554e-438f-b744-9c3f0652af0a admin admin] PATH_INFO: `/v3/projects/77a2a57d8636484ea764f704208ae2b6/users/17dc4121a8ba46809fdfff433ba41b73/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:12.754170 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af29fa-554e-438f-b744-9c3f0652af0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a2a57d8636484ea764f704208ae2b6, user_id=17dc4121a8ba46809fdfff433ba41b73, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:12.756831 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af29fa-554e-438f-b744-9c3f0652af0a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:12.769097 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1135/2272] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:12 2022] PUT /identity/v3/projects/77a2a57d8636484ea764f704208ae2b6/users/17dc4121a8ba46809fdfff433ba41b73/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:12.779868 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb1467-70b8-49b4-9b04-98a00a8538f4 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:12.780163 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb1467-70b8-49b4-9b04-98a00a8538f4 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:12.780498 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb1467-70b8-49b4-9b04-98a00a8538f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:12.811569 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-b6fb1467-70b8-49b4-9b04-98a00a8538f4 None None] MFA Rules not processed for user `17dc4121a8ba46809fdfff433ba41b73`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:12.812822 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b6fb1467-70b8-49b4-9b04-98a00a8538f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:12.889016 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1138/2273] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:12.899709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af29fa-554e-438f-b744-9c3f0652af0a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:12.901404 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-61af29fa-554e-438f-b744-9c3f0652af0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:12.963688 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af29fa-554e-438f-b744-9c3f0652af0a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:12.967417 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ef758-c317-4c06-859a-c15dc5c305f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:12.968061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ef758-c317-4c06-859a-c15dc5c305f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:12.968341 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ef758-c317-4c06-859a-c15dc5c305f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:12.968613 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ef758-c317-4c06-859a-c15dc5c305f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:13.012178 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:13.028001 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ef758-c317-4c06-859a-c15dc5c305f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:13.029647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ef758-c317-4c06-859a-c15dc5c305f7 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:13.038647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1136/2274] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:15.240198 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb1467-70b8-49b4-9b04-98a00a8538f4 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:15.241860 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b6fb1467-70b8-49b4-9b04-98a00a8538f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:15.254533 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb1467-70b8-49b4-9b04-98a00a8538f4 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:15.258313 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb9704-88f4-4be1-b51d-66c7120d7f6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:15.258920 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb9704-88f4-4be1-b51d-66c7120d7f6c service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:15.259193 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb9704-88f4-4be1-b51d-66c7120d7f6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:15.259489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb9704-88f4-4be1-b51d-66c7120d7f6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:15.261361 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9eeb9704-88f4-4be1-b51d-66c7120d7f6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:15.335371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb9704-88f4-4be1-b51d-66c7120d7f6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:15.336830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb9704-88f4-4be1-b51d-66c7120d7f6c service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:15.352563 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1139/2275] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:15.677653 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ef758-c317-4c06-859a-c15dc5c305f7 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:15.752545 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ef758-c317-4c06-859a-c15dc5c305f7 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:15.757049 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492da05b-60ed-42e0-89fb-88c47cdfc66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:15.757734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492da05b-60ed-42e0-89fb-88c47cdfc66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:15.758006 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492da05b-60ed-42e0-89fb-88c47cdfc66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:15.758274 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492da05b-60ed-42e0-89fb-88c47cdfc66d admin admin] PATH_INFO: `/v3/users/db6c3cdb37aa427682551bb09af2b520` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:15.759402 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492da05b-60ed-42e0-89fb-88c47cdfc66d admin admin] RBAC: Authorizing `identity:delete_user(user_id=db6c3cdb37aa427682551bb09af2b520)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:15.761304 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492da05b-60ed-42e0-89fb-88c47cdfc66d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:15.818337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-492da05b-60ed-42e0-89fb-88c47cdfc66d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db6c3cdb37aa427682551bb09af2b520'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:15.825494 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-492da05b-60ed-42e0-89fb-88c47cdfc66d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db6c3cdb37aa427682551bb09af2b520'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:15.834695 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-492da05b-60ed-42e0-89fb-88c47cdfc66d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db6c3cdb37aa427682551bb09af2b520'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:15.847953 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-492da05b-60ed-42e0-89fb-88c47cdfc66d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db6c3cdb37aa427682551bb09af2b520'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:15.848633 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-492da05b-60ed-42e0-89fb-88c47cdfc66d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db6c3cdb37aa427682551bb09af2b520'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:15.854747 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1137/2276] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:15 2022] DELETE /identity/v3/users/db6c3cdb37aa427682551bb09af2b520 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:15.859421 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b9885-fcea-497e-a3cd-226def2cd163 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:15.859737 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b9885-fcea-497e-a3cd-226def2cd163 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:15.860014 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b9885-fcea-497e-a3cd-226def2cd163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:15.883125 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-124b9885-fcea-497e-a3cd-226def2cd163 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:15.884289 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-124b9885-fcea-497e-a3cd-226def2cd163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:15.906539 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:15.959951 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1140/2277] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:15.972494 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492da05b-60ed-42e0-89fb-88c47cdfc66d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:15.974093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-492da05b-60ed-42e0-89fb-88c47cdfc66d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:16.036632 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492da05b-60ed-42e0-89fb-88c47cdfc66d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:16.041041 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323c707-a078-449c-b31a-9d1f8f285565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:16.041678 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323c707-a078-449c-b31a-9d1f8f285565 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:16.041994 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323c707-a078-449c-b31a-9d1f8f285565 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:16.042223 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323c707-a078-449c-b31a-9d1f8f285565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:16.054412 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323c707-a078-449c-b31a-9d1f8f285565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:16.055932 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323c707-a078-449c-b31a-9d1f8f285565 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:16.066554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1138/2278] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:16.419705 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b9885-fcea-497e-a3cd-226def2cd163 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:16.421354 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-124b9885-fcea-497e-a3cd-226def2cd163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:16.433893 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b9885-fcea-497e-a3cd-226def2cd163 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:16.440515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd143f-4afb-4ade-9608-12b683852a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:16.441558 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd143f-4afb-4ade-9608-12b683852a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:16.441861 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd143f-4afb-4ade-9608-12b683852a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:16.442409 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd143f-4afb-4ade-9608-12b683852a63 admin admin] PATH_INFO: `/v3/projects/b4ea5c09dd4a4d11963a32f14c6dfaba` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:16.443638 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd143f-4afb-4ade-9608-12b683852a63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4ea5c09dd4a4d11963a32f14c6dfaba)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:16.445576 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd143f-4afb-4ade-9608-12b683852a63 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:16.500483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b8fd143f-4afb-4ade-9608-12b683852a63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4ea5c09dd4a4d11963a32f14c6dfaba', 'request_id': 'req-b8fd143f-4afb-4ade-9608-12b683852a63'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:16.508771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b8fd143f-4afb-4ade-9608-12b683852a63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4ea5c09dd4a4d11963a32f14c6dfaba', 'request_id': 'req-b8fd143f-4afb-4ade-9608-12b683852a63'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:16.517078 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b8fd143f-4afb-4ade-9608-12b683852a63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4ea5c09dd4a4d11963a32f14c6dfaba', 'request_id': 'req-b8fd143f-4afb-4ade-9608-12b683852a63'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:16.533323 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b8fd143f-4afb-4ade-9608-12b683852a63 admin admin] The token cache is being invalidate because project b4ea5c09dd4a4d11963a32f14c6dfaba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:16.533621 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b8fd143f-4afb-4ade-9608-12b683852a63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:16.534311 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b8fd143f-4afb-4ade-9608-12b683852a63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:16.536003 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1141/2279] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:16 2022] DELETE /identity/v3/projects/b4ea5c09dd4a4d11963a32f14c6dfaba => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:16.540320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323c707-a078-449c-b31a-9d1f8f285565 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:16.546531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:16.550931 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323c707-a078-449c-b31a-9d1f8f285565 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:16.620025 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47e8c3-0a86-413c-91c2-d505b2f5bea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:16.620688 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47e8c3-0a86-413c-91c2-d505b2f5bea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:16.620966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47e8c3-0a86-413c-91c2-d505b2f5bea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:16.621234 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47e8c3-0a86-413c-91c2-d505b2f5bea8 admin admin] PATH_INFO: `/v3/users/17dc4121a8ba46809fdfff433ba41b73` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:16.622395 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47e8c3-0a86-413c-91c2-d505b2f5bea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17dc4121a8ba46809fdfff433ba41b73)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:16.624558 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47e8c3-0a86-413c-91c2-d505b2f5bea8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:16.677623 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7c47e8c3-0a86-413c-91c2-d505b2f5bea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17dc4121a8ba46809fdfff433ba41b73'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:16.684633 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7c47e8c3-0a86-413c-91c2-d505b2f5bea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17dc4121a8ba46809fdfff433ba41b73'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:16.693049 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7c47e8c3-0a86-413c-91c2-d505b2f5bea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17dc4121a8ba46809fdfff433ba41b73'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:16.705305 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7c47e8c3-0a86-413c-91c2-d505b2f5bea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17dc4121a8ba46809fdfff433ba41b73'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:16.705966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7c47e8c3-0a86-413c-91c2-d505b2f5bea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17dc4121a8ba46809fdfff433ba41b73'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:16.712478 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1139/2280] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:16 2022] DELETE /identity/v3/users/17dc4121a8ba46809fdfff433ba41b73 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:17.089497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd143f-4afb-4ade-9608-12b683852a63 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:17.091097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b8fd143f-4afb-4ade-9608-12b683852a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:17.106887 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd143f-4afb-4ade-9608-12b683852a63 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:17.174327 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0871779-d5b8-4c49-949f-2bc8f72986ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:17.174879 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0871779-d5b8-4c49-949f-2bc8f72986ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:17.175154 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0871779-d5b8-4c49-949f-2bc8f72986ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:17.175432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0871779-d5b8-4c49-949f-2bc8f72986ba admin admin] PATH_INFO: `/v3/projects/77a2a57d8636484ea764f704208ae2b6` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:17.176640 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0871779-d5b8-4c49-949f-2bc8f72986ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a2a57d8636484ea764f704208ae2b6)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:17.178622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0871779-d5b8-4c49-949f-2bc8f72986ba admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:17.226544 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:17.229793 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f0871779-d5b8-4c49-949f-2bc8f72986ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a2a57d8636484ea764f704208ae2b6', 'request_id': 'req-f0871779-d5b8-4c49-949f-2bc8f72986ba'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:17.237886 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f0871779-d5b8-4c49-949f-2bc8f72986ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a2a57d8636484ea764f704208ae2b6', 'request_id': 'req-f0871779-d5b8-4c49-949f-2bc8f72986ba'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:17.243649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f0871779-d5b8-4c49-949f-2bc8f72986ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a2a57d8636484ea764f704208ae2b6', 'request_id': 'req-f0871779-d5b8-4c49-949f-2bc8f72986ba'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:17.257612 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f0871779-d5b8-4c49-949f-2bc8f72986ba admin admin] The token cache is being invalidate because project 77a2a57d8636484ea764f704208ae2b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:17.257903 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f0871779-d5b8-4c49-949f-2bc8f72986ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:17.258589 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f0871779-d5b8-4c49-949f-2bc8f72986ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:17.260213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1142/2281] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:17 2022] DELETE /identity/v3/projects/77a2a57d8636484ea764f704208ae2b6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:17.265593 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9cf09-db25-42ff-806b-ce177fff3acd None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:17.265593 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9cf09-db25-42ff-806b-ce177fff3acd None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:17.266445 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9cf09-db25-42ff-806b-ce177fff3acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:17.287055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a3b9cf09-db25-42ff-806b-ce177fff3acd None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:17.288319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a3b9cf09-db25-42ff-806b-ce177fff3acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:17.353524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1140/2282] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:17.362314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed2eae-bf5b-4c5b-9a38-2ef8ed7c0da9 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:17.362597 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed2eae-bf5b-4c5b-9a38-2ef8ed7c0da9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:17.362864 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed2eae-bf5b-4c5b-9a38-2ef8ed7c0da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:17.383300 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-93ed2eae-bf5b-4c5b-9a38-2ef8ed7c0da9 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:17.384513 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-93ed2eae-bf5b-4c5b-9a38-2ef8ed7c0da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:17.393009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1143/2283] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:17.397367 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9cf09-db25-42ff-806b-ce177fff3acd None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:17.407614 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9cf09-db25-42ff-806b-ce177fff3acd None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:17.412408 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8423d6-1e48-4f4b-ac97-d4983aeabec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:17.413020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8423d6-1e48-4f4b-ac97-d4983aeabec1 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:17.413298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8423d6-1e48-4f4b-ac97-d4983aeabec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:17.413569 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8423d6-1e48-4f4b-ac97-d4983aeabec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:17.414221 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8423d6-1e48-4f4b-ac97-d4983aeabec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:59:17.414526 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8423d6-1e48-4f4b-ac97-d4983aeabec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:17.416180 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8423d6-1e48-4f4b-ac97-d4983aeabec1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:17.428782 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1141/2284] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:59:17.433300 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed2eae-bf5b-4c5b-9a38-2ef8ed7c0da9 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:17.443131 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed2eae-bf5b-4c5b-9a38-2ef8ed7c0da9 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:17.448005 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3dfcb-15dc-4d3f-bd28-5b2b90748484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:17.448610 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3dfcb-15dc-4d3f-bd28-5b2b90748484 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:17.448891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3dfcb-15dc-4d3f-bd28-5b2b90748484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:17.449150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3dfcb-15dc-4d3f-bd28-5b2b90748484 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:17.449794 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3dfcb-15dc-4d3f-bd28-5b2b90748484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:17.453394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3dfcb-15dc-4d3f-bd28-5b2b90748484 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:17.483460 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1144/2285] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:17 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:17.487791 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8423d6-1e48-4f4b-ac97-d4983aeabec1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:17.498199 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8423d6-1e48-4f4b-ac97-d4983aeabec1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:17.507639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:17.573921 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8978cbb-c879-4aba-91d5-fec92d814311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:17.574542 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8978cbb-c879-4aba-91d5-fec92d814311 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:17.574821 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8978cbb-c879-4aba-91d5-fec92d814311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:17.575093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8978cbb-c879-4aba-91d5-fec92d814311 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:17.575785 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8978cbb-c879-4aba-91d5-fec92d814311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:17.578258 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8978cbb-c879-4aba-91d5-fec92d814311 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:17.601918 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1142/2286] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:17 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:17.605900 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3dfcb-15dc-4d3f-bd28-5b2b90748484 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:17.617024 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3dfcb-15dc-4d3f-bd28-5b2b90748484 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:17.621807 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8df2e-5312-4216-81b9-03198ad21092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:17.622435 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8df2e-5312-4216-81b9-03198ad21092 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:17.622706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8df2e-5312-4216-81b9-03198ad21092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:17.622972 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8df2e-5312-4216-81b9-03198ad21092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:17.623638 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8df2e-5312-4216-81b9-03198ad21092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:17.625420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8df2e-5312-4216-81b9-03198ad21092 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:17.636675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1145/2287] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:59:17.640949 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8978cbb-c879-4aba-91d5-fec92d814311 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:17.650999 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8978cbb-c879-4aba-91d5-fec92d814311 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:17.655786 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11542bad-e6ab-4767-917d-96c9c73a18ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:17.656405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11542bad-e6ab-4767-917d-96c9c73a18ef admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:17.656683 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11542bad-e6ab-4767-917d-96c9c73a18ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:17.656944 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11542bad-e6ab-4767-917d-96c9c73a18ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:17.657582 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11542bad-e6ab-4767-917d-96c9c73a18ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:17.659147 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11542bad-e6ab-4767-917d-96c9c73a18ef admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:17.669986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1143/2288] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:17.675009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8df2e-5312-4216-81b9-03198ad21092 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:17.686431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8df2e-5312-4216-81b9-03198ad21092 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:17.694253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc690a5-c882-4e72-a85f-faa444cba01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:17.695059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc690a5-c882-4e72-a85f-faa444cba01d admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:17.695345 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc690a5-c882-4e72-a85f-faa444cba01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:17.695665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc690a5-c882-4e72-a85f-faa444cba01d admin admin] PATH_INFO: `/v3/projects/8670f68923974047b0090d4b4557d7f5/users/2f6d4db5ff644adab1fc5e61627c2524/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:17.713769 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc690a5-c882-4e72-a85f-faa444cba01d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8670f68923974047b0090d4b4557d7f5, user_id=2f6d4db5ff644adab1fc5e61627c2524, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:17.716516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc690a5-c882-4e72-a85f-faa444cba01d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:17.732919 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1146/2289] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:17 2022] PUT /identity/v3/projects/8670f68923974047b0090d4b4557d7f5/users/2f6d4db5ff644adab1fc5e61627c2524/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:17.744707 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6450ec-eb51-4a8f-bf18-4e723e51894c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:17.745153 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6450ec-eb51-4a8f-bf18-4e723e51894c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:17.745353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6450ec-eb51-4a8f-bf18-4e723e51894c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:17.773600 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-aa6450ec-eb51-4a8f-bf18-4e723e51894c None None] MFA Rules not processed for user `2f6d4db5ff644adab1fc5e61627c2524`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:17.774918 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-aa6450ec-eb51-4a8f-bf18-4e723e51894c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:17.851898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1144/2290] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:17.856819 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc690a5-c882-4e72-a85f-faa444cba01d admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:17.922496 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc690a5-c882-4e72-a85f-faa444cba01d admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:17.927912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b56e6a-d0e5-4b4c-b296-c406533b2063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:17.928556 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b56e6a-d0e5-4b4c-b296-c406533b2063 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:17.928833 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b56e6a-d0e5-4b4c-b296-c406533b2063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:17.929107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b56e6a-d0e5-4b4c-b296-c406533b2063 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:17.929743 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b56e6a-d0e5-4b4c-b296-c406533b2063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:17.931711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b56e6a-d0e5-4b4c-b296-c406533b2063 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:17.963465 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1147/2291] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:17 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:59:17.967653 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6450ec-eb51-4a8f-bf18-4e723e51894c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:17.979639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6450ec-eb51-4a8f-bf18-4e723e51894c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:18.057404 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92d98a-a961-46df-8169-8f8a07c37b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:18.058573 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92d98a-a961-46df-8169-8f8a07c37b60 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:18.058910 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92d98a-a961-46df-8169-8f8a07c37b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:18.059186 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92d98a-a961-46df-8169-8f8a07c37b60 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:18.061227 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92d98a-a961-46df-8169-8f8a07c37b60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:18.067871 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92d98a-a961-46df-8169-8f8a07c37b60 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:18.106654 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1145/2292] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:17 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:18.108490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b56e6a-d0e5-4b4c-b296-c406533b2063 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:18.122794 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b56e6a-d0e5-4b4c-b296-c406533b2063 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:18.129246 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df81668-38f5-4ec5-9f9f-dc5c1582252f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:18.130283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df81668-38f5-4ec5-9f9f-dc5c1582252f admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:18.130527 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df81668-38f5-4ec5-9f9f-dc5c1582252f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:18.130837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df81668-38f5-4ec5-9f9f-dc5c1582252f admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:18.131515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df81668-38f5-4ec5-9f9f-dc5c1582252f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:18.134510 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df81668-38f5-4ec5-9f9f-dc5c1582252f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:18.147882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1148/2293] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:18.151869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92d98a-a961-46df-8169-8f8a07c37b60 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:18.164843 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92d98a-a961-46df-8169-8f8a07c37b60 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:18.170174 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cd8a1-14ab-42ef-95e4-e36b8f51552e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:18.170973 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cd8a1-14ab-42ef-95e4-e36b8f51552e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:18.171145 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cd8a1-14ab-42ef-95e4-e36b8f51552e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:18.171482 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cd8a1-14ab-42ef-95e4-e36b8f51552e admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:18.172245 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cd8a1-14ab-42ef-95e4-e36b8f51552e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:18.178966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cd8a1-14ab-42ef-95e4-e36b8f51552e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:18.181699 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:18.193289 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1146/2294] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:18.197479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df81668-38f5-4ec5-9f9f-dc5c1582252f admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:18.208017 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df81668-38f5-4ec5-9f9f-dc5c1582252f admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:18.212829 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c7587-0335-47d4-af0d-f7996b069dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:18.213545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c7587-0335-47d4-af0d-f7996b069dea admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:18.213771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c7587-0335-47d4-af0d-f7996b069dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:18.214048 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c7587-0335-47d4-af0d-f7996b069dea admin admin] PATH_INFO: `/v3/projects/cd27f953f89b4f14aada31fd7a53a582/users/d58acf0ea5374dbe866c73cae1163533/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:18.229387 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c7587-0335-47d4-af0d-f7996b069dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd27f953f89b4f14aada31fd7a53a582, user_id=d58acf0ea5374dbe866c73cae1163533, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:18.232115 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c7587-0335-47d4-af0d-f7996b069dea admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:18.260919 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1149/2295] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:18 2022] PUT /identity/v3/projects/cd27f953f89b4f14aada31fd7a53a582/users/d58acf0ea5374dbe866c73cae1163533/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:18.262794 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c65595-0ffa-4849-b318-590b62dbe702 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:18.263259 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c65595-0ffa-4849-b318-590b62dbe702 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:18.263697 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c65595-0ffa-4849-b318-590b62dbe702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:18.292919 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-68c65595-0ffa-4849-b318-590b62dbe702 None None] MFA Rules not processed for user `d58acf0ea5374dbe866c73cae1163533`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:18.294154 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-68c65595-0ffa-4849-b318-590b62dbe702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:18.371928 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1147/2296] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:59:18.374708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c7587-0335-47d4-af0d-f7996b069dea admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:18.400631 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:18.457208 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c7587-0335-47d4-af0d-f7996b069dea admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:18.462153 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b16f2-f976-4508-bdd3-622c1a2b1c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:18.462765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b16f2-f976-4508-bdd3-622c1a2b1c05 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:18.463045 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b16f2-f976-4508-bdd3-622c1a2b1c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:18.463314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b16f2-f976-4508-bdd3-622c1a2b1c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:18.464068 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b16f2-f976-4508-bdd3-622c1a2b1c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:18.465940 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b16f2-f976-4508-bdd3-622c1a2b1c05 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:18.498641 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1150/2297] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:18 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:18.503922 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c65595-0ffa-4849-b318-590b62dbe702 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:18.516831 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c65595-0ffa-4849-b318-590b62dbe702 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:18.588124 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d3577-a7c0-457c-af50-02cd96f4691e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:18.588988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d3577-a7c0-457c-af50-02cd96f4691e admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:18.589261 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d3577-a7c0-457c-af50-02cd96f4691e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:18.589541 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d3577-a7c0-457c-af50-02cd96f4691e admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:18.590158 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d3577-a7c0-457c-af50-02cd96f4691e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:18.592104 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d3577-a7c0-457c-af50-02cd96f4691e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:18.620937 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1148/2298] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:18 2022] POST /identity/v3/users => generated 299 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:18.624799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b16f2-f976-4508-bdd3-622c1a2b1c05 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:18.636006 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b16f2-f976-4508-bdd3-622c1a2b1c05 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:18.641070 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d66d0-6f6c-48a6-ad8c-a327873b839e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:18.641993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d66d0-6f6c-48a6-ad8c-a327873b839e admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:18.642450 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d66d0-6f6c-48a6-ad8c-a327873b839e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:18.642794 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d66d0-6f6c-48a6-ad8c-a327873b839e admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:18.643552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d66d0-6f6c-48a6-ad8c-a327873b839e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:18.645423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d66d0-6f6c-48a6-ad8c-a327873b839e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:18.657226 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1151/2299] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:59:18.661925 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d3577-a7c0-457c-af50-02cd96f4691e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:18.678730 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d3577-a7c0-457c-af50-02cd96f4691e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:18.687494 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f884add-aa5b-44f0-95cb-fbd834d8b385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:18.688182 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f884add-aa5b-44f0-95cb-fbd834d8b385 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:18.688460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f884add-aa5b-44f0-95cb-fbd834d8b385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:18.688730 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f884add-aa5b-44f0-95cb-fbd834d8b385 admin admin] PATH_INFO: `/v3/projects/7f839a1b4e064f47acf03c283e84f005/users/7b476cf56b4f42c0bbe67ab7a02cfb5f/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:18.708337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f884add-aa5b-44f0-95cb-fbd834d8b385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f839a1b4e064f47acf03c283e84f005, user_id=7b476cf56b4f42c0bbe67ab7a02cfb5f, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:18.711594 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f884add-aa5b-44f0-95cb-fbd834d8b385 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:18.737125 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1149/2300] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:18 2022] PUT /identity/v3/projects/7f839a1b4e064f47acf03c283e84f005/users/7b476cf56b4f42c0bbe67ab7a02cfb5f/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:18.740558 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d66d0-6f6c-48a6-ad8c-a327873b839e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:18.754220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d66d0-6f6c-48a6-ad8c-a327873b839e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:18.829725 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bea84b-027a-4eb1-afce-0d9129467dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:18.830490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bea84b-027a-4eb1-afce-0d9129467dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:18.830711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bea84b-027a-4eb1-afce-0d9129467dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:18.830871 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bea84b-027a-4eb1-afce-0d9129467dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:18.831547 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bea84b-027a-4eb1-afce-0d9129467dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:18.833471 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bea84b-027a-4eb1-afce-0d9129467dc5 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:18.849167 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1152/2301] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:18.853300 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f884add-aa5b-44f0-95cb-fbd834d8b385 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:18.864534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f884add-aa5b-44f0-95cb-fbd834d8b385 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:18.869450 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558a21b-4e22-47c3-b78d-0babc53600f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:18.870116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558a21b-4e22-47c3-b78d-0babc53600f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:18.870406 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558a21b-4e22-47c3-b78d-0babc53600f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:18.870679 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558a21b-4e22-47c3-b78d-0babc53600f4 admin admin] PATH_INFO: `/v3/projects/7f839a1b4e064f47acf03c283e84f005/users/7b476cf56b4f42c0bbe67ab7a02cfb5f/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:18.872579 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558a21b-4e22-47c3-b78d-0babc53600f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f839a1b4e064f47acf03c283e84f005, user_id=7b476cf56b4f42c0bbe67ab7a02cfb5f, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:18.875459 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558a21b-4e22-47c3-b78d-0babc53600f4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:18.891068 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1150/2302] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:18 2022] PUT /identity/v3/projects/7f839a1b4e064f47acf03c283e84f005/users/7b476cf56b4f42c0bbe67ab7a02cfb5f/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:18.899829 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c922c1-6f1f-434d-b5c7-a6d75192f7e2 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:18.900117 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c922c1-6f1f-434d-b5c7-a6d75192f7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:18.900394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c922c1-6f1f-434d-b5c7-a6d75192f7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:18.929869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-55c922c1-6f1f-434d-b5c7-a6d75192f7e2 None None] MFA Rules not processed for user `7b476cf56b4f42c0bbe67ab7a02cfb5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:18.931030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-55c922c1-6f1f-434d-b5c7-a6d75192f7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:19.001581 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1153/2303] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:59:19.012818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558a21b-4e22-47c3-b78d-0babc53600f4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:19.014686 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8558a21b-4e22-47c3-b78d-0babc53600f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:19.066493 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:19.084074 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558a21b-4e22-47c3-b78d-0babc53600f4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:19.088144 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd19ff-af3c-4b1b-9814-8221f8d12df0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:19.088763 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd19ff-af3c-4b1b-9814-8221f8d12df0 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:19.089070 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd19ff-af3c-4b1b-9814-8221f8d12df0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:19.089313 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd19ff-af3c-4b1b-9814-8221f8d12df0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:19.158108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd19ff-af3c-4b1b-9814-8221f8d12df0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:19.159626 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd19ff-af3c-4b1b-9814-8221f8d12df0 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:19.179319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1151/2304] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:20.732654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c922c1-6f1f-434d-b5c7-a6d75192f7e2 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:20.743502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c922c1-6f1f-434d-b5c7-a6d75192f7e2 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:20.747582 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa9f20-ebd8-46a1-b7e1-41f51d0e2529 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:20.748193 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa9f20-ebd8-46a1-b7e1-41f51d0e2529 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:20.748476 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa9f20-ebd8-46a1-b7e1-41f51d0e2529 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:20.748752 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa9f20-ebd8-46a1-b7e1-41f51d0e2529 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:20.762257 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:20.811780 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa9f20-ebd8-46a1-b7e1-41f51d0e2529 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:20.813094 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa9f20-ebd8-46a1-b7e1-41f51d0e2529 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:20.822877 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1154/2305] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:21.505839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd19ff-af3c-4b1b-9814-8221f8d12df0 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:21.515118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd19ff-af3c-4b1b-9814-8221f8d12df0 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:21.519349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda9cef-2d3a-4053-b4cd-779ba60353fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:21.520021 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda9cef-2d3a-4053-b4cd-779ba60353fc service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:21.520290 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda9cef-2d3a-4053-b4cd-779ba60353fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:21.520563 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda9cef-2d3a-4053-b4cd-779ba60353fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:21.530819 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda9cef-2d3a-4053-b4cd-779ba60353fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:21.532309 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda9cef-2d3a-4053-b4cd-779ba60353fc service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:21.542131 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1152/2306] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:25.525039 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa9f20-ebd8-46a1-b7e1-41f51d0e2529 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:25.599677 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa9f20-ebd8-46a1-b7e1-41f51d0e2529 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:25.605540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ba8e7-de45-4025-ab8a-445c61510411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:25.606219 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ba8e7-de45-4025-ab8a-445c61510411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:25.606493 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ba8e7-de45-4025-ab8a-445c61510411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:25.606758 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ba8e7-de45-4025-ab8a-445c61510411 admin admin] PATH_INFO: `/v3/users/2f6d4db5ff644adab1fc5e61627c2524` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:25.608019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ba8e7-de45-4025-ab8a-445c61510411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f6d4db5ff644adab1fc5e61627c2524)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:25.609997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ba8e7-de45-4025-ab8a-445c61510411 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:25.661176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e78ba8e7-de45-4025-ab8a-445c61510411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f6d4db5ff644adab1fc5e61627c2524'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:25.668524 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e78ba8e7-de45-4025-ab8a-445c61510411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f6d4db5ff644adab1fc5e61627c2524'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:25.679552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e78ba8e7-de45-4025-ab8a-445c61510411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f6d4db5ff644adab1fc5e61627c2524'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:25.680205 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e78ba8e7-de45-4025-ab8a-445c61510411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f6d4db5ff644adab1fc5e61627c2524'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:25.693007 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-e78ba8e7-de45-4025-ab8a-445c61510411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f6d4db5ff644adab1fc5e61627c2524'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:25.705799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1155/2307] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:25 2022] DELETE /identity/v3/users/2f6d4db5ff644adab1fc5e61627c2524 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:25.711132 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471452a-647e-4198-a364-e16630644ac1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:25.711705 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471452a-647e-4198-a364-e16630644ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:25.711810 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471452a-647e-4198-a364-e16630644ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:25.731544 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1471452a-647e-4198-a364-e16630644ac1 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:25.732741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1471452a-647e-4198-a364-e16630644ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:25.801898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1153/2308] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:25.812313 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ba8e7-de45-4025-ab8a-445c61510411 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:25.813911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e78ba8e7-de45-4025-ab8a-445c61510411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:25.857658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:25.887779 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ba8e7-de45-4025-ab8a-445c61510411 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:25.891691 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65938975-4f20-4498-a0d8-7c00137cca67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:25.892314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65938975-4f20-4498-a0d8-7c00137cca67 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:25.892591 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65938975-4f20-4498-a0d8-7c00137cca67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:25.892865 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65938975-4f20-4498-a0d8-7c00137cca67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:25.903214 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65938975-4f20-4498-a0d8-7c00137cca67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:25.904694 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65938975-4f20-4498-a0d8-7c00137cca67 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:25.914997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1156/2309] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:26.228035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471452a-647e-4198-a364-e16630644ac1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:26.228035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1471452a-647e-4198-a364-e16630644ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:26.238153 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471452a-647e-4198-a364-e16630644ac1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:26.243809 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a7504-7029-48db-94ab-6ae99914bb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:26.244530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a7504-7029-48db-94ab-6ae99914bb59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:26.245078 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a7504-7029-48db-94ab-6ae99914bb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:26.245078 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a7504-7029-48db-94ab-6ae99914bb59 admin admin] PATH_INFO: `/v3/projects/8670f68923974047b0090d4b4557d7f5` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:26.246205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a7504-7029-48db-94ab-6ae99914bb59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8670f68923974047b0090d4b4557d7f5)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:26.248154 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a7504-7029-48db-94ab-6ae99914bb59 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:26.302415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d09a7504-7029-48db-94ab-6ae99914bb59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8670f68923974047b0090d4b4557d7f5', 'request_id': 'req-d09a7504-7029-48db-94ab-6ae99914bb59'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:26.311774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d09a7504-7029-48db-94ab-6ae99914bb59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8670f68923974047b0090d4b4557d7f5', 'request_id': 'req-d09a7504-7029-48db-94ab-6ae99914bb59'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:26.317642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d09a7504-7029-48db-94ab-6ae99914bb59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8670f68923974047b0090d4b4557d7f5', 'request_id': 'req-d09a7504-7029-48db-94ab-6ae99914bb59'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:26.329492 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d09a7504-7029-48db-94ab-6ae99914bb59 admin admin] The token cache is being invalidate because project 8670f68923974047b0090d4b4557d7f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:26.329797 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d09a7504-7029-48db-94ab-6ae99914bb59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:26.330530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d09a7504-7029-48db-94ab-6ae99914bb59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:26.332320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1154/2310] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:26 2022] DELETE /identity/v3/projects/8670f68923974047b0090d4b4557d7f5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:26.336690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65938975-4f20-4498-a0d8-7c00137cca67 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:26.348611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65938975-4f20-4498-a0d8-7c00137cca67 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:26.418254 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b6bc5-999b-46ce-a548-4db8d54acc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:26.419054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b6bc5-999b-46ce-a548-4db8d54acc8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:26.426117 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b6bc5-999b-46ce-a548-4db8d54acc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:26.426117 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b6bc5-999b-46ce-a548-4db8d54acc8a admin admin] PATH_INFO: `/v3/users/d58acf0ea5374dbe866c73cae1163533` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:26.427922 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b6bc5-999b-46ce-a548-4db8d54acc8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d58acf0ea5374dbe866c73cae1163533)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:26.429949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b6bc5-999b-46ce-a548-4db8d54acc8a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:26.496812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7e6b6bc5-999b-46ce-a548-4db8d54acc8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd58acf0ea5374dbe866c73cae1163533'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:26.503862 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7e6b6bc5-999b-46ce-a548-4db8d54acc8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd58acf0ea5374dbe866c73cae1163533'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:26.512328 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7e6b6bc5-999b-46ce-a548-4db8d54acc8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd58acf0ea5374dbe866c73cae1163533'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:26.512989 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7e6b6bc5-999b-46ce-a548-4db8d54acc8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd58acf0ea5374dbe866c73cae1163533'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:26.526263 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7e6b6bc5-999b-46ce-a548-4db8d54acc8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd58acf0ea5374dbe866c73cae1163533'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:26.532882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1157/2311] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:26 2022] DELETE /identity/v3/users/d58acf0ea5374dbe866c73cae1163533 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:26.821560 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a7504-7029-48db-94ab-6ae99914bb59 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:26.823455 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d09a7504-7029-48db-94ab-6ae99914bb59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:26.836002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:26.850299 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a7504-7029-48db-94ab-6ae99914bb59 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:26.918190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e3aef-f4d6-4a79-acd8-5aaab3cad81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:26.918931 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e3aef-f4d6-4a79-acd8-5aaab3cad81c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:26.919209 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e3aef-f4d6-4a79-acd8-5aaab3cad81c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:26.919528 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e3aef-f4d6-4a79-acd8-5aaab3cad81c admin admin] PATH_INFO: `/v3/projects/cd27f953f89b4f14aada31fd7a53a582` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:26.920648 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e3aef-f4d6-4a79-acd8-5aaab3cad81c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd27f953f89b4f14aada31fd7a53a582)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:26.922553 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e3aef-f4d6-4a79-acd8-5aaab3cad81c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:26.974085 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ae7e3aef-f4d6-4a79-acd8-5aaab3cad81c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd27f953f89b4f14aada31fd7a53a582', 'request_id': 'req-ae7e3aef-f4d6-4a79-acd8-5aaab3cad81c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:26.982679 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ae7e3aef-f4d6-4a79-acd8-5aaab3cad81c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd27f953f89b4f14aada31fd7a53a582', 'request_id': 'req-ae7e3aef-f4d6-4a79-acd8-5aaab3cad81c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:26.988355 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ae7e3aef-f4d6-4a79-acd8-5aaab3cad81c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd27f953f89b4f14aada31fd7a53a582', 'request_id': 'req-ae7e3aef-f4d6-4a79-acd8-5aaab3cad81c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:26.999521 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ae7e3aef-f4d6-4a79-acd8-5aaab3cad81c admin admin] The token cache is being invalidate because project cd27f953f89b4f14aada31fd7a53a582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:26.999809 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ae7e3aef-f4d6-4a79-acd8-5aaab3cad81c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:27.000477 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ae7e3aef-f4d6-4a79-acd8-5aaab3cad81c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:27.002026 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1155/2312] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:26 2022] DELETE /identity/v3/projects/cd27f953f89b4f14aada31fd7a53a582 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:27.006434 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b6bc5-999b-46ce-a548-4db8d54acc8a admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:27.007914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7e6b6bc5-999b-46ce-a548-4db8d54acc8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:27.021776 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b6bc5-999b-46ce-a548-4db8d54acc8a admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:27.075153 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:27.082896 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e768fa-17f3-429d-84ec-e6bab1ec668b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:27.083985 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e768fa-17f3-429d-84ec-e6bab1ec668b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:27.084331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e768fa-17f3-429d-84ec-e6bab1ec668b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:27.085040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e768fa-17f3-429d-84ec-e6bab1ec668b admin admin] PATH_INFO: `/v3/users/7b476cf56b4f42c0bbe67ab7a02cfb5f` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:27.086199 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e768fa-17f3-429d-84ec-e6bab1ec668b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b476cf56b4f42c0bbe67ab7a02cfb5f)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:27.088628 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e768fa-17f3-429d-84ec-e6bab1ec668b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:27.141890 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-82e768fa-17f3-429d-84ec-e6bab1ec668b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b476cf56b4f42c0bbe67ab7a02cfb5f'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:27.149350 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-82e768fa-17f3-429d-84ec-e6bab1ec668b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b476cf56b4f42c0bbe67ab7a02cfb5f'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:27.158005 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-82e768fa-17f3-429d-84ec-e6bab1ec668b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b476cf56b4f42c0bbe67ab7a02cfb5f'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:27.158654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-82e768fa-17f3-429d-84ec-e6bab1ec668b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b476cf56b4f42c0bbe67ab7a02cfb5f'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:27.191208 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-82e768fa-17f3-429d-84ec-e6bab1ec668b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b476cf56b4f42c0bbe67ab7a02cfb5f'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:27.198087 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1158/2313] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:27 2022] DELETE /identity/v3/users/7b476cf56b4f42c0bbe67ab7a02cfb5f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:27.509706 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e3aef-f4d6-4a79-acd8-5aaab3cad81c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:27.511337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ae7e3aef-f4d6-4a79-acd8-5aaab3cad81c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:27.529457 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e3aef-f4d6-4a79-acd8-5aaab3cad81c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:27.595382 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65488731-15c2-4bf3-a413-35598395c0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:27.596058 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65488731-15c2-4bf3-a413-35598395c0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:27.596360 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65488731-15c2-4bf3-a413-35598395c0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:27.596629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65488731-15c2-4bf3-a413-35598395c0c1 admin admin] PATH_INFO: `/v3/projects/7f839a1b4e064f47acf03c283e84f005` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:27.598468 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65488731-15c2-4bf3-a413-35598395c0c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f839a1b4e064f47acf03c283e84f005)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:27.601560 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65488731-15c2-4bf3-a413-35598395c0c1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:27.668554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:27.680250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-65488731-15c2-4bf3-a413-35598395c0c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f839a1b4e064f47acf03c283e84f005', 'request_id': 'req-65488731-15c2-4bf3-a413-35598395c0c1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:27.688853 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-65488731-15c2-4bf3-a413-35598395c0c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f839a1b4e064f47acf03c283e84f005', 'request_id': 'req-65488731-15c2-4bf3-a413-35598395c0c1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:27.696212 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-65488731-15c2-4bf3-a413-35598395c0c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f839a1b4e064f47acf03c283e84f005', 'request_id': 'req-65488731-15c2-4bf3-a413-35598395c0c1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:27.708338 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-65488731-15c2-4bf3-a413-35598395c0c1 admin admin] The token cache is being invalidate because project 7f839a1b4e064f47acf03c283e84f005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:27.708637 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-65488731-15c2-4bf3-a413-35598395c0c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:27.709365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-65488731-15c2-4bf3-a413-35598395c0c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:27.710997 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1156/2314] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:27 2022] DELETE /identity/v3/projects/7f839a1b4e064f47acf03c283e84f005 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:27.715966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274153eb-4e5b-4d17-af9c-b3af0ffa0e56 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:27.716436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274153eb-4e5b-4d17-af9c-b3af0ffa0e56 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:27.716523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274153eb-4e5b-4d17-af9c-b3af0ffa0e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:27.737714 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-274153eb-4e5b-4d17-af9c-b3af0ffa0e56 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:27.738981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-274153eb-4e5b-4d17-af9c-b3af0ffa0e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:27.808192 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1159/2315] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:27.819311 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dd704-2006-4630-acc5-ea3350006d66 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:27.819656 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dd704-2006-4630-acc5-ea3350006d66 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:27.819934 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dd704-2006-4630-acc5-ea3350006d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:27.840220 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ba3dd704-2006-4630-acc5-ea3350006d66 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:27.841441 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ba3dd704-2006-4630-acc5-ea3350006d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:27.850103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1157/2316] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:27.854717 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274153eb-4e5b-4d17-af9c-b3af0ffa0e56 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:27.864830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274153eb-4e5b-4d17-af9c-b3af0ffa0e56 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:27.869338 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa24a1-49c1-4399-a71c-7095b9c4993c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:27.869939 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa24a1-49c1-4399-a71c-7095b9c4993c admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:27.870221 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa24a1-49c1-4399-a71c-7095b9c4993c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:27.870486 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa24a1-49c1-4399-a71c-7095b9c4993c admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:27.871156 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa24a1-49c1-4399-a71c-7095b9c4993c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:59:27.871489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa24a1-49c1-4399-a71c-7095b9c4993c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:27.873088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa24a1-49c1-4399-a71c-7095b9c4993c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:27.884856 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1160/2317] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:59:27.889224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dd704-2006-4630-acc5-ea3350006d66 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:27.898636 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dd704-2006-4630-acc5-ea3350006d66 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:27.903901 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe48fb-f3f4-4370-bcdb-952858cad0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:27.904493 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe48fb-f3f4-4370-bcdb-952858cad0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:27.904798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe48fb-f3f4-4370-bcdb-952858cad0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:27.905063 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe48fb-f3f4-4370-bcdb-952858cad0d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:27.905696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe48fb-f3f4-4370-bcdb-952858cad0d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:27.907632 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe48fb-f3f4-4370-bcdb-952858cad0d8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:27.937221 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1158/2318] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:27 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:59:27.941650 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa24a1-49c1-4399-a71c-7095b9c4993c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:27.951776 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa24a1-49c1-4399-a71c-7095b9c4993c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:28.012382 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc9f72-b6ed-4b39-acc2-f2c1fd7a5915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:28.012999 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc9f72-b6ed-4b39-acc2-f2c1fd7a5915 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:28.013279 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc9f72-b6ed-4b39-acc2-f2c1fd7a5915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:28.013554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc9f72-b6ed-4b39-acc2-f2c1fd7a5915 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:28.014179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc9f72-b6ed-4b39-acc2-f2c1fd7a5915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:28.016331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc9f72-b6ed-4b39-acc2-f2c1fd7a5915 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:28.025700 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:28.040791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1161/2319] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:27 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:28.045392 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe48fb-f3f4-4370-bcdb-952858cad0d8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:28.056215 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe48fb-f3f4-4370-bcdb-952858cad0d8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:28.061326 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc94944-4a50-4682-b36e-656c8317845f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:28.061929 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc94944-4a50-4682-b36e-656c8317845f admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:28.062204 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc94944-4a50-4682-b36e-656c8317845f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:28.062472 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc94944-4a50-4682-b36e-656c8317845f admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:28.063109 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc94944-4a50-4682-b36e-656c8317845f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:28.064758 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc94944-4a50-4682-b36e-656c8317845f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:28.075210 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1159/2320] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:28.079251 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc9f72-b6ed-4b39-acc2-f2c1fd7a5915 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:28.089659 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc9f72-b6ed-4b39-acc2-f2c1fd7a5915 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:28.094799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908b63f-e960-4f4d-9676-bd843a63e551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:28.095444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908b63f-e960-4f4d-9676-bd843a63e551 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:28.095719 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908b63f-e960-4f4d-9676-bd843a63e551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:28.095977 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908b63f-e960-4f4d-9676-bd843a63e551 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:28.096619 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908b63f-e960-4f4d-9676-bd843a63e551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:28.098512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908b63f-e960-4f4d-9676-bd843a63e551 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:28.110754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1162/2321] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:59:28.115187 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc94944-4a50-4682-b36e-656c8317845f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:28.125952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc94944-4a50-4682-b36e-656c8317845f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:28.131770 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c43d4e-3753-48e9-a686-e43650a4e2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:28.132410 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c43d4e-3753-48e9-a686-e43650a4e2c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:28.132684 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c43d4e-3753-48e9-a686-e43650a4e2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:28.132951 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c43d4e-3753-48e9-a686-e43650a4e2c0 admin admin] PATH_INFO: `/v3/projects/12d28772f08044e289747b782de23b25/users/cc64506c0e724221b1777a05a6a715c6/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:28.148073 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c43d4e-3753-48e9-a686-e43650a4e2c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d28772f08044e289747b782de23b25, user_id=cc64506c0e724221b1777a05a6a715c6, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:28.150731 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c43d4e-3753-48e9-a686-e43650a4e2c0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:28.166350 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1160/2322] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:28 2022] PUT /identity/v3/projects/12d28772f08044e289747b782de23b25/users/cc64506c0e724221b1777a05a6a715c6/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:28.172189 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151413b3-d21f-4888-90ee-e6d051e5e3cc None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:28.172607 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151413b3-d21f-4888-90ee-e6d051e5e3cc None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:28.172891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151413b3-d21f-4888-90ee-e6d051e5e3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:28.193417 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-151413b3-d21f-4888-90ee-e6d051e5e3cc None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:28.194662 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-151413b3-d21f-4888-90ee-e6d051e5e3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:28.265009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1163/2323] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:28.277498 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c43d4e-3753-48e9-a686-e43650a4e2c0 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:28.280207 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-33c43d4e-3753-48e9-a686-e43650a4e2c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:28.376837 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c43d4e-3753-48e9-a686-e43650a4e2c0 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:28.380956 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e2e72-8d22-4eb4-93c4-90b59ab0e9c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:28.381527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e2e72-8d22-4eb4-93c4-90b59ab0e9c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:28.381769 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e2e72-8d22-4eb4-93c4-90b59ab0e9c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:28.382039 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e2e72-8d22-4eb4-93c4-90b59ab0e9c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:28.391497 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e2e72-8d22-4eb4-93c4-90b59ab0e9c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:28.393005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e2e72-8d22-4eb4-93c4-90b59ab0e9c8 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:28.402747 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1161/2324] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 11:59:29.060659 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004f91d-171d-49f1-8c3b-29295d9399dc None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:29.061679 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004f91d-171d-49f1-8c3b-29295d9399dc None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:29.062014 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004f91d-171d-49f1-8c3b-29295d9399dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:29.091755 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-5004f91d-171d-49f1-8c3b-29295d9399dc None None] MFA Rules not processed for user `cc64506c0e724221b1777a05a6a715c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:29.093308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5004f91d-171d-49f1-8c3b-29295d9399dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:29.189245 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1164/2325] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:29.200999 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e2e72-8d22-4eb4-93c4-90b59ab0e9c8 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:29.202525 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b12e2e72-8d22-4eb4-93c4-90b59ab0e9c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:29.261870 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e2e72-8d22-4eb4-93c4-90b59ab0e9c8 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:29.265854 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a26de5-327e-42c6-9e8b-3a0388e73b02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:29.266489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a26de5-327e-42c6-9e8b-3a0388e73b02 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:29.266762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a26de5-327e-42c6-9e8b-3a0388e73b02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:29.267029 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a26de5-327e-42c6-9e8b-3a0388e73b02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:29.277971 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a26de5-327e-42c6-9e8b-3a0388e73b02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:29.279484 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a26de5-327e-42c6-9e8b-3a0388e73b02 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:29.289361 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1162/2326] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:30.741646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce251da3-929a-4d00-a6e6-6dd17075f8d0 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:30.742238 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce251da3-929a-4d00-a6e6-6dd17075f8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:30.742238 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce251da3-929a-4d00-a6e6-6dd17075f8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:30.762991 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-ce251da3-929a-4d00-a6e6-6dd17075f8d0 None None] MFA Rules not processed for user `cc64506c0e724221b1777a05a6a715c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:30.763920 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ce251da3-929a-4d00-a6e6-6dd17075f8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:30.771258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1165/2327] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:37.767695 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47364c8e-ae30-4b68-a381-50754f8aa939 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:37.767695 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47364c8e-ae30-4b68-a381-50754f8aa939 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:37.768254 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47364c8e-ae30-4b68-a381-50754f8aa939 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:37.769367 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1163/2328] 10.222.0.27 () {54 vars in 921 bytes} [Tue Aug 30 11:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 11:59:37.778610 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7aecd3-ab77-4f02-a912-06263aa0ef64 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:37.779150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7aecd3-ab77-4f02-a912-06263aa0ef64 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:37.779150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7aecd3-ab77-4f02-a912-06263aa0ef64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:37.798876 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-4a7aecd3-ab77-4f02-a912-06263aa0ef64 None None] MFA Rules not processed for user `9efd2ac7fc4a42558e8dc48c408ce525`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:37.800112 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4a7aecd3-ab77-4f02-a912-06263aa0ef64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:37.880848 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:37.897974 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47364c8e-ae30-4b68-a381-50754f8aa939 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:37.902323 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1166/2329] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Aug 30 11:59:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:37.903462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-47364c8e-ae30-4b68-a381-50754f8aa939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:37.916580 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7aecd3-ab77-4f02-a912-06263aa0ef64 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:37.918417 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4a7aecd3-ab77-4f02-a912-06263aa0ef64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:37.922241 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47364c8e-ae30-4b68-a381-50754f8aa939 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:37.927081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ca47d-204d-4cd0-ba0e-3aeade7be46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:37.927875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ca47d-204d-4cd0-ba0e-3aeade7be46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:37.928250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ca47d-204d-4cd0-ba0e-3aeade7be46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:37.928621 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ca47d-204d-4cd0-ba0e-3aeade7be46c admin admin] PATH_INFO: `/v3/users/68f27885290a4b4184fc601314455f84` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:37.929880 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ca47d-204d-4cd0-ba0e-3aeade7be46c admin admin] RBAC: Authorizing `identity:delete_user(user_id=68f27885290a4b4184fc601314455f84)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:37.932143 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ca47d-204d-4cd0-ba0e-3aeade7be46c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:37.934534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:37.938069 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7aecd3-ab77-4f02-a912-06263aa0ef64 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:37.948229 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79883430-fd22-4b95-950f-da2a66c036e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9efd2ac7fc4a42558e8dc48c408ce525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:37.948867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79883430-fd22-4b95-950f-da2a66c036e3 service placement] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:37.949192 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79883430-fd22-4b95-950f-da2a66c036e3 service placement] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:37.949468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79883430-fd22-4b95-950f-da2a66c036e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:37.958764 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79883430-fd22-4b95-950f-da2a66c036e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:37.960412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79883430-fd22-4b95-950f-da2a66c036e3 service placement] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:37.975060 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1167/2330] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:38.020086 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d58ca47d-204d-4cd0-ba0e-3aeade7be46c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68f27885290a4b4184fc601314455f84'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:38.030233 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d58ca47d-204d-4cd0-ba0e-3aeade7be46c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68f27885290a4b4184fc601314455f84'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:38.040956 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d58ca47d-204d-4cd0-ba0e-3aeade7be46c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68f27885290a4b4184fc601314455f84'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:38.055641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d58ca47d-204d-4cd0-ba0e-3aeade7be46c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68f27885290a4b4184fc601314455f84'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:38.056631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d58ca47d-204d-4cd0-ba0e-3aeade7be46c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68f27885290a4b4184fc601314455f84'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:38.063632 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1164/2331] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:37 2022] DELETE /identity/v3/users/68f27885290a4b4184fc601314455f84 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:38.284391 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79883430-fd22-4b95-950f-da2a66c036e3 service placement] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:38.296705 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79883430-fd22-4b95-950f-da2a66c036e3 service placement] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:38.372624 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb71a8-b4de-4701-8c00-c35e94f1eacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:38.373272 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb71a8-b4de-4701-8c00-c35e94f1eacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:38.375764 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb71a8-b4de-4701-8c00-c35e94f1eacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:38.375764 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb71a8-b4de-4701-8c00-c35e94f1eacb admin admin] PATH_INFO: `/v3/projects/7a7ddef4a77a480db1c4ecf5e1ad16bc` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:38.375764 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb71a8-b4de-4701-8c00-c35e94f1eacb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a7ddef4a77a480db1c4ecf5e1ad16bc)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:38.377795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb71a8-b4de-4701-8c00-c35e94f1eacb admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:38.433436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a3eb71a8-b4de-4701-8c00-c35e94f1eacb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a7ddef4a77a480db1c4ecf5e1ad16bc', 'request_id': 'req-a3eb71a8-b4de-4701-8c00-c35e94f1eacb'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:38.440238 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a3eb71a8-b4de-4701-8c00-c35e94f1eacb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a7ddef4a77a480db1c4ecf5e1ad16bc', 'request_id': 'req-a3eb71a8-b4de-4701-8c00-c35e94f1eacb'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:38.446675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a3eb71a8-b4de-4701-8c00-c35e94f1eacb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a7ddef4a77a480db1c4ecf5e1ad16bc', 'request_id': 'req-a3eb71a8-b4de-4701-8c00-c35e94f1eacb'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:38.460027 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a3eb71a8-b4de-4701-8c00-c35e94f1eacb admin admin] The token cache is being invalidate because project 7a7ddef4a77a480db1c4ecf5e1ad16bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:38.460313 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a3eb71a8-b4de-4701-8c00-c35e94f1eacb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:38.464069 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a3eb71a8-b4de-4701-8c00-c35e94f1eacb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:38.465967 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1168/2332] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:38 2022] DELETE /identity/v3/projects/7a7ddef4a77a480db1c4ecf5e1ad16bc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:38.469817 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ca47d-204d-4cd0-ba0e-3aeade7be46c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:38.471309 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d58ca47d-204d-4cd0-ba0e-3aeade7be46c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:38.484660 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ca47d-204d-4cd0-ba0e-3aeade7be46c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:38.545323 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e7a02-4bb0-4572-b3a9-000a27e19296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:38.545970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e7a02-4bb0-4572-b3a9-000a27e19296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:38.546420 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e7a02-4bb0-4572-b3a9-000a27e19296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:38.546687 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e7a02-4bb0-4572-b3a9-000a27e19296 admin admin] PATH_INFO: `/v3/users/690052887c3c44e3aab2eb1b839ec5f1` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:38.547954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e7a02-4bb0-4572-b3a9-000a27e19296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=690052887c3c44e3aab2eb1b839ec5f1)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:38.549923 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e7a02-4bb0-4572-b3a9-000a27e19296 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:38.601266 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5c7e7a02-4bb0-4572-b3a9-000a27e19296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '690052887c3c44e3aab2eb1b839ec5f1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:38.610016 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5c7e7a02-4bb0-4572-b3a9-000a27e19296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '690052887c3c44e3aab2eb1b839ec5f1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:38.618355 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5c7e7a02-4bb0-4572-b3a9-000a27e19296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '690052887c3c44e3aab2eb1b839ec5f1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:38.631812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5c7e7a02-4bb0-4572-b3a9-000a27e19296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '690052887c3c44e3aab2eb1b839ec5f1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:38.632705 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5c7e7a02-4bb0-4572-b3a9-000a27e19296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '690052887c3c44e3aab2eb1b839ec5f1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:38.634509 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:38.644165 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1165/2333] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:38 2022] DELETE /identity/v3/users/690052887c3c44e3aab2eb1b839ec5f1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:38.839234 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb71a8-b4de-4701-8c00-c35e94f1eacb admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:38.841901 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a3eb71a8-b4de-4701-8c00-c35e94f1eacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:38.868140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb71a8-b4de-4701-8c00-c35e94f1eacb admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:38.946239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80778c4b-919d-4b58-ab38-204a7b0e0e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:38.946893 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80778c4b-919d-4b58-ab38-204a7b0e0e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:38.947166 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80778c4b-919d-4b58-ab38-204a7b0e0e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:38.947641 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80778c4b-919d-4b58-ab38-204a7b0e0e51 admin admin] PATH_INFO: `/v3/projects/414936f6387b4836ba1dbcd96b6dbe3d` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:38.948785 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80778c4b-919d-4b58-ab38-204a7b0e0e51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=414936f6387b4836ba1dbcd96b6dbe3d)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:38.950717 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80778c4b-919d-4b58-ab38-204a7b0e0e51 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:38.978813 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:39.018302 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-80778c4b-919d-4b58-ab38-204a7b0e0e51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '414936f6387b4836ba1dbcd96b6dbe3d', 'request_id': 'req-80778c4b-919d-4b58-ab38-204a7b0e0e51'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:39.026369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-80778c4b-919d-4b58-ab38-204a7b0e0e51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '414936f6387b4836ba1dbcd96b6dbe3d', 'request_id': 'req-80778c4b-919d-4b58-ab38-204a7b0e0e51'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:39.033079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-80778c4b-919d-4b58-ab38-204a7b0e0e51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '414936f6387b4836ba1dbcd96b6dbe3d', 'request_id': 'req-80778c4b-919d-4b58-ab38-204a7b0e0e51'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:39.047058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-80778c4b-919d-4b58-ab38-204a7b0e0e51 admin admin] The token cache is being invalidate because project 414936f6387b4836ba1dbcd96b6dbe3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:39.047332 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-80778c4b-919d-4b58-ab38-204a7b0e0e51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:39.048150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-80778c4b-919d-4b58-ab38-204a7b0e0e51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:39.049672 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1169/2334] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:38 2022] DELETE /identity/v3/projects/414936f6387b4836ba1dbcd96b6dbe3d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:39.055110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34faad1c-2cb2-4076-9590-caa25d7ebc55 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:39.055908 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34faad1c-2cb2-4076-9590-caa25d7ebc55 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:39.056278 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34faad1c-2cb2-4076-9590-caa25d7ebc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:39.084734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-34faad1c-2cb2-4076-9590-caa25d7ebc55 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:39.086969 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-34faad1c-2cb2-4076-9590-caa25d7ebc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:39.181989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1166/2335] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:39.192674 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042c285-7e7b-4ea5-938d-b9939df5cbb1 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:39.193338 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042c285-7e7b-4ea5-938d-b9939df5cbb1 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:39.193630 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042c285-7e7b-4ea5-938d-b9939df5cbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:39.217355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-9042c285-7e7b-4ea5-938d-b9939df5cbb1 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:39.218938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9042c285-7e7b-4ea5-938d-b9939df5cbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:39.227531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1170/2336] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:59:39.231915 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34faad1c-2cb2-4076-9590-caa25d7ebc55 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:39.242701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34faad1c-2cb2-4076-9590-caa25d7ebc55 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:39.248337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b17a8-b924-4c85-ae4f-e6ce80401825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:39.248961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b17a8-b924-4c85-ae4f-e6ce80401825 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:39.249237 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b17a8-b924-4c85-ae4f-e6ce80401825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:39.249503 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b17a8-b924-4c85-ae4f-e6ce80401825 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:39.250204 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b17a8-b924-4c85-ae4f-e6ce80401825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:59:39.251788 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b17a8-b924-4c85-ae4f-e6ce80401825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:39.253450 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b17a8-b924-4c85-ae4f-e6ce80401825 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:39.269758 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1167/2337] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:59:39.274904 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042c285-7e7b-4ea5-938d-b9939df5cbb1 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:39.285375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042c285-7e7b-4ea5-938d-b9939df5cbb1 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:39.292120 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d304231-f56e-4166-86c9-d8c2f37cdf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:39.292896 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d304231-f56e-4166-86c9-d8c2f37cdf49 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:39.293267 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d304231-f56e-4166-86c9-d8c2f37cdf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:39.293632 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d304231-f56e-4166-86c9-d8c2f37cdf49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:39.294360 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d304231-f56e-4166-86c9-d8c2f37cdf49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:39.296462 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d304231-f56e-4166-86c9-d8c2f37cdf49 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:39.335783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1171/2338] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:39 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:39.337138 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b17a8-b924-4c85-ae4f-e6ce80401825 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:39.348720 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b17a8-b924-4c85-ae4f-e6ce80401825 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:39.388790 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d304231-f56e-4166-86c9-d8c2f37cdf49 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:39.390518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2d304231-f56e-4166-86c9-d8c2f37cdf49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:39.448980 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33de1f7-4ca6-4fa3-9719-9a9886adee78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:39.449473 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33de1f7-4ca6-4fa3-9719-9a9886adee78 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:39.449813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33de1f7-4ca6-4fa3-9719-9a9886adee78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:39.450146 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33de1f7-4ca6-4fa3-9719-9a9886adee78 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:39.451009 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33de1f7-4ca6-4fa3-9719-9a9886adee78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:39.454348 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33de1f7-4ca6-4fa3-9719-9a9886adee78 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:39.493089 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1168/2339] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:39 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:59:39.497306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33de1f7-4ca6-4fa3-9719-9a9886adee78 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:39.512489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33de1f7-4ca6-4fa3-9719-9a9886adee78 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:39.512750 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d304231-f56e-4166-86c9-d8c2f37cdf49 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:39.518160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1bd7a6-6adb-4308-b0aa-6ed70cd55dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:39.518402 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e62c3-e4e2-4ac0-941c-58f66e404a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:39.518951 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bd7a6-6adb-4308-b0aa-6ed70cd55dbd admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:39.519079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e62c3-e4e2-4ac0-941c-58f66e404a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:39.519349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bd7a6-6adb-4308-b0aa-6ed70cd55dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:39.519495 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e62c3-e4e2-4ac0-941c-58f66e404a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:39.519799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e62c3-e4e2-4ac0-941c-58f66e404a38 admin admin] PATH_INFO: `/v3/users/63cb366e9cab4f448ba2095d24b18d37` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:39.519920 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bd7a6-6adb-4308-b0aa-6ed70cd55dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:39.522516 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1bd7a6-6adb-4308-b0aa-6ed70cd55dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:39.524482 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1bd7a6-6adb-4308-b0aa-6ed70cd55dbd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:39.524606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e62c3-e4e2-4ac0-941c-58f66e404a38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63cb366e9cab4f448ba2095d24b18d37)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:39.527714 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e62c3-e4e2-4ac0-941c-58f66e404a38 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:39.550870 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1169/2340] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:59:39.556630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1bd7a6-6adb-4308-b0aa-6ed70cd55dbd admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:39.572643 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1bd7a6-6adb-4308-b0aa-6ed70cd55dbd admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:39.578438 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed43d0d-8898-4322-b6fa-0bbb32903087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:39.579248 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed43d0d-8898-4322-b6fa-0bbb32903087 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:39.579681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed43d0d-8898-4322-b6fa-0bbb32903087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:39.580138 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed43d0d-8898-4322-b6fa-0bbb32903087 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:39.581519 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed43d0d-8898-4322-b6fa-0bbb32903087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:39.584575 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed43d0d-8898-4322-b6fa-0bbb32903087 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:39.602085 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1170/2341] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:39.603176 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed43d0d-8898-4322-b6fa-0bbb32903087 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:39.614756 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed43d0d-8898-4322-b6fa-0bbb32903087 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:39.620302 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1247e5-ad1a-4612-a00b-a7a4bc01e296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:39.621099 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1247e5-ad1a-4612-a00b-a7a4bc01e296 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:39.621449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1247e5-ad1a-4612-a00b-a7a4bc01e296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:39.621783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1247e5-ad1a-4612-a00b-a7a4bc01e296 admin admin] PATH_INFO: `/v3/projects/ad62154778b444a0a51c4f29a30afb6a/users/5a0d8e817c1848d5971011584b3137fc/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:39.626722 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7e7e62c3-e4e2-4ac0-941c-58f66e404a38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63cb366e9cab4f448ba2095d24b18d37'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:39.638302 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7e7e62c3-e4e2-4ac0-941c-58f66e404a38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63cb366e9cab4f448ba2095d24b18d37'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:39.640168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1247e5-ad1a-4612-a00b-a7a4bc01e296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad62154778b444a0a51c4f29a30afb6a, user_id=5a0d8e817c1848d5971011584b3137fc, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:39.643320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1247e5-ad1a-4612-a00b-a7a4bc01e296 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:39.662627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7e7e62c3-e4e2-4ac0-941c-58f66e404a38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63cb366e9cab4f448ba2095d24b18d37'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:39.663032 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1171/2342] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:39 2022] PUT /identity/v3/projects/ad62154778b444a0a51c4f29a30afb6a/users/5a0d8e817c1848d5971011584b3137fc/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:39.663569 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7e7e62c3-e4e2-4ac0-941c-58f66e404a38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63cb366e9cab4f448ba2095d24b18d37'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:39.675148 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf47a7-0657-4d8c-990e-7c28c912d90c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:39.675601 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf47a7-0657-4d8c-990e-7c28c912d90c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:39.676167 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf47a7-0657-4d8c-990e-7c28c912d90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:39.690285 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7e7e62c3-e4e2-4ac0-941c-58f66e404a38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63cb366e9cab4f448ba2095d24b18d37'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:39.692125 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:39.699316 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1172/2343] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:39 2022] DELETE /identity/v3/users/63cb366e9cab4f448ba2095d24b18d37 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:39.704120 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f5762-962d-49cc-8bab-86abf2283080 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:39.706426 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f5762-962d-49cc-8bab-86abf2283080 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:39.706426 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f5762-962d-49cc-8bab-86abf2283080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:39.726637 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f1cf47a7-0657-4d8c-990e-7c28c912d90c None None] MFA Rules not processed for user `5a0d8e817c1848d5971011584b3137fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:39.728709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f1cf47a7-0657-4d8c-990e-7c28c912d90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:39.737770 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-bc2f5762-962d-49cc-8bab-86abf2283080 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:39.739215 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bc2f5762-962d-49cc-8bab-86abf2283080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:39.761223 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:39.813458 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1173/2344] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:59:39.815493 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1172/2345] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:39.826552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf47a7-0657-4d8c-990e-7c28c912d90c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:39.826829 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f5762-962d-49cc-8bab-86abf2283080 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:39.828282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f1cf47a7-0657-4d8c-990e-7c28c912d90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:39.828564 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bc2f5762-962d-49cc-8bab-86abf2283080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:39.906643 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf47a7-0657-4d8c-990e-7c28c912d90c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:39.912929 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f5762-962d-49cc-8bab-86abf2283080 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:39.914588 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9dbed-511f-4700-bea4-b3e325360f05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:39.915286 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9dbed-511f-4700-bea4-b3e325360f05 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:39.915539 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9dbed-511f-4700-bea4-b3e325360f05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:39.915806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9dbed-511f-4700-bea4-b3e325360f05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:39.917394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675945d1-c03d-4dce-ac2a-9d91b9854df6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:39.918016 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675945d1-c03d-4dce-ac2a-9d91b9854df6 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:39.918315 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675945d1-c03d-4dce-ac2a-9d91b9854df6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:39.918582 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675945d1-c03d-4dce-ac2a-9d91b9854df6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:39.925798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9dbed-511f-4700-bea4-b3e325360f05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:39.927154 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9dbed-511f-4700-bea4-b3e325360f05 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:39.931914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675945d1-c03d-4dce-ac2a-9d91b9854df6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:39.933918 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675945d1-c03d-4dce-ac2a-9d91b9854df6 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:39.938436 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1173/2346] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:39.950843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1174/2347] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:40.426719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9dbed-511f-4700-bea4-b3e325360f05 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:40.428801 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-eee9dbed-511f-4700-bea4-b3e325360f05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:40.449878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9dbed-511f-4700-bea4-b3e325360f05 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:40.456010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc55d2-e76c-460e-bc53-7591b405faaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:40.456746 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc55d2-e76c-460e-bc53-7591b405faaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:40.457032 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc55d2-e76c-460e-bc53-7591b405faaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:40.457493 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc55d2-e76c-460e-bc53-7591b405faaa admin admin] PATH_INFO: `/v3/projects/ecd18821255f4de3a6dddb4d126238a4` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:40.458885 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc55d2-e76c-460e-bc53-7591b405faaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecd18821255f4de3a6dddb4d126238a4)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:40.462343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc55d2-e76c-460e-bc53-7591b405faaa admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:40.517540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7abc55d2-e76c-460e-bc53-7591b405faaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecd18821255f4de3a6dddb4d126238a4', 'request_id': 'req-7abc55d2-e76c-460e-bc53-7591b405faaa'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:40.530230 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7abc55d2-e76c-460e-bc53-7591b405faaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecd18821255f4de3a6dddb4d126238a4', 'request_id': 'req-7abc55d2-e76c-460e-bc53-7591b405faaa'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:40.536713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7abc55d2-e76c-460e-bc53-7591b405faaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecd18821255f4de3a6dddb4d126238a4', 'request_id': 'req-7abc55d2-e76c-460e-bc53-7591b405faaa'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:40.551050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7abc55d2-e76c-460e-bc53-7591b405faaa admin admin] The token cache is being invalidate because project ecd18821255f4de3a6dddb4d126238a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:40.551260 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7abc55d2-e76c-460e-bc53-7591b405faaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:40.551943 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7abc55d2-e76c-460e-bc53-7591b405faaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:40.553422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1174/2348] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:40 2022] DELETE /identity/v3/projects/ecd18821255f4de3a6dddb4d126238a4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:40.559689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48660f08-f130-42e1-a844-11168ecf15ea None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:40.559980 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48660f08-f130-42e1-a844-11168ecf15ea None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:40.560261 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48660f08-f130-42e1-a844-11168ecf15ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:40.585515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-48660f08-f130-42e1-a844-11168ecf15ea None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:40.587100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-48660f08-f130-42e1-a844-11168ecf15ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:40.656666 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1175/2349] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:40.665429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677647c8-25f4-4a34-b905-cb783abc4d7a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:40.665879 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677647c8-25f4-4a34-b905-cb783abc4d7a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:40.666270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677647c8-25f4-4a34-b905-cb783abc4d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:40.689206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-677647c8-25f4-4a34-b905-cb783abc4d7a None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:40.690492 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-677647c8-25f4-4a34-b905-cb783abc4d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:40.699578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1175/2350] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:40.703980 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48660f08-f130-42e1-a844-11168ecf15ea None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:40.714774 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48660f08-f130-42e1-a844-11168ecf15ea None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:40.719262 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aef6b3-c2b6-4fe5-a89a-146642a777b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:40.719898 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aef6b3-c2b6-4fe5-a89a-146642a777b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:40.720172 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aef6b3-c2b6-4fe5-a89a-146642a777b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:40.720440 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aef6b3-c2b6-4fe5-a89a-146642a777b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:40.721083 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aef6b3-c2b6-4fe5-a89a-146642a777b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:59:40.721377 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aef6b3-c2b6-4fe5-a89a-146642a777b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:40.723034 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aef6b3-c2b6-4fe5-a89a-146642a777b8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:40.735271 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1176/2351] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 11:59:40.739762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677647c8-25f4-4a34-b905-cb783abc4d7a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:40.750270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677647c8-25f4-4a34-b905-cb783abc4d7a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:40.755542 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55261f0f-3148-4420-b1f1-7be9d0e66e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:40.756151 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55261f0f-3148-4420-b1f1-7be9d0e66e57 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:40.756429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55261f0f-3148-4420-b1f1-7be9d0e66e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:40.756701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55261f0f-3148-4420-b1f1-7be9d0e66e57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:40.757333 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55261f0f-3148-4420-b1f1-7be9d0e66e57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:40.759480 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55261f0f-3148-4420-b1f1-7be9d0e66e57 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:40.791032 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1176/2352] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:40 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:59:40.795257 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aef6b3-c2b6-4fe5-a89a-146642a777b8 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:40.806387 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aef6b3-c2b6-4fe5-a89a-146642a777b8 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:40.845354 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:40.881976 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b144044-4095-450c-866b-6599cd5848ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:40.882589 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b144044-4095-450c-866b-6599cd5848ed admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:40.883143 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b144044-4095-450c-866b-6599cd5848ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:40.883143 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b144044-4095-450c-866b-6599cd5848ed admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:40.883946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b144044-4095-450c-866b-6599cd5848ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:40.885913 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b144044-4095-450c-866b-6599cd5848ed admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:40.907737 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1177/2353] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:40 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:40.911845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55261f0f-3148-4420-b1f1-7be9d0e66e57 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:40.922231 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55261f0f-3148-4420-b1f1-7be9d0e66e57 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:40.927194 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0953833-1fa3-45f9-8cb0-bf2542b38a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:40.928007 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0953833-1fa3-45f9-8cb0-bf2542b38a39 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:40.928284 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0953833-1fa3-45f9-8cb0-bf2542b38a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:40.928554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0953833-1fa3-45f9-8cb0-bf2542b38a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:40.929194 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0953833-1fa3-45f9-8cb0-bf2542b38a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:40.931504 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0953833-1fa3-45f9-8cb0-bf2542b38a39 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:40.941857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1177/2354] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:40.945928 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b144044-4095-450c-866b-6599cd5848ed admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:40.956266 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b144044-4095-450c-866b-6599cd5848ed admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:40.961042 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7739039-0c58-4142-be57-930f8e9bba3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:40.961732 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7739039-0c58-4142-be57-930f8e9bba3e admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:40.962088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7739039-0c58-4142-be57-930f8e9bba3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:40.962365 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7739039-0c58-4142-be57-930f8e9bba3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:40.963041 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7739039-0c58-4142-be57-930f8e9bba3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:40.964672 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7739039-0c58-4142-be57-930f8e9bba3e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:40.975804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1178/2355] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:40.980191 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0953833-1fa3-45f9-8cb0-bf2542b38a39 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:40.986806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:40.991289 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0953833-1fa3-45f9-8cb0-bf2542b38a39 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:40.997764 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313253d3-32a4-4d55-873d-d0c9bd0906f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:40.998555 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313253d3-32a4-4d55-873d-d0c9bd0906f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:40.999059 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313253d3-32a4-4d55-873d-d0c9bd0906f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:40.999472 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313253d3-32a4-4d55-873d-d0c9bd0906f3 admin admin] PATH_INFO: `/v3/projects/c55620b415e043c5956a2dc9a0d607d6/users/6d0a46f626cd46ce84ecb2c98becec9c/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:41.015546 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313253d3-32a4-4d55-873d-d0c9bd0906f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c55620b415e043c5956a2dc9a0d607d6, user_id=6d0a46f626cd46ce84ecb2c98becec9c, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:41.018212 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313253d3-32a4-4d55-873d-d0c9bd0906f3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:41.032974 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1178/2356] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:40 2022] PUT /identity/v3/projects/c55620b415e043c5956a2dc9a0d607d6/users/6d0a46f626cd46ce84ecb2c98becec9c/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:41.044597 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a7bf1-f9b2-47a3-972a-a052a5ee2a5c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:41.044884 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a7bf1-f9b2-47a3-972a-a052a5ee2a5c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:41.045155 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a7bf1-f9b2-47a3-972a-a052a5ee2a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:41.073604 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-213a7bf1-f9b2-47a3-972a-a052a5ee2a5c None None] MFA Rules not processed for user `6d0a46f626cd46ce84ecb2c98becec9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:41.074845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-213a7bf1-f9b2-47a3-972a-a052a5ee2a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:41.144234 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1179/2357] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:41.155668 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313253d3-32a4-4d55-873d-d0c9bd0906f3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:41.157411 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-313253d3-32a4-4d55-873d-d0c9bd0906f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:41.220154 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313253d3-32a4-4d55-873d-d0c9bd0906f3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:41.223831 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27e901-64d1-4bb9-ae21-8fae9c3669ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:41.224450 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27e901-64d1-4bb9-ae21-8fae9c3669ae service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:41.224716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27e901-64d1-4bb9-ae21-8fae9c3669ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:41.224987 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27e901-64d1-4bb9-ae21-8fae9c3669ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:41.240314 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27e901-64d1-4bb9-ae21-8fae9c3669ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:41.242051 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27e901-64d1-4bb9-ae21-8fae9c3669ae service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:41.253263 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1179/2358] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:41.444031 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c6fe1-c29a-4fa4-92a3-ced0e7108bef None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:41.444311 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c6fe1-c29a-4fa4-92a3-ced0e7108bef None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:41.444581 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c6fe1-c29a-4fa4-92a3-ced0e7108bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:41.467916 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-602c6fe1-c29a-4fa4-92a3-ced0e7108bef None None] MFA Rules not processed for user `5a0d8e817c1848d5971011584b3137fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:41.469247 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-602c6fe1-c29a-4fa4-92a3-ced0e7108bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:41.544800 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1180/2359] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:41.920522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27e901-64d1-4bb9-ae21-8fae9c3669ae service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:41.922036 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-da27e901-64d1-4bb9-ae21-8fae9c3669ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:42.033849 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27e901-64d1-4bb9-ae21-8fae9c3669ae service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:42.039077 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695206cf-8554-4840-a749-87844ad212d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:42.039934 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695206cf-8554-4840-a749-87844ad212d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:42.040211 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695206cf-8554-4840-a749-87844ad212d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:42.040485 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695206cf-8554-4840-a749-87844ad212d4 admin admin] PATH_INFO: `/v3/users/855b160002eb42bdbacbd99777e783a6` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:42.041717 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695206cf-8554-4840-a749-87844ad212d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=855b160002eb42bdbacbd99777e783a6)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:42.043933 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695206cf-8554-4840-a749-87844ad212d4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:42.116729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-695206cf-8554-4840-a749-87844ad212d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '855b160002eb42bdbacbd99777e783a6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:42.126236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-695206cf-8554-4840-a749-87844ad212d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '855b160002eb42bdbacbd99777e783a6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:42.166525 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-695206cf-8554-4840-a749-87844ad212d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '855b160002eb42bdbacbd99777e783a6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:42.187832 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-695206cf-8554-4840-a749-87844ad212d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '855b160002eb42bdbacbd99777e783a6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:42.188915 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-695206cf-8554-4840-a749-87844ad212d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '855b160002eb42bdbacbd99777e783a6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:42.199575 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1180/2360] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:41 2022] DELETE /identity/v3/users/855b160002eb42bdbacbd99777e783a6 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:42.201700 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73042b45-5e8a-4066-b8dc-eb9ab0bba2ba None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:42.202149 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73042b45-5e8a-4066-b8dc-eb9ab0bba2ba None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:42.202267 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73042b45-5e8a-4066-b8dc-eb9ab0bba2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:42.250420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-73042b45-5e8a-4066-b8dc-eb9ab0bba2ba None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:42.251848 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-73042b45-5e8a-4066-b8dc-eb9ab0bba2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:42.308121 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:42.332363 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1181/2361] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:42.342502 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695206cf-8554-4840-a749-87844ad212d4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:42.344060 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-695206cf-8554-4840-a749-87844ad212d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:42.349581 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:42.409172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695206cf-8554-4840-a749-87844ad212d4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:42.414083 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c3767-f515-429a-a609-db9eeca2ea7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:42.414868 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c3767-f515-429a-a609-db9eeca2ea7a service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:42.415252 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c3767-f515-429a-a609-db9eeca2ea7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:42.415605 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c3767-f515-429a-a609-db9eeca2ea7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:42.427034 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c3767-f515-429a-a609-db9eeca2ea7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:42.428673 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c3767-f515-429a-a609-db9eeca2ea7a service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:42.440566 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1181/2362] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:42.825035 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73042b45-5e8a-4066-b8dc-eb9ab0bba2ba None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:42.826821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-73042b45-5e8a-4066-b8dc-eb9ab0bba2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:42.842052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73042b45-5e8a-4066-b8dc-eb9ab0bba2ba None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:42.847938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1375a-ad07-49de-91c9-1ee5f8ccc846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:42.848586 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1375a-ad07-49de-91c9-1ee5f8ccc846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:42.849025 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1375a-ad07-49de-91c9-1ee5f8ccc846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:42.849470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1375a-ad07-49de-91c9-1ee5f8ccc846 admin admin] PATH_INFO: `/v3/projects/c1eec21ca5d144a9a173707203352e8d` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:42.850794 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1375a-ad07-49de-91c9-1ee5f8ccc846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1eec21ca5d144a9a173707203352e8d)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:42.852841 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1375a-ad07-49de-91c9-1ee5f8ccc846 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:42.909337 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-58e1375a-ad07-49de-91c9-1ee5f8ccc846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1eec21ca5d144a9a173707203352e8d', 'request_id': 'req-58e1375a-ad07-49de-91c9-1ee5f8ccc846'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:42.915935 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-58e1375a-ad07-49de-91c9-1ee5f8ccc846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1eec21ca5d144a9a173707203352e8d', 'request_id': 'req-58e1375a-ad07-49de-91c9-1ee5f8ccc846'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:42.922174 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-58e1375a-ad07-49de-91c9-1ee5f8ccc846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1eec21ca5d144a9a173707203352e8d', 'request_id': 'req-58e1375a-ad07-49de-91c9-1ee5f8ccc846'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:42.938406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-58e1375a-ad07-49de-91c9-1ee5f8ccc846 admin admin] The token cache is being invalidate because project c1eec21ca5d144a9a173707203352e8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:42.938793 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-58e1375a-ad07-49de-91c9-1ee5f8ccc846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:42.939521 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-58e1375a-ad07-49de-91c9-1ee5f8ccc846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:42.941393 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1182/2363] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:42 2022] DELETE /identity/v3/projects/c1eec21ca5d144a9a173707203352e8d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:42.946216 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dead79-1d5c-4a12-ae07-b00587490816 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:42.946724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dead79-1d5c-4a12-ae07-b00587490816 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:42.946821 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dead79-1d5c-4a12-ae07-b00587490816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:42.967610 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-01dead79-1d5c-4a12-ae07-b00587490816 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:42.969308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-01dead79-1d5c-4a12-ae07-b00587490816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:43.039302 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1182/2364] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:59:43.048601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1e23b-0168-4157-a942-323e38698b1d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:43.049119 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1e23b-0168-4157-a942-323e38698b1d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:43.049454 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1e23b-0168-4157-a942-323e38698b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:43.073299 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-83a1e23b-0168-4157-a942-323e38698b1d None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:43.074712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-83a1e23b-0168-4157-a942-323e38698b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:43.083988 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1183/2365] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:43.089288 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dead79-1d5c-4a12-ae07-b00587490816 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:43.108711 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dead79-1d5c-4a12-ae07-b00587490816 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:43.118259 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b2971-d7e9-42ae-952e-a59da1720030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:43.118971 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b2971-d7e9-42ae-952e-a59da1720030 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:43.119250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b2971-d7e9-42ae-952e-a59da1720030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:43.119567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b2971-d7e9-42ae-952e-a59da1720030 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:43.120218 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b2971-d7e9-42ae-952e-a59da1720030 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:59:43.120525 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b2971-d7e9-42ae-952e-a59da1720030 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:43.122432 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b2971-d7e9-42ae-952e-a59da1720030 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:43.152009 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1183/2366] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:59:43.156158 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1e23b-0168-4157-a942-323e38698b1d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:43.171341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1e23b-0168-4157-a942-323e38698b1d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:43.179189 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096131ed-fe77-4570-bb29-7d315289b4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:43.179944 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096131ed-fe77-4570-bb29-7d315289b4ac admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:43.181137 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096131ed-fe77-4570-bb29-7d315289b4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:43.181648 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096131ed-fe77-4570-bb29-7d315289b4ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:43.182554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096131ed-fe77-4570-bb29-7d315289b4ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:43.185941 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096131ed-fe77-4570-bb29-7d315289b4ac admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:43.221175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1184/2367] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:43 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:43.225516 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b2971-d7e9-42ae-952e-a59da1720030 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:43.235995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b2971-d7e9-42ae-952e-a59da1720030 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:43.311972 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183cb2f-e6f0-40d0-9cb1-e8e89becbada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:43.312678 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183cb2f-e6f0-40d0-9cb1-e8e89becbada admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:43.313023 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183cb2f-e6f0-40d0-9cb1-e8e89becbada admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:43.315673 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183cb2f-e6f0-40d0-9cb1-e8e89becbada admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:43.316671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183cb2f-e6f0-40d0-9cb1-e8e89becbada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:43.318847 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183cb2f-e6f0-40d0-9cb1-e8e89becbada admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:43.347325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1184/2368] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:43 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:43.348732 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096131ed-fe77-4570-bb29-7d315289b4ac admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:43.359661 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096131ed-fe77-4570-bb29-7d315289b4ac admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:43.365151 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a9c3b-5ed5-4d24-b7f5-5aa5f1fd801b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:43.365298 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a9c3b-5ed5-4d24-b7f5-5aa5f1fd801b admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:43.365564 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a9c3b-5ed5-4d24-b7f5-5aa5f1fd801b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:43.366010 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a9c3b-5ed5-4d24-b7f5-5aa5f1fd801b admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:43.366997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a9c3b-5ed5-4d24-b7f5-5aa5f1fd801b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:43.368880 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a9c3b-5ed5-4d24-b7f5-5aa5f1fd801b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:43.383223 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1185/2369] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:43.384857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183cb2f-e6f0-40d0-9cb1-e8e89becbada admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:43.395112 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183cb2f-e6f0-40d0-9cb1-e8e89becbada admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:43.400878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac847f-84f2-4cee-a4ab-9b7a179ba72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:43.401522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac847f-84f2-4cee-a4ab-9b7a179ba72d admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:43.401966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac847f-84f2-4cee-a4ab-9b7a179ba72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:43.402289 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac847f-84f2-4cee-a4ab-9b7a179ba72d admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:43.402863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac847f-84f2-4cee-a4ab-9b7a179ba72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:43.404496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac847f-84f2-4cee-a4ab-9b7a179ba72d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:43.416824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1185/2370] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:59:43.420722 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a9c3b-5ed5-4d24-b7f5-5aa5f1fd801b admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:43.444155 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a9c3b-5ed5-4d24-b7f5-5aa5f1fd801b admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:43.448860 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb7879-5623-417e-90e7-7d2966c387c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:43.449733 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb7879-5623-417e-90e7-7d2966c387c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:43.450078 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb7879-5623-417e-90e7-7d2966c387c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:43.450447 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb7879-5623-417e-90e7-7d2966c387c4 admin admin] PATH_INFO: `/v3/projects/2fd93df0805444dfad2ac2d69e42f3ac/users/8af146e2395949c4b7ee748b5bcb6b9b/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:43.468709 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb7879-5623-417e-90e7-7d2966c387c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd93df0805444dfad2ac2d69e42f3ac, user_id=8af146e2395949c4b7ee748b5bcb6b9b, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:43.471584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb7879-5623-417e-90e7-7d2966c387c4 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:43.485448 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1186/2371] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:43 2022] PUT /identity/v3/projects/2fd93df0805444dfad2ac2d69e42f3ac/users/8af146e2395949c4b7ee748b5bcb6b9b/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:43.496222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9781e0-88d0-41ec-9aca-4a2ae0051d74 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:43.496511 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9781e0-88d0-41ec-9aca-4a2ae0051d74 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:43.496783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9781e0-88d0-41ec-9aca-4a2ae0051d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:43.517283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:43.526223 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3c9781e0-88d0-41ec-9aca-4a2ae0051d74 None None] MFA Rules not processed for user `8af146e2395949c4b7ee748b5bcb6b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:43.527839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3c9781e0-88d0-41ec-9aca-4a2ae0051d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:43.601115 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1186/2372] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:59:43.616658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb7879-5623-417e-90e7-7d2966c387c4 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:43.619571 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3ddb7879-5623-417e-90e7-7d2966c387c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:43.687804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb7879-5623-417e-90e7-7d2966c387c4 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:43.699956 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960b100-973f-4320-80bf-dd46ffcd8aa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:43.700595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960b100-973f-4320-80bf-dd46ffcd8aa2 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:43.700936 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960b100-973f-4320-80bf-dd46ffcd8aa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:43.701135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960b100-973f-4320-80bf-dd46ffcd8aa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:43.724292 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960b100-973f-4320-80bf-dd46ffcd8aa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:43.726642 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960b100-973f-4320-80bf-dd46ffcd8aa2 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:43.741938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1187/2373] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:43.787312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9781e0-88d0-41ec-9aca-4a2ae0051d74 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:43.918567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9781e0-88d0-41ec-9aca-4a2ae0051d74 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:43.923992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d1080-1eef-4069-b250-4520944984fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:43.924656 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d1080-1eef-4069-b250-4520944984fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:43.924942 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d1080-1eef-4069-b250-4520944984fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:43.925217 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d1080-1eef-4069-b250-4520944984fd admin admin] PATH_INFO: `/v3/users/8af146e2395949c4b7ee748b5bcb6b9b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:43.926480 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d1080-1eef-4069-b250-4520944984fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8af146e2395949c4b7ee748b5bcb6b9b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:43.928584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d1080-1eef-4069-b250-4520944984fd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:43.996643 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-402d1080-1eef-4069-b250-4520944984fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8af146e2395949c4b7ee748b5bcb6b9b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:44.003643 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-402d1080-1eef-4069-b250-4520944984fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8af146e2395949c4b7ee748b5bcb6b9b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:44.012206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-402d1080-1eef-4069-b250-4520944984fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8af146e2395949c4b7ee748b5bcb6b9b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:44.024569 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-402d1080-1eef-4069-b250-4520944984fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8af146e2395949c4b7ee748b5bcb6b9b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:44.025249 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-402d1080-1eef-4069-b250-4520944984fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8af146e2395949c4b7ee748b5bcb6b9b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:44.031117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1187/2374] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:43 2022] DELETE /identity/v3/users/8af146e2395949c4b7ee748b5bcb6b9b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:44.035997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b34b4-4587-4f78-91c7-4886aa528801 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:44.036102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b34b4-4587-4f78-91c7-4886aa528801 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:44.036369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b34b4-4587-4f78-91c7-4886aa528801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:44.044341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:44.055829 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d90b34b4-4587-4f78-91c7-4886aa528801 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:44.057609 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d90b34b4-4587-4f78-91c7-4886aa528801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:44.130384 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1188/2375] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:44.140936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d1080-1eef-4069-b250-4520944984fd admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:44.143016 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-402d1080-1eef-4069-b250-4520944984fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:44.170713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:44.218690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d1080-1eef-4069-b250-4520944984fd admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:44.225736 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec717d5a-b7dd-4a4d-bcce-2995b385f561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:44.226367 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec717d5a-b7dd-4a4d-bcce-2995b385f561 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:44.226812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec717d5a-b7dd-4a4d-bcce-2995b385f561 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:44.227647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec717d5a-b7dd-4a4d-bcce-2995b385f561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:44.238496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec717d5a-b7dd-4a4d-bcce-2995b385f561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:44.240186 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec717d5a-b7dd-4a4d-bcce-2995b385f561 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:44.303071 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1188/2376] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:44.793685 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b34b4-4587-4f78-91c7-4886aa528801 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:44.796206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d90b34b4-4587-4f78-91c7-4886aa528801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:44.814382 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b34b4-4587-4f78-91c7-4886aa528801 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:44.821582 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92f9cc-17f2-4a3b-afe0-b12fed02c93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:44.822232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92f9cc-17f2-4a3b-afe0-b12fed02c93f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:44.822517 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92f9cc-17f2-4a3b-afe0-b12fed02c93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:44.822946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92f9cc-17f2-4a3b-afe0-b12fed02c93f admin admin] PATH_INFO: `/v3/projects/2fd93df0805444dfad2ac2d69e42f3ac` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:44.824307 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92f9cc-17f2-4a3b-afe0-b12fed02c93f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fd93df0805444dfad2ac2d69e42f3ac)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:44.826418 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92f9cc-17f2-4a3b-afe0-b12fed02c93f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:44.882533 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3e92f9cc-17f2-4a3b-afe0-b12fed02c93f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fd93df0805444dfad2ac2d69e42f3ac', 'request_id': 'req-3e92f9cc-17f2-4a3b-afe0-b12fed02c93f'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:44.888908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3e92f9cc-17f2-4a3b-afe0-b12fed02c93f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fd93df0805444dfad2ac2d69e42f3ac', 'request_id': 'req-3e92f9cc-17f2-4a3b-afe0-b12fed02c93f'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:44.895571 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3e92f9cc-17f2-4a3b-afe0-b12fed02c93f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fd93df0805444dfad2ac2d69e42f3ac', 'request_id': 'req-3e92f9cc-17f2-4a3b-afe0-b12fed02c93f'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:44.912510 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3e92f9cc-17f2-4a3b-afe0-b12fed02c93f admin admin] The token cache is being invalidate because project 2fd93df0805444dfad2ac2d69e42f3ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:44.912803 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3e92f9cc-17f2-4a3b-afe0-b12fed02c93f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:44.913516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3e92f9cc-17f2-4a3b-afe0-b12fed02c93f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:44.915516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1189/2377] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:44 2022] DELETE /identity/v3/projects/2fd93df0805444dfad2ac2d69e42f3ac => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:44.920585 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c89d0-fada-4241-a91b-02711fb8f4e1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:44.920871 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c89d0-fada-4241-a91b-02711fb8f4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:44.921146 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c89d0-fada-4241-a91b-02711fb8f4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:44.945502 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-215c89d0-fada-4241-a91b-02711fb8f4e1 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:44.946801 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-215c89d0-fada-4241-a91b-02711fb8f4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:45.021211 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1189/2378] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:45.024049 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3b7f2-b939-4271-98a7-8f99dfa8992a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:45.024392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3b7f2-b939-4271-98a7-8f99dfa8992a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:45.024668 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3b7f2-b939-4271-98a7-8f99dfa8992a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:45.045496 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-90a3b7f2-b939-4271-98a7-8f99dfa8992a None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:45.046702 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-90a3b7f2-b939-4271-98a7-8f99dfa8992a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:45.055094 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1190/2379] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 11:59:45.059784 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c89d0-fada-4241-a91b-02711fb8f4e1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:45.069382 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c89d0-fada-4241-a91b-02711fb8f4e1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:45.074066 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c8175-43c8-4745-a800-d3c43f971317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:45.074673 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c8175-43c8-4745-a800-d3c43f971317 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:45.074945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c8175-43c8-4745-a800-d3c43f971317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:45.075212 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c8175-43c8-4745-a800-d3c43f971317 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:45.075883 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c8175-43c8-4745-a800-d3c43f971317 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:59:45.076183 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c8175-43c8-4745-a800-d3c43f971317 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:45.077777 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c8175-43c8-4745-a800-d3c43f971317 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:45.089261 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1190/2380] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:59:45.093648 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3b7f2-b939-4271-98a7-8f99dfa8992a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:45.103058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3b7f2-b939-4271-98a7-8f99dfa8992a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:45.107961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1853c-d6ea-46f2-b6e9-e0a69d977fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:45.108565 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1853c-d6ea-46f2-b6e9-e0a69d977fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:45.108878 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1853c-d6ea-46f2-b6e9-e0a69d977fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:45.109114 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1853c-d6ea-46f2-b6e9-e0a69d977fb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:45.109769 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba1853c-d6ea-46f2-b6e9-e0a69d977fb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:45.111709 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba1853c-d6ea-46f2-b6e9-e0a69d977fb2 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:45.144099 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1191/2381] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:45 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:45.149078 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c8175-43c8-4745-a800-d3c43f971317 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:45.159345 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c8175-43c8-4745-a800-d3c43f971317 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:45.219104 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40f879-bdd2-4475-907b-2d67293134e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:45.219736 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40f879-bdd2-4475-907b-2d67293134e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:45.220012 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40f879-bdd2-4475-907b-2d67293134e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:45.220288 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40f879-bdd2-4475-907b-2d67293134e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:45.220912 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40f879-bdd2-4475-907b-2d67293134e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:45.222853 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40f879-bdd2-4475-907b-2d67293134e8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:45.249701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1191/2382] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:45 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:59:45.254100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1853c-d6ea-46f2-b6e9-e0a69d977fb2 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:45.264647 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1853c-d6ea-46f2-b6e9-e0a69d977fb2 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:45.269428 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1372c5c-eee0-4276-9a1e-93ec922f1f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:45.270030 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1372c5c-eee0-4276-9a1e-93ec922f1f0e admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:45.270307 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1372c5c-eee0-4276-9a1e-93ec922f1f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:45.270576 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1372c5c-eee0-4276-9a1e-93ec922f1f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:45.271275 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1372c5c-eee0-4276-9a1e-93ec922f1f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:45.272906 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1372c5c-eee0-4276-9a1e-93ec922f1f0e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:45.283138 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1192/2383] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:59:45.286949 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40f879-bdd2-4475-907b-2d67293134e8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:45.297584 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40f879-bdd2-4475-907b-2d67293134e8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:45.302401 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6ec60-c70e-48f0-bdca-721547fd3b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:45.303145 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6ec60-c70e-48f0-bdca-721547fd3b58 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:45.303526 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6ec60-c70e-48f0-bdca-721547fd3b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:45.303790 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6ec60-c70e-48f0-bdca-721547fd3b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:45.304434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6ec60-c70e-48f0-bdca-721547fd3b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:45.306193 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6ec60-c70e-48f0-bdca-721547fd3b58 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:45.320318 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1192/2384] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:59:45.325231 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1372c5c-eee0-4276-9a1e-93ec922f1f0e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:45.336650 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1372c5c-eee0-4276-9a1e-93ec922f1f0e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:45.342872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49842e95-a8a2-4525-9716-5df1426b7ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:45.343623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49842e95-a8a2-4525-9716-5df1426b7ae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:45.343902 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49842e95-a8a2-4525-9716-5df1426b7ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:45.344173 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49842e95-a8a2-4525-9716-5df1426b7ae0 admin admin] PATH_INFO: `/v3/projects/05f1b3d58a4d41418b518eea903c4c0e/users/c7ceaf4cecaa4ecc80dd4357371330bf/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:45.374661 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49842e95-a8a2-4525-9716-5df1426b7ae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f1b3d58a4d41418b518eea903c4c0e, user_id=c7ceaf4cecaa4ecc80dd4357371330bf, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:45.377948 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49842e95-a8a2-4525-9716-5df1426b7ae0 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:45.393431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1193/2385] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:45 2022] PUT /identity/v3/projects/05f1b3d58a4d41418b518eea903c4c0e/users/c7ceaf4cecaa4ecc80dd4357371330bf/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 11:59:45.399167 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9c9d6-42f1-4355-a940-c4c69f0e36a7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:45.399167 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9c9d6-42f1-4355-a940-c4c69f0e36a7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:45.399898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9c9d6-42f1-4355-a940-c4c69f0e36a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:45.422421 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-99c9c9d6-42f1-4355-a940-c4c69f0e36a7 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:45.423668 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-99c9c9d6-42f1-4355-a940-c4c69f0e36a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:45.461251 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:45.498521 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1193/2386] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:45.508327 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49842e95-a8a2-4525-9716-5df1426b7ae0 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:45.510293 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-49842e95-a8a2-4525-9716-5df1426b7ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:45.553439 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:45.584936 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49842e95-a8a2-4525-9716-5df1426b7ae0 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:45.589135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5adc2-fdfc-425a-b590-a9f53d83ee1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:45.589775 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5adc2-fdfc-425a-b590-a9f53d83ee1e service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:45.590055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5adc2-fdfc-425a-b590-a9f53d83ee1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:45.590325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5adc2-fdfc-425a-b590-a9f53d83ee1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:45.603621 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5adc2-fdfc-425a-b590-a9f53d83ee1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:45.605192 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5adc2-fdfc-425a-b590-a9f53d83ee1e service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:45.615639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1194/2387] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:49.145917 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9c9d6-42f1-4355-a940-c4c69f0e36a7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:49.147827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-99c9c9d6-42f1-4355-a940-c4c69f0e36a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:49.167655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9c9d6-42f1-4355-a940-c4c69f0e36a7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:49.172673 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501f158-f051-471c-9a31-bb5c5b6f88c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:49.173470 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501f158-f051-471c-9a31-bb5c5b6f88c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:49.173848 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501f158-f051-471c-9a31-bb5c5b6f88c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:49.174219 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501f158-f051-471c-9a31-bb5c5b6f88c4 admin admin] PATH_INFO: `/v3/users/f7fe04b5cb8a49039413692514aa0bbd` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:49.176385 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501f158-f051-471c-9a31-bb5c5b6f88c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7fe04b5cb8a49039413692514aa0bbd)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:49.179169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501f158-f051-471c-9a31-bb5c5b6f88c4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:49.324501 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8501f158-f051-471c-9a31-bb5c5b6f88c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7fe04b5cb8a49039413692514aa0bbd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:49.364546 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8501f158-f051-471c-9a31-bb5c5b6f88c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7fe04b5cb8a49039413692514aa0bbd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:49.387681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8501f158-f051-471c-9a31-bb5c5b6f88c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7fe04b5cb8a49039413692514aa0bbd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:49.437829 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8501f158-f051-471c-9a31-bb5c5b6f88c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7fe04b5cb8a49039413692514aa0bbd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:49.438698 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8501f158-f051-471c-9a31-bb5c5b6f88c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7fe04b5cb8a49039413692514aa0bbd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:49.455287 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1194/2388] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:49 2022] DELETE /identity/v3/users/f7fe04b5cb8a49039413692514aa0bbd => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:49.462828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440ef40-b54d-44bf-bd38-099cb9eac5ec None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:49.463472 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440ef40-b54d-44bf-bd38-099cb9eac5ec None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:49.463472 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440ef40-b54d-44bf-bd38-099cb9eac5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:49.504285 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2440ef40-b54d-44bf-bd38-099cb9eac5ec None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:49.505579 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2440ef40-b54d-44bf-bd38-099cb9eac5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:49.599425 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1195/2389] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:49.629315 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501f158-f051-471c-9a31-bb5c5b6f88c4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:49.631160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8501f158-f051-471c-9a31-bb5c5b6f88c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:49.798718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501f158-f051-471c-9a31-bb5c5b6f88c4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:49.821103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fe3ee-1636-49fc-b9b2-67ff3cedb450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:49.824049 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fe3ee-1636-49fc-b9b2-67ff3cedb450 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:49.825223 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fe3ee-1636-49fc-b9b2-67ff3cedb450 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:49.826070 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fe3ee-1636-49fc-b9b2-67ff3cedb450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:49.873740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279fe3ee-1636-49fc-b9b2-67ff3cedb450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:49.880716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279fe3ee-1636-49fc-b9b2-67ff3cedb450 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:49.912462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1195/2390] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:51.200439 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440ef40-b54d-44bf-bd38-099cb9eac5ec None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:51.209666 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2440ef40-b54d-44bf-bd38-099cb9eac5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:51.225517 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440ef40-b54d-44bf-bd38-099cb9eac5ec None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:51.234889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e058a59-8797-4370-8b2e-c86cee6d82a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:51.235597 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e058a59-8797-4370-8b2e-c86cee6d82a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:51.235980 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e058a59-8797-4370-8b2e-c86cee6d82a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:51.238755 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e058a59-8797-4370-8b2e-c86cee6d82a8 admin admin] PATH_INFO: `/v3/projects/8ebfd3acf2a34c559fa11ceffe591b38` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:51.241952 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e058a59-8797-4370-8b2e-c86cee6d82a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ebfd3acf2a34c559fa11ceffe591b38)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:51.244444 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e058a59-8797-4370-8b2e-c86cee6d82a8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:51.346921 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5e058a59-8797-4370-8b2e-c86cee6d82a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ebfd3acf2a34c559fa11ceffe591b38', 'request_id': 'req-5e058a59-8797-4370-8b2e-c86cee6d82a8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:51.364624 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5e058a59-8797-4370-8b2e-c86cee6d82a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ebfd3acf2a34c559fa11ceffe591b38', 'request_id': 'req-5e058a59-8797-4370-8b2e-c86cee6d82a8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:51.392665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5e058a59-8797-4370-8b2e-c86cee6d82a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ebfd3acf2a34c559fa11ceffe591b38', 'request_id': 'req-5e058a59-8797-4370-8b2e-c86cee6d82a8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:51.424925 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5e058a59-8797-4370-8b2e-c86cee6d82a8 admin admin] The token cache is being invalidate because project 8ebfd3acf2a34c559fa11ceffe591b38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:51.426140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5e058a59-8797-4370-8b2e-c86cee6d82a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:51.427083 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5e058a59-8797-4370-8b2e-c86cee6d82a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:51.473937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1196/2391] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:51 2022] DELETE /identity/v3/projects/8ebfd3acf2a34c559fa11ceffe591b38 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:53.134982 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fe3ee-1636-49fc-b9b2-67ff3cedb450 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:53.137023 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-279fe3ee-1636-49fc-b9b2-67ff3cedb450 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:53.156101 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fe3ee-1636-49fc-b9b2-67ff3cedb450 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:53.239221 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:53.265638 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d896abe-b72b-45d7-8cff-28ab1c4df987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:53.266372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d896abe-b72b-45d7-8cff-28ab1c4df987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:53.266713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d896abe-b72b-45d7-8cff-28ab1c4df987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:53.267053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d896abe-b72b-45d7-8cff-28ab1c4df987 admin admin] PATH_INFO: `/v3/users/6d0a46f626cd46ce84ecb2c98becec9c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:53.268333 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d896abe-b72b-45d7-8cff-28ab1c4df987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d0a46f626cd46ce84ecb2c98becec9c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:53.270396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d896abe-b72b-45d7-8cff-28ab1c4df987 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:53.356394 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6d896abe-b72b-45d7-8cff-28ab1c4df987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d0a46f626cd46ce84ecb2c98becec9c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:53.370981 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6d896abe-b72b-45d7-8cff-28ab1c4df987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d0a46f626cd46ce84ecb2c98becec9c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:53.391988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6d896abe-b72b-45d7-8cff-28ab1c4df987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d0a46f626cd46ce84ecb2c98becec9c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:53.431448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6d896abe-b72b-45d7-8cff-28ab1c4df987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d0a46f626cd46ce84ecb2c98becec9c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:53.432806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6d896abe-b72b-45d7-8cff-28ab1c4df987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d0a46f626cd46ce84ecb2c98becec9c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:53.443751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1196/2392] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 11:59:53 2022] DELETE /identity/v3/users/6d0a46f626cd46ce84ecb2c98becec9c => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:53.446209 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2785c-ff18-4642-8ed8-391511990778 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:53.446704 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2785c-ff18-4642-8ed8-391511990778 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:53.448492 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2785c-ff18-4642-8ed8-391511990778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:53.481844 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-3fc2785c-ff18-4642-8ed8-391511990778 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:53.483761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3fc2785c-ff18-4642-8ed8-391511990778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:53.575819 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:53.604371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1197/2393] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:53.632029 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d896abe-b72b-45d7-8cff-28ab1c4df987 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:53.633808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6d896abe-b72b-45d7-8cff-28ab1c4df987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:53.722225 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d896abe-b72b-45d7-8cff-28ab1c4df987 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:53.726544 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b2967-2900-4a1b-995f-b36c6afd68f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:53.727184 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b2967-2900-4a1b-995f-b36c6afd68f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:53.727504 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b2967-2900-4a1b-995f-b36c6afd68f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:53.727770 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b2967-2900-4a1b-995f-b36c6afd68f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:53.743968 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b2967-2900-4a1b-995f-b36c6afd68f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:53.745435 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b2967-2900-4a1b-995f-b36c6afd68f1 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:53.769524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1197/2394] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 11:59:53.836859 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d6f54-2b0f-427b-be33-70be0f40c157 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:53.837378 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d6f54-2b0f-427b-be33-70be0f40c157 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:53.837819 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d6f54-2b0f-427b-be33-70be0f40c157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:53.876755 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-af9d6f54-2b0f-427b-be33-70be0f40c157 None None] MFA Rules not processed for user `c7ceaf4cecaa4ecc80dd4357371330bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:53.878898 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-af9d6f54-2b0f-427b-be33-70be0f40c157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:53.989585 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b2967-2900-4a1b-995f-b36c6afd68f1 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:53.991222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5f5b2967-2900-4a1b-995f-b36c6afd68f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:53.997255 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1198/2395] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:54.010163 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b2967-2900-4a1b-995f-b36c6afd68f1 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:54.030333 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f61c8-0f49-4094-882a-0d483cad22d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:54.033497 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f61c8-0f49-4094-882a-0d483cad22d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:54.034079 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f61c8-0f49-4094-882a-0d483cad22d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:54.034215 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f61c8-0f49-4094-882a-0d483cad22d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:54.034853 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f61c8-0f49-4094-882a-0d483cad22d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:54.036892 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f61c8-0f49-4094-882a-0d483cad22d7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:54.073455 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1198/2396] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:53 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:54.074814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d6f54-2b0f-427b-be33-70be0f40c157 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:54.086997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d6f54-2b0f-427b-be33-70be0f40c157 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:54.162791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52329b04-0e2b-495f-a3a5-ad5497adf126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:54.163777 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52329b04-0e2b-495f-a3a5-ad5497adf126 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:54.164161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52329b04-0e2b-495f-a3a5-ad5497adf126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:54.164502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52329b04-0e2b-495f-a3a5-ad5497adf126 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:54.165250 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52329b04-0e2b-495f-a3a5-ad5497adf126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:54.167440 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52329b04-0e2b-495f-a3a5-ad5497adf126 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:54.207460 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1199/2397] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:54 2022] POST /identity/v3/users => generated 298 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 11:59:54.208432 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f61c8-0f49-4094-882a-0d483cad22d7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:54.221504 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f61c8-0f49-4094-882a-0d483cad22d7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:54.233445 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e58999-6893-4ad2-a315-0c99b402bfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:54.234090 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e58999-6893-4ad2-a315-0c99b402bfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:54.234371 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e58999-6893-4ad2-a315-0c99b402bfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:54.234764 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e58999-6893-4ad2-a315-0c99b402bfc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:54.235448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e58999-6893-4ad2-a315-0c99b402bfc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:54.240324 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e58999-6893-4ad2-a315-0c99b402bfc6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:54.254313 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1199/2398] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:59:54.258947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52329b04-0e2b-495f-a3a5-ad5497adf126 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:54.269433 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52329b04-0e2b-495f-a3a5-ad5497adf126 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:54.274737 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2b9fd-7bc9-4f5f-9446-a9e2f1ea3108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:54.274917 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2b9fd-7bc9-4f5f-9446-a9e2f1ea3108 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:54.275182 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2b9fd-7bc9-4f5f-9446-a9e2f1ea3108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:54.275575 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2b9fd-7bc9-4f5f-9446-a9e2f1ea3108 admin admin] PATH_INFO: `/v3/projects/edab11f5ff974f9193ba6cd7bb292a94/users/1f259a1b49244fa0847c300d6d555b2d/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:54.292110 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2b9fd-7bc9-4f5f-9446-a9e2f1ea3108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edab11f5ff974f9193ba6cd7bb292a94, user_id=1f259a1b49244fa0847c300d6d555b2d, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:54.295539 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2b9fd-7bc9-4f5f-9446-a9e2f1ea3108 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:54.313331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1200/2399] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:54 2022] PUT /identity/v3/projects/edab11f5ff974f9193ba6cd7bb292a94/users/1f259a1b49244fa0847c300d6d555b2d/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:54.317457 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e58999-6893-4ad2-a315-0c99b402bfc6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:54.334154 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e58999-6893-4ad2-a315-0c99b402bfc6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:54.369755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:54.409939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61149636-0165-437a-a9b7-c387fef6dde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:54.410937 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61149636-0165-437a-a9b7-c387fef6dde1 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:54.411407 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61149636-0165-437a-a9b7-c387fef6dde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:54.412371 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61149636-0165-437a-a9b7-c387fef6dde1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:54.413249 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61149636-0165-437a-a9b7-c387fef6dde1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:54.415953 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61149636-0165-437a-a9b7-c387fef6dde1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:54.435055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1200/2400] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 11:59:54.439129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2b9fd-7bc9-4f5f-9446-a9e2f1ea3108 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:54.455721 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2b9fd-7bc9-4f5f-9446-a9e2f1ea3108 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:54.464512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d8db2-ea70-426e-83e4-9a19873bdc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:54.465969 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d8db2-ea70-426e-83e4-9a19873bdc2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:54.466462 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d8db2-ea70-426e-83e4-9a19873bdc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:54.466892 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d8db2-ea70-426e-83e4-9a19873bdc2b admin admin] PATH_INFO: `/v3/projects/edab11f5ff974f9193ba6cd7bb292a94/users/1f259a1b49244fa0847c300d6d555b2d/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:54.469107 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d8db2-ea70-426e-83e4-9a19873bdc2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=edab11f5ff974f9193ba6cd7bb292a94, user_id=1f259a1b49244fa0847c300d6d555b2d, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:54.472023 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d8db2-ea70-426e-83e4-9a19873bdc2b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:54.487270 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1201/2401] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:54 2022] PUT /identity/v3/projects/edab11f5ff974f9193ba6cd7bb292a94/users/1f259a1b49244fa0847c300d6d555b2d/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:54.610602 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61149636-0165-437a-a9b7-c387fef6dde1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:54.612906 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-61149636-0165-437a-a9b7-c387fef6dde1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:54.654541 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61149636-0165-437a-a9b7-c387fef6dde1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:54.791234 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef32ec7-123e-4371-82dd-12b4645274b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:54.792749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef32ec7-123e-4371-82dd-12b4645274b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:54.793774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef32ec7-123e-4371-82dd-12b4645274b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:54.794147 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef32ec7-123e-4371-82dd-12b4645274b2 admin admin] PATH_INFO: `/v3/projects/c55620b415e043c5956a2dc9a0d607d6` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:54.796852 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef32ec7-123e-4371-82dd-12b4645274b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c55620b415e043c5956a2dc9a0d607d6)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:54.803747 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef32ec7-123e-4371-82dd-12b4645274b2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:55.041242 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ef32ec7-123e-4371-82dd-12b4645274b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c55620b415e043c5956a2dc9a0d607d6', 'request_id': 'req-5ef32ec7-123e-4371-82dd-12b4645274b2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:55.062075 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ef32ec7-123e-4371-82dd-12b4645274b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c55620b415e043c5956a2dc9a0d607d6', 'request_id': 'req-5ef32ec7-123e-4371-82dd-12b4645274b2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:55.071267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ef32ec7-123e-4371-82dd-12b4645274b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c55620b415e043c5956a2dc9a0d607d6', 'request_id': 'req-5ef32ec7-123e-4371-82dd-12b4645274b2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:55.097745 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ef32ec7-123e-4371-82dd-12b4645274b2 admin admin] The token cache is being invalidate because project c55620b415e043c5956a2dc9a0d607d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 11:59:55.098119 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ef32ec7-123e-4371-82dd-12b4645274b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:55.098862 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ef32ec7-123e-4371-82dd-12b4645274b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 11:59:55.105179 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1201/2402] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 11:59:54 2022] DELETE /identity/v3/projects/c55620b415e043c5956a2dc9a0d607d6 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:55.118680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41b7a8-bbc4-4c27-ba91-5d38e2bf1817 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:55.118986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41b7a8-bbc4-4c27-ba91-5d38e2bf1817 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:55.119238 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41b7a8-bbc4-4c27-ba91-5d38e2bf1817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:55.159614 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-0b41b7a8-bbc4-4c27-ba91-5d38e2bf1817 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:55.163560 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0b41b7a8-bbc4-4c27-ba91-5d38e2bf1817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:55.219676 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:55.307981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1202/2403] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:55.310218 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b5f7f-9932-45ea-b083-b80734d09af8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:55.310702 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b5f7f-9932-45ea-b083-b80734d09af8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:55.310800 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b5f7f-9932-45ea-b083-b80734d09af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:55.341531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d60b5f7f-9932-45ea-b083-b80734d09af8 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:55.342979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d60b5f7f-9932-45ea-b083-b80734d09af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:55.373235 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1202/2404] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:55.378321 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41b7a8-bbc4-4c27-ba91-5d38e2bf1817 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:55.395574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41b7a8-bbc4-4c27-ba91-5d38e2bf1817 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:55.416460 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e064d0-73a4-4997-828d-9a525afb90e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:55.417139 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e064d0-73a4-4997-828d-9a525afb90e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:55.417426 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e064d0-73a4-4997-828d-9a525afb90e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:55.417708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e064d0-73a4-4997-828d-9a525afb90e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:55.418385 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e064d0-73a4-4997-828d-9a525afb90e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 11:59:55.418686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e064d0-73a4-4997-828d-9a525afb90e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:55.420388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e064d0-73a4-4997-828d-9a525afb90e1 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:55.438162 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1203/2405] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 11:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 11:59:55.442466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b5f7f-9932-45ea-b083-b80734d09af8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:55.453650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b5f7f-9932-45ea-b083-b80734d09af8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:55.484143 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481764d2-41a2-4b74-bdb4-a9184e9cb319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:55.485194 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481764d2-41a2-4b74-bdb4-a9184e9cb319 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:55.485194 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481764d2-41a2-4b74-bdb4-a9184e9cb319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:55.485468 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481764d2-41a2-4b74-bdb4-a9184e9cb319 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:55.485945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481764d2-41a2-4b74-bdb4-a9184e9cb319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:55.487903 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481764d2-41a2-4b74-bdb4-a9184e9cb319 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:55.541393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1203/2406] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 11:59:55 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:55.545845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e064d0-73a4-4997-828d-9a525afb90e1 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:55.566308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e064d0-73a4-4997-828d-9a525afb90e1 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:55.719844 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b196f-3657-415d-b9bb-d5fa5cf314fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:55.720842 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b196f-3657-415d-b9bb-d5fa5cf314fa admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:55.721267 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b196f-3657-415d-b9bb-d5fa5cf314fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:55.721687 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b196f-3657-415d-b9bb-d5fa5cf314fa admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:55.726553 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b196f-3657-415d-b9bb-d5fa5cf314fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:55.728908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b196f-3657-415d-b9bb-d5fa5cf314fa admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:55.770134 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1204/2407] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 11:59:55 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 11:59:55.774573 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481764d2-41a2-4b74-bdb4-a9184e9cb319 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:55.786798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481764d2-41a2-4b74-bdb4-a9184e9cb319 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:55.794336 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ee5f9-9824-4d27-a67e-89b2d58116e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:55.795149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ee5f9-9824-4d27-a67e-89b2d58116e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:55.795626 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ee5f9-9824-4d27-a67e-89b2d58116e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:55.796040 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ee5f9-9824-4d27-a67e-89b2d58116e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:55.797156 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ee5f9-9824-4d27-a67e-89b2d58116e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:55.799074 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ee5f9-9824-4d27-a67e-89b2d58116e5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:55.814130 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1204/2408] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:55.818222 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b196f-3657-415d-b9bb-d5fa5cf314fa admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:55.836365 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b196f-3657-415d-b9bb-d5fa5cf314fa admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:55.845884 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3de5f-c5e3-4f5f-8a3f-68aa2e2a1022 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:55.846158 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3de5f-c5e3-4f5f-8a3f-68aa2e2a1022 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:55.846598 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3de5f-c5e3-4f5f-8a3f-68aa2e2a1022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:55.847334 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73df4e-51bc-49fc-ad71-2ad1707f265d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:55.848523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73df4e-51bc-49fc-ad71-2ad1707f265d admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:55.848945 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73df4e-51bc-49fc-ad71-2ad1707f265d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:55.849513 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73df4e-51bc-49fc-ad71-2ad1707f265d admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:55.850577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73df4e-51bc-49fc-ad71-2ad1707f265d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:55.852850 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73df4e-51bc-49fc-ad71-2ad1707f265d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:55.884941 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1205/2409] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 11:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 11:59:55.888550 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73df4e-51bc-49fc-ad71-2ad1707f265d admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:55.897833 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-99a3de5f-c5e3-4f5f-8a3f-68aa2e2a1022 None None] MFA Rules not processed for user `985216f4610e4da19d73c5d3a823a134`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:55.902168 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-99a3de5f-c5e3-4f5f-8a3f-68aa2e2a1022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:55.922489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 11:59:55.924072 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73df4e-51bc-49fc-ad71-2ad1707f265d admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:55.930737 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a237558-2ade-4ad9-a317-75958c4f3e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:55.931445 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a237558-2ade-4ad9-a317-75958c4f3e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:55.931728 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a237558-2ade-4ad9-a317-75958c4f3e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:55.931998 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a237558-2ade-4ad9-a317-75958c4f3e94 admin admin] PATH_INFO: `/v3/projects/b35a4c4abaf74b4c8677924c87633383/users/d6ae09155ef14b7992a0831e852d89e0/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:55.961753 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a237558-2ade-4ad9-a317-75958c4f3e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35a4c4abaf74b4c8677924c87633383, user_id=d6ae09155ef14b7992a0831e852d89e0, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:55.964757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a237558-2ade-4ad9-a317-75958c4f3e94 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:55.994869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1206/2410] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 11:59:55 2022] PUT /identity/v3/projects/b35a4c4abaf74b4c8677924c87633383/users/d6ae09155ef14b7992a0831e852d89e0/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 11:59:55.999558 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc2758-77a0-4db8-904c-152480e4f3ea None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:56.000092 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc2758-77a0-4db8-904c-152480e4f3ea None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:56.000431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc2758-77a0-4db8-904c-152480e4f3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:56.026488 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a1dc2758-77a0-4db8-904c-152480e4f3ea None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 11:59:56.028650 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a1dc2758-77a0-4db8-904c-152480e4f3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:56.029193 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1205/2411] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:56.206480 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1207/2412] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 11:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 11:59:56.207593 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3de5f-c5e3-4f5f-8a3f-68aa2e2a1022 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 11:59:56.209351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-99a3de5f-c5e3-4f5f-8a3f-68aa2e2a1022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 11:59:56.284138 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3de5f-c5e3-4f5f-8a3f-68aa2e2a1022 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 11:59:56.351413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794305a1-e375-4242-b563-951ad3dce4ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 11:59:56.352367 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794305a1-e375-4242-b563-951ad3dce4ac service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 11:59:56.353511 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794305a1-e375-4242-b563-951ad3dce4ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 11:59:56.353963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794305a1-e375-4242-b563-951ad3dce4ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 11:59:56.376410 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794305a1-e375-4242-b563-951ad3dce4ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 11:59:56.388490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794305a1-e375-4242-b563-951ad3dce4ac service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 11:59:56.421618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1206/2413] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 11:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:02.675764 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633c484-0602-4945-95d1-b358a354d8bb None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:02.676371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633c484-0602-4945-95d1-b358a354d8bb None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:02.676371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633c484-0602-4945-95d1-b358a354d8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:02.737202 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e633c484-0602-4945-95d1-b358a354d8bb None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:02.740299 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e633c484-0602-4945-95d1-b358a354d8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:02.766216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1208/2414] 10.222.0.45 () {58 vars in 1016 bytes} [Tue Aug 30 12:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:02.783900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794305a1-e375-4242-b563-951ad3dce4ac service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:02.785417 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-794305a1-e375-4242-b563-951ad3dce4ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:02.971527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794305a1-e375-4242-b563-951ad3dce4ac service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:02.986191 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501892b6-bc94-4f70-b52a-21e3844f2b15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:02.990431 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501892b6-bc94-4f70-b52a-21e3844f2b15 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:02.990431 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501892b6-bc94-4f70-b52a-21e3844f2b15 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:02.991263 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501892b6-bc94-4f70-b52a-21e3844f2b15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:03.009498 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501892b6-bc94-4f70-b52a-21e3844f2b15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:03.011531 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501892b6-bc94-4f70-b52a-21e3844f2b15 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:03.039117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1207/2415] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:04.684007 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94299f81-338c-4b15-898b-58630c5dd140 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:04.684983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94299f81-338c-4b15-898b-58630c5dd140 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:04.685176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94299f81-338c-4b15-898b-58630c5dd140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:04.741037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-94299f81-338c-4b15-898b-58630c5dd140 None None] MFA Rules not processed for user `58c86110ce97463e9b3d53691ae3e12c`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:04.745326 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-94299f81-338c-4b15-898b-58630c5dd140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:04.764120 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:04.880384 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1209/2416] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Aug 30 12:00:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:04.953147 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501892b6-bc94-4f70-b52a-21e3844f2b15 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:04.957690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-501892b6-bc94-4f70-b52a-21e3844f2b15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:04.973567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:05.027947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e40f5-9eb1-4361-aca5-2159910547c2 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:05.028286 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e40f5-9eb1-4361-aca5-2159910547c2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:05.028559 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e40f5-9eb1-4361-aca5-2159910547c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:05.104222 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-ef6e40f5-9eb1-4361-aca5-2159910547c2 None None] MFA Rules not processed for user `d6ae09155ef14b7992a0831e852d89e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:05.112053 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ef6e40f5-9eb1-4361-aca5-2159910547c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:05.244096 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501892b6-bc94-4f70-b52a-21e3844f2b15 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:05.252672 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26309e-a58a-4baa-a079-76247f750ce3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d27bfb8c0b64763b7db7cffa5f230f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:05.254385 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26309e-a58a-4baa-a079-76247f750ce3 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:05.254834 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26309e-a58a-4baa-a079-76247f750ce3 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:05.255265 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26309e-a58a-4baa-a079-76247f750ce3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:05.274197 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26309e-a58a-4baa-a079-76247f750ce3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:05.280759 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26309e-a58a-4baa-a079-76247f750ce3 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:05.308058 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1208/2417] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Aug 30 12:00:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 12:00:05.341283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1210/2418] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:00:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:05.344504 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26309e-a58a-4baa-a079-76247f750ce3 service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:05.358076 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26309e-a58a-4baa-a079-76247f750ce3 service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:05.364749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c56c3-56d2-49b3-ad43-b7cc03f573d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:05.365862 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c56c3-56d2-49b3-ad43-b7cc03f573d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:05.366300 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c56c3-56d2-49b3-ad43-b7cc03f573d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:05.366850 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c56c3-56d2-49b3-ad43-b7cc03f573d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:05.368239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c56c3-56d2-49b3-ad43-b7cc03f573d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:05.370750 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c56c3-56d2-49b3-ad43-b7cc03f573d8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:05.420567 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1209/2419] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:00:05 2022] POST /identity/v3/projects => generated 369 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:00:05.425630 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e40f5-9eb1-4361-aca5-2159910547c2 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:05.466967 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e40f5-9eb1-4361-aca5-2159910547c2 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:05.653173 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcaa91-1313-427e-8e0a-0ffa0f2ca3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:05.653870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcaa91-1313-427e-8e0a-0ffa0f2ca3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:05.654215 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcaa91-1313-427e-8e0a-0ffa0f2ca3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:05.654494 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcaa91-1313-427e-8e0a-0ffa0f2ca3d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:05.655391 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcaa91-1313-427e-8e0a-0ffa0f2ca3d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:05.657922 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcaa91-1313-427e-8e0a-0ffa0f2ca3d8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:05.808375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1211/2420] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:00:05 2022] POST /identity/v3/users => generated 291 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 12:00:05.809062 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c56c3-56d2-49b3-ad43-b7cc03f573d8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:05.839699 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c56c3-56d2-49b3-ad43-b7cc03f573d8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:05.844596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357698b2-19a4-4d95-a9e6-8768b36afcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:05.845574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357698b2-19a4-4d95-a9e6-8768b36afcfb admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:05.845574 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357698b2-19a4-4d95-a9e6-8768b36afcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:05.845951 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357698b2-19a4-4d95-a9e6-8768b36afcfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:05.846695 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357698b2-19a4-4d95-a9e6-8768b36afcfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:05.848428 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357698b2-19a4-4d95-a9e6-8768b36afcfb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:05.891271 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcaa91-1313-427e-8e0a-0ffa0f2ca3d8 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:05.891605 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1210/2421] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:00:05.902861 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcaa91-1313-427e-8e0a-0ffa0f2ca3d8 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:05.937688 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394034f-e827-4e93-86a6-a5d15972c8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:05.937688 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394034f-e827-4e93-86a6-a5d15972c8f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:05.937688 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394034f-e827-4e93-86a6-a5d15972c8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:05.937688 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394034f-e827-4e93-86a6-a5d15972c8f7 admin admin] PATH_INFO: `/v3/projects/f23637a2acbf4afe8bfaf6da7f203bee/users/3eccef06342340e6bcfe734eac510edf/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:06.013621 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394034f-e827-4e93-86a6-a5d15972c8f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f23637a2acbf4afe8bfaf6da7f203bee, user_id=3eccef06342340e6bcfe734eac510edf, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:06.016733 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394034f-e827-4e93-86a6-a5d15972c8f7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:06.054113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1212/2422] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:00:05 2022] PUT /identity/v3/projects/f23637a2acbf4afe8bfaf6da7f203bee/users/3eccef06342340e6bcfe734eac510edf/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:00:06.058663 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357698b2-19a4-4d95-a9e6-8768b36afcfb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:06.074191 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357698b2-19a4-4d95-a9e6-8768b36afcfb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:06.242997 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee816152-b943-4b26-8a46-75b6d9361ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:06.246294 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee816152-b943-4b26-8a46-75b6d9361ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:06.246774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee816152-b943-4b26-8a46-75b6d9361ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:06.247229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee816152-b943-4b26-8a46-75b6d9361ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:06.248200 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee816152-b943-4b26-8a46-75b6d9361ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:06.253343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee816152-b943-4b26-8a46-75b6d9361ab2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:06.284568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd5b38-06cb-43ff-83c4-ed5931b3a6c5 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:06.284867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd5b38-06cb-43ff-83c4-ed5931b3a6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:06.285146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd5b38-06cb-43ff-83c4-ed5931b3a6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:06.300791 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1211/2423] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:00:06.306283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee816152-b943-4b26-8a46-75b6d9361ab2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:06.344029 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee816152-b943-4b26-8a46-75b6d9361ab2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:06.351298 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:06.372140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfcb0f7-2bbf-48c7-8403-b16cbfad9ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:06.375786 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfcb0f7-2bbf-48c7-8403-b16cbfad9ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:06.377245 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfcb0f7-2bbf-48c7-8403-b16cbfad9ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:06.377762 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfcb0f7-2bbf-48c7-8403-b16cbfad9ed2 admin admin] PATH_INFO: `/v3/projects/f23637a2acbf4afe8bfaf6da7f203bee/users/3eccef06342340e6bcfe734eac510edf/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:06.386077 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfcb0f7-2bbf-48c7-8403-b16cbfad9ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f23637a2acbf4afe8bfaf6da7f203bee, user_id=3eccef06342340e6bcfe734eac510edf, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:06.386230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-37fd5b38-06cb-43ff-83c4-ed5931b3a6c5 None None] MFA Rules not processed for user `1f259a1b49244fa0847c300d6d555b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:06.387739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-37fd5b38-06cb-43ff-83c4-ed5931b3a6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:06.389684 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfcb0f7-2bbf-48c7-8403-b16cbfad9ed2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:06.424081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1212/2424] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:00:06 2022] PUT /identity/v3/projects/f23637a2acbf4afe8bfaf6da7f203bee/users/3eccef06342340e6bcfe734eac510edf/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:00:06.679852 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1213/2425] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:00:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 12:00:06.693000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfcb0f7-2bbf-48c7-8403-b16cbfad9ed2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:06.695041 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7cfcb0f7-2bbf-48c7-8403-b16cbfad9ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:06.828923 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:06.835758 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfcb0f7-2bbf-48c7-8403-b16cbfad9ed2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:06.844413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40875bb4-46cb-466e-a354-7f2b50b34454 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6682c22be8c4bdca4be33a93e802409', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:06.848543 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40875bb4-46cb-466e-a354-7f2b50b34454 service glance] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:06.848829 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40875bb4-46cb-466e-a354-7f2b50b34454 service glance] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:06.849107 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40875bb4-46cb-466e-a354-7f2b50b34454 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:06.857790 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-40875bb4-46cb-466e-a354-7f2b50b34454 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:06.988933 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40875bb4-46cb-466e-a354-7f2b50b34454 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:06.992979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40875bb4-46cb-466e-a354-7f2b50b34454 service glance] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:07.040476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1213/2426] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:07.412525 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760d358-7ca0-48e2-938b-3535a7e129de None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:07.413910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760d358-7ca0-48e2-938b-3535a7e129de None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:07.414413 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760d358-7ca0-48e2-938b-3535a7e129de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:07.443498 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-c760d358-7ca0-48e2-938b-3535a7e129de None None] MFA Rules not processed for user `58c86110ce97463e9b3d53691ae3e12c`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:07.446843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c760d358-7ca0-48e2-938b-3535a7e129de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:07.600115 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1214/2427] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Aug 30 12:00:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:07.613973 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40875bb4-46cb-466e-a354-7f2b50b34454 service glance] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:07.770606 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40875bb4-46cb-466e-a354-7f2b50b34454 service glance] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:07.784016 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58775b-1d77-4623-80aa-a34992fa4af7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d27bfb8c0b64763b7db7cffa5f230f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:07.784979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58775b-1d77-4623-80aa-a34992fa4af7 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:07.785569 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58775b-1d77-4623-80aa-a34992fa4af7 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:07.786072 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58775b-1d77-4623-80aa-a34992fa4af7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:07.828008 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58775b-1d77-4623-80aa-a34992fa4af7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:07.833226 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58775b-1d77-4623-80aa-a34992fa4af7 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:07.859086 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1214/2428] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Aug 30 12:00:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 12:00:08.022228 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728900f-9943-482f-bedf-01bcfb5674d7 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:08.022651 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728900f-9943-482f-bedf-01bcfb5674d7 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:08.022836 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728900f-9943-482f-bedf-01bcfb5674d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:08.067818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a728900f-9943-482f-bedf-01bcfb5674d7 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:08.072705 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a728900f-9943-482f-bedf-01bcfb5674d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:08.337143 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1215/2429] 10.222.0.45 () {58 vars in 1016 bytes} [Tue Aug 30 12:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:08.526801 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58775b-1d77-4623-80aa-a34992fa4af7 service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:08.528340 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6c58775b-1d77-4623-80aa-a34992fa4af7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:08.840415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58775b-1d77-4623-80aa-a34992fa4af7 service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:08.857155 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f77351-2c42-4de6-adbb-101fd6e23540 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:08.857862 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f77351-2c42-4de6-adbb-101fd6e23540 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:08.858087 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f77351-2c42-4de6-adbb-101fd6e23540 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:08.863651 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f77351-2c42-4de6-adbb-101fd6e23540 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:08.899351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f77351-2c42-4de6-adbb-101fd6e23540 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:08.903243 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f77351-2c42-4de6-adbb-101fd6e23540 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:08.931602 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1215/2430] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 12:00:12.949138 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de8cbd-9193-4162-ade5-9f577387ce61 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:12.949138 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de8cbd-9193-4162-ade5-9f577387ce61 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:12.949138 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de8cbd-9193-4162-ade5-9f577387ce61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:13.035061 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-62de8cbd-9193-4162-ade5-9f577387ce61 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:13.036478 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-62de8cbd-9193-4162-ade5-9f577387ce61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:13.081213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1216/2431] 10.222.0.45 () {58 vars in 1016 bytes} [Tue Aug 30 12:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:13.197078 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f77351-2c42-4de6-adbb-101fd6e23540 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:13.225601 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f77351-2c42-4de6-adbb-101fd6e23540 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:13.234901 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a47339-1173-4eef-938b-2af176d242a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:13.235941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a47339-1173-4eef-938b-2af176d242a1 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:13.236601 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a47339-1173-4eef-938b-2af176d242a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:13.237395 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a47339-1173-4eef-938b-2af176d242a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:13.249737 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a47339-1173-4eef-938b-2af176d242a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:13.252472 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a47339-1173-4eef-938b-2af176d242a1 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:13.268036 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1216/2432] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 12:00:16.270028 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982110c-8595-407b-9e1f-11903c56a427 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:16.271433 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982110c-8595-407b-9e1f-11903c56a427 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:16.271961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982110c-8595-407b-9e1f-11903c56a427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:16.316639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-9982110c-8595-407b-9e1f-11903c56a427 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:16.321979 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9982110c-8595-407b-9e1f-11903c56a427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:16.331651 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1217/2433] 10.222.0.45 () {58 vars in 1016 bytes} [Tue Aug 30 12:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:16.699217 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a47339-1173-4eef-938b-2af176d242a1 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:16.719827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:16.726394 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a47339-1173-4eef-938b-2af176d242a1 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:16.742543 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adc2dc-44d0-4d57-9f72-768ba5317055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:16.744807 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adc2dc-44d0-4d57-9f72-768ba5317055 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:16.745561 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adc2dc-44d0-4d57-9f72-768ba5317055 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:16.753182 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adc2dc-44d0-4d57-9f72-768ba5317055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:16.775930 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adc2dc-44d0-4d57-9f72-768ba5317055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:16.781478 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adc2dc-44d0-4d57-9f72-768ba5317055 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:16.827170 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1217/2434] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:19.724251 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32426bd5-f91d-4f8c-bd7a-08d01e2eaa93 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:19.724791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32426bd5-f91d-4f8c-bd7a-08d01e2eaa93 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:19.724791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32426bd5-f91d-4f8c-bd7a-08d01e2eaa93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:19.772994 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-32426bd5-f91d-4f8c-bd7a-08d01e2eaa93 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:19.787817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-32426bd5-f91d-4f8c-bd7a-08d01e2eaa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:19.844297 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1218/2435] 10.222.0.45 () {58 vars in 1016 bytes} [Tue Aug 30 12:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:19.939350 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adc2dc-44d0-4d57-9f72-768ba5317055 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:19.952131 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adc2dc-44d0-4d57-9f72-768ba5317055 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:19.957572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9ef32-d90c-4c0b-89a6-be43782525b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:19.958571 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9ef32-d90c-4c0b-89a6-be43782525b9 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:19.959090 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9ef32-d90c-4c0b-89a6-be43782525b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:19.961264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9ef32-d90c-4c0b-89a6-be43782525b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:19.972107 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9ef32-d90c-4c0b-89a6-be43782525b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:19.974191 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9ef32-d90c-4c0b-89a6-be43782525b9 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:19.989001 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1218/2436] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:20.851690 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091b560-4ce9-450e-b78a-d763cfed2ad7 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:20.852578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091b560-4ce9-450e-b78a-d763cfed2ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:20.853098 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091b560-4ce9-450e-b78a-d763cfed2ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:20.919391 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f091b560-4ce9-450e-b78a-d763cfed2ad7 None None] MFA Rules not processed for user `3eccef06342340e6bcfe734eac510edf`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:20.921002 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f091b560-4ce9-450e-b78a-d763cfed2ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:20.940819 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:21.150177 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1219/2437] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:00:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:21.171857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9ef32-d90c-4c0b-89a6-be43782525b9 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:21.202249 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9ef32-d90c-4c0b-89a6-be43782525b9 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:21.219171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a56bc8-f357-46ed-9c2c-bdc04870d764 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:21.220458 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a56bc8-f357-46ed-9c2c-bdc04870d764 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:21.220890 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a56bc8-f357-46ed-9c2c-bdc04870d764 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:21.221311 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a56bc8-f357-46ed-9c2c-bdc04870d764 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:21.381482 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a56bc8-f357-46ed-9c2c-bdc04870d764 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:21.383126 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a56bc8-f357-46ed-9c2c-bdc04870d764 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:21.425721 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1219/2438] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:24.232162 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db469ec-efbb-41a8-871c-9be80192b9bc None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:24.232783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db469ec-efbb-41a8-871c-9be80192b9bc None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:24.232783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db469ec-efbb-41a8-871c-9be80192b9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:24.289384 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-1db469ec-efbb-41a8-871c-9be80192b9bc None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:24.290645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1db469ec-efbb-41a8-871c-9be80192b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:24.317212 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1220/2439] 10.222.0.45 () {58 vars in 1016 bytes} [Tue Aug 30 12:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:24.335313 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a56bc8-f357-46ed-9c2c-bdc04870d764 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:24.356554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a56bc8-f357-46ed-9c2c-bdc04870d764 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:24.372006 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d58d85-5394-4150-a6d3-eb581480ac84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:24.375079 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d58d85-5394-4150-a6d3-eb581480ac84 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:24.376214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d58d85-5394-4150-a6d3-eb581480ac84 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:24.378188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d58d85-5394-4150-a6d3-eb581480ac84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:24.400671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d58d85-5394-4150-a6d3-eb581480ac84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:24.402578 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d58d85-5394-4150-a6d3-eb581480ac84 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:24.437744 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1220/2440] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:25.396131 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2060cc0-e9a8-442d-ac0d-8d0b9ff758b2 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:25.397773 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2060cc0-e9a8-442d-ac0d-8d0b9ff758b2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:25.398288 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2060cc0-e9a8-442d-ac0d-8d0b9ff758b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:25.420787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a2060cc0-e9a8-442d-ac0d-8d0b9ff758b2 None None] MFA Rules not processed for user `d6ae09155ef14b7992a0831e852d89e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:25.422191 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a2060cc0-e9a8-442d-ac0d-8d0b9ff758b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:25.429859 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1221/2441] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:00:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:26.686557 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4d024-1fa4-4093-8b55-194c0585c79e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:26.687297 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4d024-1fa4-4093-8b55-194c0585c79e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:26.687610 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4d024-1fa4-4093-8b55-194c0585c79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:26.706851 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5f4de-05a4-4223-be7f-cdd46b2b26d9 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:26.707334 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5f4de-05a4-4223-be7f-cdd46b2b26d9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:26.707621 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5f4de-05a4-4223-be7f-cdd46b2b26d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:26.732388 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-71f4d024-1fa4-4093-8b55-194c0585c79e None None] MFA Rules not processed for user `c7ceaf4cecaa4ecc80dd4357371330bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:26.733998 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-71f4d024-1fa4-4093-8b55-194c0585c79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:26.734335 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e5e5f4de-05a4-4223-be7f-cdd46b2b26d9 None None] MFA Rules not processed for user `58c86110ce97463e9b3d53691ae3e12c`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:26.735990 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e5e5f4de-05a4-4223-be7f-cdd46b2b26d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:26.749522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1221/2442] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:00:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:26.754668 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1222/2443] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Aug 30 12:00:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 12:00:26.763389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4d024-1fa4-4093-8b55-194c0585c79e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:26.783246 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4d024-1fa4-4093-8b55-194c0585c79e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:26.791316 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7b7bb-0ae3-4ea9-a513-ebac874b700e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d27bfb8c0b64763b7db7cffa5f230f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:26.792518 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7b7bb-0ae3-4ea9-a513-ebac874b700e service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:26.793119 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7b7bb-0ae3-4ea9-a513-ebac874b700e service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:26.793625 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7b7bb-0ae3-4ea9-a513-ebac874b700e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:26.810015 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7b7bb-0ae3-4ea9-a513-ebac874b700e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:26.813405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7b7bb-0ae3-4ea9-a513-ebac874b700e service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:26.830316 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1222/2444] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Aug 30 12:00:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 12:00:27.981354 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65fc48-0f87-46b6-a744-ddaacff80125 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:27.981848 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65fc48-0f87-46b6-a744-ddaacff80125 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:27.981959 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65fc48-0f87-46b6-a744-ddaacff80125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:28.024493 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-ab65fc48-0f87-46b6-a744-ddaacff80125 None None] MFA Rules not processed for user `58c86110ce97463e9b3d53691ae3e12c`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:28.025929 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ab65fc48-0f87-46b6-a744-ddaacff80125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:28.054005 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1223/2445] 10.222.0.27 () {58 vars in 967 bytes} [Tue Aug 30 12:00:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:28.073051 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7b7bb-0ae3-4ea9-a513-ebac874b700e service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:28.122141 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7b7bb-0ae3-4ea9-a513-ebac874b700e service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:28.140579 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8b34e-d52e-4e7e-9001-e59cfa57cdff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d27bfb8c0b64763b7db7cffa5f230f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:28.141732 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8b34e-d52e-4e7e-9001-e59cfa57cdff service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:28.143520 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8b34e-d52e-4e7e-9001-e59cfa57cdff service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:28.143976 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8b34e-d52e-4e7e-9001-e59cfa57cdff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:28.169623 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8b34e-d52e-4e7e-9001-e59cfa57cdff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:28.174727 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8b34e-d52e-4e7e-9001-e59cfa57cdff service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:28.195648 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1223/2446] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Aug 30 12:00:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 12:00:28.624059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0f476-d5b8-4714-a568-779a29af5784 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:28.624307 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0f476-d5b8-4714-a568-779a29af5784 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:28.624992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0f476-d5b8-4714-a568-779a29af5784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:28.649522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-dcb0f476-d5b8-4714-a568-779a29af5784 None None] MFA Rules not processed for user `58c86110ce97463e9b3d53691ae3e12c`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:28.650756 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-dcb0f476-d5b8-4714-a568-779a29af5784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:28.663167 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1224/2447] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Aug 30 12:00:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:28.672114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8b34e-d52e-4e7e-9001-e59cfa57cdff service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:28.686193 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8b34e-d52e-4e7e-9001-e59cfa57cdff service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:28.691704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5782ccc-4ac6-4f77-89a4-316ae575cc3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d27bfb8c0b64763b7db7cffa5f230f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:28.692336 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5782ccc-4ac6-4f77-89a4-316ae575cc3f service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:28.692611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5782ccc-4ac6-4f77-89a4-316ae575cc3f service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:28.692880 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5782ccc-4ac6-4f77-89a4-316ae575cc3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:28.702430 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5782ccc-4ac6-4f77-89a4-316ae575cc3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:28.704810 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5782ccc-4ac6-4f77-89a4-316ae575cc3f service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:28.721161 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1224/2448] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Aug 30 12:00:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 12:00:29.142610 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad32c3e-ee4a-44b1-9b10-0f8387d26a8c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:29.143161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad32c3e-ee4a-44b1-9b10-0f8387d26a8c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:29.143305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad32c3e-ee4a-44b1-9b10-0f8387d26a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:29.173905 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-6ad32c3e-ee4a-44b1-9b10-0f8387d26a8c None None] MFA Rules not processed for user `58c86110ce97463e9b3d53691ae3e12c`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:29.175247 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6ad32c3e-ee4a-44b1-9b10-0f8387d26a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:29.196509 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1225/2449] 10.222.0.27 () {58 vars in 967 bytes} [Tue Aug 30 12:00:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:29.213162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5782ccc-4ac6-4f77-89a4-316ae575cc3f service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:29.234225 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5782ccc-4ac6-4f77-89a4-316ae575cc3f service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:29.239693 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c063aca-77f3-4ef2-80fa-03cc84ed20fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d27bfb8c0b64763b7db7cffa5f230f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:29.240436 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c063aca-77f3-4ef2-80fa-03cc84ed20fc service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:29.240855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c063aca-77f3-4ef2-80fa-03cc84ed20fc service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:29.241128 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c063aca-77f3-4ef2-80fa-03cc84ed20fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:29.250399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c063aca-77f3-4ef2-80fa-03cc84ed20fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:29.252030 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c063aca-77f3-4ef2-80fa-03cc84ed20fc service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:29.261487 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1225/2450] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Aug 30 12:00:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 12:00:31.442314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad32c3e-ee4a-44b1-9b10-0f8387d26a8c None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:31.444036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6ad32c3e-ee4a-44b1-9b10-0f8387d26a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:31.459796 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad32c3e-ee4a-44b1-9b10-0f8387d26a8c None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:31.465114 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6a397-89ee-490e-89b6-bfe5ca01eddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:31.465763 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6a397-89ee-490e-89b6-bfe5ca01eddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:31.466041 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6a397-89ee-490e-89b6-bfe5ca01eddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:31.466313 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6a397-89ee-490e-89b6-bfe5ca01eddd admin admin] PATH_INFO: `/v3/users/5a0d8e817c1848d5971011584b3137fc` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:31.467582 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6a397-89ee-490e-89b6-bfe5ca01eddd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a0d8e817c1848d5971011584b3137fc)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:31.469545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6a397-89ee-490e-89b6-bfe5ca01eddd admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:31.527872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b3a6a397-89ee-490e-89b6-bfe5ca01eddd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a0d8e817c1848d5971011584b3137fc'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:00:31.538810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b3a6a397-89ee-490e-89b6-bfe5ca01eddd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a0d8e817c1848d5971011584b3137fc'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:00:31.549264 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b3a6a397-89ee-490e-89b6-bfe5ca01eddd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a0d8e817c1848d5971011584b3137fc'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:00:31.550762 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b3a6a397-89ee-490e-89b6-bfe5ca01eddd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a0d8e817c1848d5971011584b3137fc'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:00:31.575076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b3a6a397-89ee-490e-89b6-bfe5ca01eddd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a0d8e817c1848d5971011584b3137fc'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:00:31.582267 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1226/2451] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:00:31 2022] DELETE /identity/v3/users/5a0d8e817c1848d5971011584b3137fc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:00:31.587165 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb801cc4-b5c5-4a39-b2bd-a447ceb4dbdb None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:31.587664 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb801cc4-b5c5-4a39-b2bd-a447ceb4dbdb None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:31.587846 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb801cc4-b5c5-4a39-b2bd-a447ceb4dbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:31.611607 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bb801cc4-b5c5-4a39-b2bd-a447ceb4dbdb None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:31.612787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bb801cc4-b5c5-4a39-b2bd-a447ceb4dbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:31.680913 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1226/2452] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 12:00:31.691305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6a397-89ee-490e-89b6-bfe5ca01eddd admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:31.692920 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b3a6a397-89ee-490e-89b6-bfe5ca01eddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:31.738688 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:31.758772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6a397-89ee-490e-89b6-bfe5ca01eddd admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:31.762814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111bee0-e7de-411a-ac75-e1e58cc279b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:31.763488 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111bee0-e7de-411a-ac75-e1e58cc279b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:31.763768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111bee0-e7de-411a-ac75-e1e58cc279b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:31.764037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111bee0-e7de-411a-ac75-e1e58cc279b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:31.774241 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111bee0-e7de-411a-ac75-e1e58cc279b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:31.775720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111bee0-e7de-411a-ac75-e1e58cc279b0 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:31.785708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1227/2453] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:31.971599 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb801cc4-b5c5-4a39-b2bd-a447ceb4dbdb None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:31.973550 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bb801cc4-b5c5-4a39-b2bd-a447ceb4dbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:31.989303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:31.993918 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb801cc4-b5c5-4a39-b2bd-a447ceb4dbdb None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:32.020632 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb72ec-73ce-4f52-a771-03f617d8dd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:32.021703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb72ec-73ce-4f52-a771-03f617d8dd25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:32.022110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb72ec-73ce-4f52-a771-03f617d8dd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:32.022457 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb72ec-73ce-4f52-a771-03f617d8dd25 admin admin] PATH_INFO: `/v3/projects/ad62154778b444a0a51c4f29a30afb6a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:32.024161 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb72ec-73ce-4f52-a771-03f617d8dd25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad62154778b444a0a51c4f29a30afb6a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:32.027610 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb72ec-73ce-4f52-a771-03f617d8dd25 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:32.083445 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-53bb72ec-73ce-4f52-a771-03f617d8dd25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad62154778b444a0a51c4f29a30afb6a', 'request_id': 'req-53bb72ec-73ce-4f52-a771-03f617d8dd25'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:00:32.091630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-53bb72ec-73ce-4f52-a771-03f617d8dd25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad62154778b444a0a51c4f29a30afb6a', 'request_id': 'req-53bb72ec-73ce-4f52-a771-03f617d8dd25'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:00:32.097514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-53bb72ec-73ce-4f52-a771-03f617d8dd25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad62154778b444a0a51c4f29a30afb6a', 'request_id': 'req-53bb72ec-73ce-4f52-a771-03f617d8dd25'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:00:32.111240 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-53bb72ec-73ce-4f52-a771-03f617d8dd25 admin admin] The token cache is being invalidate because project ad62154778b444a0a51c4f29a30afb6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:00:32.111240 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-53bb72ec-73ce-4f52-a771-03f617d8dd25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:00:32.111240 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-53bb72ec-73ce-4f52-a771-03f617d8dd25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:00:32.113255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1227/2454] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:00:31 2022] DELETE /identity/v3/projects/ad62154778b444a0a51c4f29a30afb6a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:00:32.119862 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cbe9f-ec7f-4299-bad1-6852948fabdc None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:32.120335 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cbe9f-ec7f-4299-bad1-6852948fabdc None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:32.120897 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cbe9f-ec7f-4299-bad1-6852948fabdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:32.141346 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-fe5cbe9f-ec7f-4299-bad1-6852948fabdc None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:32.142552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-fe5cbe9f-ec7f-4299-bad1-6852948fabdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:32.207189 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1228/2455] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:32.274715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e6792-67f6-4252-b822-73650c384c31 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:32.274991 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e6792-67f6-4252-b822-73650c384c31 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:32.275241 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e6792-67f6-4252-b822-73650c384c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:32.297087 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-521e6792-67f6-4252-b822-73650c384c31 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:32.298292 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-521e6792-67f6-4252-b822-73650c384c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:32.307019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1228/2456] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:32.311408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cbe9f-ec7f-4299-bad1-6852948fabdc None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:32.321177 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cbe9f-ec7f-4299-bad1-6852948fabdc None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:32.326277 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509798dd-c7b3-4b68-adc3-cd0724f20e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:32.326874 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509798dd-c7b3-4b68-adc3-cd0724f20e05 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:32.327146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509798dd-c7b3-4b68-adc3-cd0724f20e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:32.327408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509798dd-c7b3-4b68-adc3-cd0724f20e05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:32.328080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509798dd-c7b3-4b68-adc3-cd0724f20e05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 12:00:32.328379 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509798dd-c7b3-4b68-adc3-cd0724f20e05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:32.329983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509798dd-c7b3-4b68-adc3-cd0724f20e05 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:32.341951 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1229/2457] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 12:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 12:00:32.346351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e6792-67f6-4252-b822-73650c384c31 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:32.356392 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e6792-67f6-4252-b822-73650c384c31 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:32.362368 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb40ba-e89d-410b-990a-579e12437072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:32.362966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb40ba-e89d-410b-990a-579e12437072 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:32.363273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb40ba-e89d-410b-990a-579e12437072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:32.363573 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb40ba-e89d-410b-990a-579e12437072 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:32.364207 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb40ba-e89d-410b-990a-579e12437072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:32.366094 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb40ba-e89d-410b-990a-579e12437072 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:32.399413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1229/2458] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:00:32 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:00:32.401036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509798dd-c7b3-4b68-adc3-cd0724f20e05 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:32.411484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509798dd-c7b3-4b68-adc3-cd0724f20e05 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:32.475151 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d86217-8a32-4dfd-8ae5-56ab61706a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:32.475926 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d86217-8a32-4dfd-8ae5-56ab61706a93 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:32.476263 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d86217-8a32-4dfd-8ae5-56ab61706a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:32.476579 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d86217-8a32-4dfd-8ae5-56ab61706a93 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:32.477628 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d86217-8a32-4dfd-8ae5-56ab61706a93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:32.480588 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d86217-8a32-4dfd-8ae5-56ab61706a93 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:32.507879 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1230/2459] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:00:32 2022] POST /identity/v3/users => generated 300 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:00:32.512975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb40ba-e89d-410b-990a-579e12437072 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:32.524943 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb40ba-e89d-410b-990a-579e12437072 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:32.529671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece76d43-4bf3-4da9-b7d1-b6e9d5233898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:32.530277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece76d43-4bf3-4da9-b7d1-b6e9d5233898 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:32.530552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece76d43-4bf3-4da9-b7d1-b6e9d5233898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:32.530815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece76d43-4bf3-4da9-b7d1-b6e9d5233898 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:32.531486 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece76d43-4bf3-4da9-b7d1-b6e9d5233898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:32.533095 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece76d43-4bf3-4da9-b7d1-b6e9d5233898 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:32.544419 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1230/2460] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:00:32.548650 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d86217-8a32-4dfd-8ae5-56ab61706a93 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:32.560039 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d86217-8a32-4dfd-8ae5-56ab61706a93 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:32.565066 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206266c7-50c3-43db-b81c-c415396b2bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:32.565759 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206266c7-50c3-43db-b81c-c415396b2bea admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:32.566040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206266c7-50c3-43db-b81c-c415396b2bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:32.566327 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206266c7-50c3-43db-b81c-c415396b2bea admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:32.566977 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206266c7-50c3-43db-b81c-c415396b2bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:32.568753 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206266c7-50c3-43db-b81c-c415396b2bea admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:32.581525 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1231/2461] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:00:32.585935 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece76d43-4bf3-4da9-b7d1-b6e9d5233898 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:32.598361 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece76d43-4bf3-4da9-b7d1-b6e9d5233898 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:32.603821 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad8cfb-6730-4c3f-896d-23b782836abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:32.604536 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad8cfb-6730-4c3f-896d-23b782836abf admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:32.604849 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad8cfb-6730-4c3f-896d-23b782836abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:32.605095 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad8cfb-6730-4c3f-896d-23b782836abf admin admin] PATH_INFO: `/v3/projects/4c17e4fcd5b940148470265bd2232b2e/users/ce4c8c0ec865423e9ae70b9e7f7f0032/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:32.622731 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad8cfb-6730-4c3f-896d-23b782836abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c17e4fcd5b940148470265bd2232b2e, user_id=ce4c8c0ec865423e9ae70b9e7f7f0032, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:32.625527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad8cfb-6730-4c3f-896d-23b782836abf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:32.643243 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1231/2462] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:00:32 2022] PUT /identity/v3/projects/4c17e4fcd5b940148470265bd2232b2e/users/ce4c8c0ec865423e9ae70b9e7f7f0032/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:00:32.653857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acf51f-bcdb-49da-b7fc-26dd081447cc None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:32.654716 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acf51f-bcdb-49da-b7fc-26dd081447cc None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:32.654716 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acf51f-bcdb-49da-b7fc-26dd081447cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:32.688849 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f1acf51f-bcdb-49da-b7fc-26dd081447cc None None] MFA Rules not processed for user `ce4c8c0ec865423e9ae70b9e7f7f0032`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:32.690344 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f1acf51f-bcdb-49da-b7fc-26dd081447cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:32.729045 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:32.772638 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1232/2463] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:00:32 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:32.784456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad8cfb-6730-4c3f-896d-23b782836abf admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:32.786303 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2cad8cfb-6730-4c3f-896d-23b782836abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:32.844899 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad8cfb-6730-4c3f-896d-23b782836abf admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:32.848814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20cf21-9001-4faf-aee4-da71b2ac67c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:32.849418 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20cf21-9001-4faf-aee4-da71b2ac67c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:32.849693 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20cf21-9001-4faf-aee4-da71b2ac67c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:32.849959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20cf21-9001-4faf-aee4-da71b2ac67c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:32.858797 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20cf21-9001-4faf-aee4-da71b2ac67c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:32.860410 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20cf21-9001-4faf-aee4-da71b2ac67c2 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:32.874550 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1232/2464] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:32 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:38.002138 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acf51f-bcdb-49da-b7fc-26dd081447cc None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:38.096731 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acf51f-bcdb-49da-b7fc-26dd081447cc None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:38.102163 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d328ee-f48e-4ee8-95f8-ccad74d8cfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:38.103398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d328ee-f48e-4ee8-95f8-ccad74d8cfb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:38.103749 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d328ee-f48e-4ee8-95f8-ccad74d8cfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:38.104095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d328ee-f48e-4ee8-95f8-ccad74d8cfb7 admin admin] PATH_INFO: `/v3/users/ce4c8c0ec865423e9ae70b9e7f7f0032` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:38.105431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d328ee-f48e-4ee8-95f8-ccad74d8cfb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce4c8c0ec865423e9ae70b9e7f7f0032)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:38.107504 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d328ee-f48e-4ee8-95f8-ccad74d8cfb7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:38.207571 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-50d328ee-f48e-4ee8-95f8-ccad74d8cfb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce4c8c0ec865423e9ae70b9e7f7f0032'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:00:38.226003 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-50d328ee-f48e-4ee8-95f8-ccad74d8cfb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce4c8c0ec865423e9ae70b9e7f7f0032'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:00:38.254800 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-50d328ee-f48e-4ee8-95f8-ccad74d8cfb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce4c8c0ec865423e9ae70b9e7f7f0032'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:00:38.255682 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-50d328ee-f48e-4ee8-95f8-ccad74d8cfb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce4c8c0ec865423e9ae70b9e7f7f0032'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:00:38.262597 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1f09d-de6c-49fa-b464-cd98c852b588 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:38.263057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1f09d-de6c-49fa-b464-cd98c852b588 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:38.263197 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1f09d-de6c-49fa-b464-cd98c852b588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:38.288388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-50d328ee-f48e-4ee8-95f8-ccad74d8cfb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce4c8c0ec865423e9ae70b9e7f7f0032'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:00:38.311305 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1233/2465] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:00:38 2022] DELETE /identity/v3/users/ce4c8c0ec865423e9ae70b9e7f7f0032 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:00:38.312614 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-85b1f09d-de6c-49fa-b464-cd98c852b588 None None] MFA Rules not processed for user `58c86110ce97463e9b3d53691ae3e12c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:38.313862 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-85b1f09d-de6c-49fa-b464-cd98c852b588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:38.321456 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7c7b6-f549-4425-9480-4df496687e8c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:38.323297 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7c7b6-f549-4425-9480-4df496687e8c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:38.323923 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7c7b6-f549-4425-9480-4df496687e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:38.339999 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:38.357388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-48b7c7b6-f549-4425-9480-4df496687e8c None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:38.358618 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-48b7c7b6-f549-4425-9480-4df496687e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:38.412446 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1233/2466] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Aug 30 12:00:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 12:00:38.425665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1f09d-de6c-49fa-b464-cd98c852b588 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:38.427271 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-85b1f09d-de6c-49fa-b464-cd98c852b588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:38.460634 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:38.477551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1234/2467] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:38.495605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7c7b6-f549-4425-9480-4df496687e8c None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:38.499632 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-48b7c7b6-f549-4425-9480-4df496687e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:38.536322 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1f09d-de6c-49fa-b464-cd98c852b588 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:38.548495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1535f78-e6df-457a-8f61-152168a54e47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d27bfb8c0b64763b7db7cffa5f230f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:38.549228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1535f78-e6df-457a-8f61-152168a54e47 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:38.549512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1535f78-e6df-457a-8f61-152168a54e47 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:38.550149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1535f78-e6df-457a-8f61-152168a54e47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:38.560537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1535f78-e6df-457a-8f61-152168a54e47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:38.562516 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1535f78-e6df-457a-8f61-152168a54e47 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:38.579666 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1234/2468] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Aug 30 12:00:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 12:00:38.582450 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fd53c-a561-4233-ae6c-e039036d5693 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:38.582754 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fd53c-a561-4233-ae6c-e039036d5693 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:38.583180 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fd53c-a561-4233-ae6c-e039036d5693 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:38.585038 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1235/2469] 10.222.0.27 () {54 vars in 921 bytes} [Tue Aug 30 12:00:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 12:00:38.599227 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c159e-3363-4439-9fc6-dcb7a047169a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:38.599680 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c159e-3363-4439-9fc6-dcb7a047169a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:38.600123 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c159e-3363-4439-9fc6-dcb7a047169a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:38.610636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7c7b6-f549-4425-9480-4df496687e8c None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:38.617879 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc14916-01e6-42aa-81c4-fb6399718d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:38.619094 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc14916-01e6-42aa-81c4-fb6399718d14 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:38.619472 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc14916-01e6-42aa-81c4-fb6399718d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:38.619807 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc14916-01e6-42aa-81c4-fb6399718d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:38.626677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-eb7c159e-3363-4439-9fc6-dcb7a047169a None None] MFA Rules not processed for user `8d17f1d0577a41ed8859706073f79d77`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:38.628541 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-eb7c159e-3363-4439-9fc6-dcb7a047169a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:38.636258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc14916-01e6-42aa-81c4-fb6399718d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:38.640150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc14916-01e6-42aa-81c4-fb6399718d14 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:38.666279 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1235/2470] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:38.793098 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1236/2471] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Aug 30 12:00:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:39.093095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc14916-01e6-42aa-81c4-fb6399718d14 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:39.094603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9dc14916-01e6-42aa-81c4-fb6399718d14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:39.127664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc14916-01e6-42aa-81c4-fb6399718d14 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:39.154994 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e22f8-10ac-4d76-80ea-df23a94bc4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:39.155686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e22f8-10ac-4d76-80ea-df23a94bc4c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:39.155962 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e22f8-10ac-4d76-80ea-df23a94bc4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:39.156231 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e22f8-10ac-4d76-80ea-df23a94bc4c7 admin admin] PATH_INFO: `/v3/projects/4c17e4fcd5b940148470265bd2232b2e` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:39.158161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e22f8-10ac-4d76-80ea-df23a94bc4c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c17e4fcd5b940148470265bd2232b2e)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:39.160290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e22f8-10ac-4d76-80ea-df23a94bc4c7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:39.249400 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-530e22f8-10ac-4d76-80ea-df23a94bc4c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c17e4fcd5b940148470265bd2232b2e', 'request_id': 'req-530e22f8-10ac-4d76-80ea-df23a94bc4c7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:00:39.256596 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-530e22f8-10ac-4d76-80ea-df23a94bc4c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c17e4fcd5b940148470265bd2232b2e', 'request_id': 'req-530e22f8-10ac-4d76-80ea-df23a94bc4c7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:00:39.268610 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-530e22f8-10ac-4d76-80ea-df23a94bc4c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c17e4fcd5b940148470265bd2232b2e', 'request_id': 'req-530e22f8-10ac-4d76-80ea-df23a94bc4c7'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:00:39.319731 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-530e22f8-10ac-4d76-80ea-df23a94bc4c7 admin admin] The token cache is being invalidate because project 4c17e4fcd5b940148470265bd2232b2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:00:39.321570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-530e22f8-10ac-4d76-80ea-df23a94bc4c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:00:39.326971 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-530e22f8-10ac-4d76-80ea-df23a94bc4c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:00:39.328891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1236/2472] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:00:39 2022] DELETE /identity/v3/projects/4c17e4fcd5b940148470265bd2232b2e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:00:39.946823 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c159e-3363-4439-9fc6-dcb7a047169a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:39.949621 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-eb7c159e-3363-4439-9fc6-dcb7a047169a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:40.026626 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c159e-3363-4439-9fc6-dcb7a047169a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:40.033366 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:40.093996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b41062-807c-46cc-a88e-66fdfb227ac1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6682c22be8c4bdca4be33a93e802409', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:40.094648 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b41062-807c-46cc-a88e-66fdfb227ac1 service glance] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:40.094952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b41062-807c-46cc-a88e-66fdfb227ac1 service glance] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:40.095283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b41062-807c-46cc-a88e-66fdfb227ac1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:40.097077 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-93b41062-807c-46cc-a88e-66fdfb227ac1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:40.187587 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b41062-807c-46cc-a88e-66fdfb227ac1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:40.188945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b41062-807c-46cc-a88e-66fdfb227ac1 service glance] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:40.202021 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1237/2473] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:40.284626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384c67e-afcc-4f42-aebc-6339209a4fb2 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:40.285080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384c67e-afcc-4f42-aebc-6339209a4fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:40.285359 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384c67e-afcc-4f42-aebc-6339209a4fb2 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:40.286855 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1237/2474] 10.222.0.27 () {54 vars in 921 bytes} [Tue Aug 30 12:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 12:00:40.293308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc49782-6254-4f51-bed3-5418194d5033 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:40.293700 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc49782-6254-4f51-bed3-5418194d5033 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:40.294110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc49782-6254-4f51-bed3-5418194d5033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:40.316422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ebc49782-6254-4f51-bed3-5418194d5033 None None] MFA Rules not processed for user `f3be96d37b4e4dd889be755b004bfe52`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:40.317646 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ebc49782-6254-4f51-bed3-5418194d5033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:40.375527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1238/2475] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Aug 30 12:00:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:40.386081 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384c67e-afcc-4f42-aebc-6339209a4fb2 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:40.387888 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0384c67e-afcc-4f42-aebc-6339209a4fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:40.402362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384c67e-afcc-4f42-aebc-6339209a4fb2 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:40.406161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba2da8-6b97-40ed-a862-6266f38b5d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:40.406767 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba2da8-6b97-40ed-a862-6266f38b5d79 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:40.407041 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba2da8-6b97-40ed-a862-6266f38b5d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:40.407315 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba2da8-6b97-40ed-a862-6266f38b5d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:40.414618 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba2da8-6b97-40ed-a862-6266f38b5d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:40.416144 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba2da8-6b97-40ed-a862-6266f38b5d79 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:40.429003 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1238/2476] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:40.529627 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aef4fe-c7d2-452b-87a2-2e9b39f88cd3 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:40.529924 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aef4fe-c7d2-452b-87a2-2e9b39f88cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:40.530202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aef4fe-c7d2-452b-87a2-2e9b39f88cd3 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:40.531661 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1239/2477] 10.222.0.27 () {54 vars in 921 bytes} [Tue Aug 30 12:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 12:00:40.537242 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b26228-e536-4530-a3ec-89594e2416bf None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:40.537648 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b26228-e536-4530-a3ec-89594e2416bf None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:40.538070 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b26228-e536-4530-a3ec-89594e2416bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:40.566692 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-17b26228-e536-4530-a3ec-89594e2416bf None None] MFA Rules not processed for user `8d17f1d0577a41ed8859706073f79d77`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:40.567943 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-17b26228-e536-4530-a3ec-89594e2416bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:40.577995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1239/2478] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Aug 30 12:00:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:40.590196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aef4fe-c7d2-452b-87a2-2e9b39f88cd3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:40.602320 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aef4fe-c7d2-452b-87a2-2e9b39f88cd3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:40.606115 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1de4a-69b3-444a-899c-d618aadf87ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:40.606802 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1de4a-69b3-444a-899c-d618aadf87ec service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:40.607149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1de4a-69b3-444a-899c-d618aadf87ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:40.607634 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1de4a-69b3-444a-899c-d618aadf87ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:40.619666 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1de4a-69b3-444a-899c-d618aadf87ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:40.621295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1de4a-69b3-444a-899c-d618aadf87ec service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:40.633295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1240/2479] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:00:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:00:50.561309 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=64,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:50.627941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=79 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:51.786609 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb3a1b-5247-4431-ae6a-62f46379af47 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:51.787087 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb3a1b-5247-4431-ae6a-62f46379af47 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:51.787196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb3a1b-5247-4431-ae6a-62f46379af47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:51.807110 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-fecb3a1b-5247-4431-ae6a-62f46379af47 None None] MFA Rules not processed for user `58c86110ce97463e9b3d53691ae3e12c`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:51.808457 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-fecb3a1b-5247-4431-ae6a-62f46379af47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:51.877768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1240/2480] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Aug 30 12:00:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:00:51.892456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1de4a-69b3-444a-899c-d618aadf87ec service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:00:51.894173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c2a1de4a-69b3-444a-899c-d618aadf87ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:51.967419 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1de4a-69b3-444a-899c-d618aadf87ec service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:00:51.972359 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2ae15-2be8-4149-b604-007feaa41e26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d27bfb8c0b64763b7db7cffa5f230f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:00:51.972978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2ae15-2be8-4149-b604-007feaa41e26 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:51.973255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2ae15-2be8-4149-b604-007feaa41e26 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:51.973968 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2ae15-2be8-4149-b604-007feaa41e26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:51.982630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2ae15-2be8-4149-b604-007feaa41e26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:00:51.984988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2ae15-2be8-4149-b604-007feaa41e26 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:00:51.993992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1241/2481] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Aug 30 12:00:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 12:00:52.381873 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c12d6c-dbdf-4953-a1cb-67b7a7ba6483 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:00:52.382375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c12d6c-dbdf-4953-a1cb-67b7a7ba6483 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:00:52.382567 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c12d6c-dbdf-4953-a1cb-67b7a7ba6483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:00:52.418145 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e8c12d6c-dbdf-4953-a1cb-67b7a7ba6483 None None] MFA Rules not processed for user `cc64506c0e724221b1777a05a6a715c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:00:52.419765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e8c12d6c-dbdf-4953-a1cb-67b7a7ba6483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:00:52.517408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1241/2482] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:00:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:01:01.990688 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=32 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:01:02.200570 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2ae15-2be8-4149-b604-007feaa41e26 service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:01:02.202999 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-88b2ae15-2be8-4149-b604-007feaa41e26 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:01:02.296874 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2ae15-2be8-4149-b604-007feaa41e26 service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:01:02.302048 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4545a1d-1b4f-466c-9c06-321c896ae70d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9efd2ac7fc4a42558e8dc48c408ce525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:01:02.302788 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4545a1d-1b4f-466c-9c06-321c896ae70d service placement] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:01:02.303079 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4545a1d-1b4f-466c-9c06-321c896ae70d service placement] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:01:02.303345 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4545a1d-1b4f-466c-9c06-321c896ae70d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:01:02.305823 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d4545a1d-1b4f-466c-9c06-321c896ae70d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:01:02.317439 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4545a1d-1b4f-466c-9c06-321c896ae70d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:01:02.319088 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4545a1d-1b4f-466c-9c06-321c896ae70d service placement] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:01:02.328780 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1242/2483] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:01:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:01:02.511146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=50 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:01:07.438528 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c12d6c-dbdf-4953-a1cb-67b7a7ba6483 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:01:07.440323 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e8c12d6c-dbdf-4953-a1cb-67b7a7ba6483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:01:07.453153 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c12d6c-dbdf-4953-a1cb-67b7a7ba6483 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:01:07.456805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7b509-ef42-47ea-b9eb-53e1a03f6f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:01:07.457425 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7b509-ef42-47ea-b9eb-53e1a03f6f30 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:01:07.457701 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7b509-ef42-47ea-b9eb-53e1a03f6f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:01:07.457975 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7b509-ef42-47ea-b9eb-53e1a03f6f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:01:07.459777 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-49e7b509-ef42-47ea-b9eb-53e1a03f6f30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:01:07.522166 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7b509-ef42-47ea-b9eb-53e1a03f6f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:01:07.523619 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7b509-ef42-47ea-b9eb-53e1a03f6f30 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:01:07.533464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1242/2484] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:01:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:01:10.716782 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e14f3-068f-4ab3-aa38-3e5deec0cf95 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:01:10.717706 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e14f3-068f-4ab3-aa38-3e5deec0cf95 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:01:10.718137 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e14f3-068f-4ab3-aa38-3e5deec0cf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:01:10.751291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-488e14f3-068f-4ab3-aa38-3e5deec0cf95 None None] MFA Rules not processed for user `58c86110ce97463e9b3d53691ae3e12c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:01:10.752663 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-488e14f3-068f-4ab3-aa38-3e5deec0cf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:01:10.760808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1243/2485] 10.222.0.27 () {58 vars in 967 bytes} [Tue Aug 30 12:01:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:01:10.784491 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7b509-ef42-47ea-b9eb-53e1a03f6f30 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:01:10.796755 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7b509-ef42-47ea-b9eb-53e1a03f6f30 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:01:10.802043 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9892e2-106e-4833-b5a7-c3f66cdba4f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d27bfb8c0b64763b7db7cffa5f230f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:01:10.802670 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9892e2-106e-4833-b5a7-c3f66cdba4f0 service swift] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:01:10.802946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9892e2-106e-4833-b5a7-c3f66cdba4f0 service swift] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:01:10.803217 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9892e2-106e-4833-b5a7-c3f66cdba4f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:01:10.813227 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9892e2-106e-4833-b5a7-c3f66cdba4f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:01:10.814833 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9892e2-106e-4833-b5a7-c3f66cdba4f0 service swift] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:01:10.824193 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1243/2486] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Aug 30 12:01:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 12:01:12.115322 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e14f3-068f-4ab3-aa38-3e5deec0cf95 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:01:12.125507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e14f3-068f-4ab3-aa38-3e5deec0cf95 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:01:12.130128 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea2c54-987e-40cf-8767-fbe26a4016fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:01:12.130741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea2c54-987e-40cf-8767-fbe26a4016fd service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:01:12.131047 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea2c54-987e-40cf-8767-fbe26a4016fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:01:12.131315 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea2c54-987e-40cf-8767-fbe26a4016fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:01:12.133331 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f8ea2c54-987e-40cf-8767-fbe26a4016fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:01:12.198048 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea2c54-987e-40cf-8767-fbe26a4016fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:01:12.200732 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea2c54-987e-40cf-8767-fbe26a4016fd service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:01:12.210331 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1244/2487] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:01:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:01:20.820463 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=36 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:01:22.205415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=65 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:01:24.946837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801af575-68d5-4f32-aab8-768b765ce85c None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:01:24.947408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801af575-68d5-4f32-aab8-768b765ce85c None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:01:24.947408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801af575-68d5-4f32-aab8-768b765ce85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:01:24.969121 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-801af575-68d5-4f32-aab8-768b765ce85c None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:01:24.970405 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-801af575-68d5-4f32-aab8-768b765ce85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:01:25.032937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1244/2488] 10.222.0.45 () {58 vars in 1016 bytes} [Tue Aug 30 12:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:01:25.053869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea2c54-987e-40cf-8767-fbe26a4016fd service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:01:25.055325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f8ea2c54-987e-40cf-8767-fbe26a4016fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:01:25.070901 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea2c54-987e-40cf-8767-fbe26a4016fd service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:01:25.078170 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428778aa-569f-434a-b24a-fe472dcab0c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:01:25.078878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428778aa-569f-434a-b24a-fe472dcab0c0 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:01:25.079143 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428778aa-569f-434a-b24a-fe472dcab0c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:01:25.079650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428778aa-569f-434a-b24a-fe472dcab0c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:01:25.088541 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428778aa-569f-434a-b24a-fe472dcab0c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:01:25.090146 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428778aa-569f-434a-b24a-fe472dcab0c0 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:01:25.100408 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1245/2489] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:01:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:01:28.236519 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186e74e-63ea-4252-b0a4-86d65f618985 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:01:28.237063 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186e74e-63ea-4252-b0a4-86d65f618985 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:01:28.237063 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186e74e-63ea-4252-b0a4-86d65f618985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:01:28.257267 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a186e74e-63ea-4252-b0a4-86d65f618985 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:01:28.258462 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a186e74e-63ea-4252-b0a4-86d65f618985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:01:28.267709 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1245/2490] 10.222.0.45 () {58 vars in 1016 bytes} [Tue Aug 30 12:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:01:28.295807 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428778aa-569f-434a-b24a-fe472dcab0c0 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:01:28.298082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-428778aa-569f-434a-b24a-fe472dcab0c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:01:28.313925 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428778aa-569f-434a-b24a-fe472dcab0c0 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:01:28.320641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eae429-c622-4234-9095-681d054a6c46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:01:28.321249 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eae429-c622-4234-9095-681d054a6c46 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:01:28.321518 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eae429-c622-4234-9095-681d054a6c46 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:01:28.321783 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eae429-c622-4234-9095-681d054a6c46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:01:28.330850 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eae429-c622-4234-9095-681d054a6c46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:01:28.332577 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eae429-c622-4234-9095-681d054a6c46 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:01:28.343458 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1246/2491] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:01:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:01:31.335568 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dbc80-7744-44ef-9952-e20157030349 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:01:31.336102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dbc80-7744-44ef-9952-e20157030349 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:01:31.336102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dbc80-7744-44ef-9952-e20157030349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:01:31.357833 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-052dbc80-7744-44ef-9952-e20157030349 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:01:31.359039 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-052dbc80-7744-44ef-9952-e20157030349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:01:31.368601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1246/2492] 10.222.0.45 () {58 vars in 1016 bytes} [Tue Aug 30 12:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:01:31.387023 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eae429-c622-4234-9095-681d054a6c46 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:01:31.399448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eae429-c622-4234-9095-681d054a6c46 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:01:31.406764 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d0392-beb8-48ae-9809-33deebb76ced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:01:31.407572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d0392-beb8-48ae-9809-33deebb76ced service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:01:31.407916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d0392-beb8-48ae-9809-33deebb76ced service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:01:31.408245 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d0392-beb8-48ae-9809-33deebb76ced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:01:31.416856 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d0392-beb8-48ae-9809-33deebb76ced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:01:31.418425 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d0392-beb8-48ae-9809-33deebb76ced service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:01:31.428851 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1247/2493] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:01:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:01:36.563650 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e6b6d-18d9-4e5a-81e9-40852f1fb4cc None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:01:36.564189 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e6b6d-18d9-4e5a-81e9-40852f1fb4cc None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:01:36.564189 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e6b6d-18d9-4e5a-81e9-40852f1fb4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:01:36.591089 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-122e6b6d-18d9-4e5a-81e9-40852f1fb4cc None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:01:36.592550 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-122e6b6d-18d9-4e5a-81e9-40852f1fb4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:01:36.601130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1247/2494] 10.222.0.45 () {58 vars in 1016 bytes} [Tue Aug 30 12:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:01:36.621749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d0392-beb8-48ae-9809-33deebb76ced service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:01:36.636654 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d0392-beb8-48ae-9809-33deebb76ced service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:01:36.643541 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3122552-52bd-4aff-85c6-8b158c43b8a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:01:36.644159 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3122552-52bd-4aff-85c6-8b158c43b8a2 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:01:36.644439 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3122552-52bd-4aff-85c6-8b158c43b8a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:01:36.644704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3122552-52bd-4aff-85c6-8b158c43b8a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:01:36.653798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3122552-52bd-4aff-85c6-8b158c43b8a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:01:36.655462 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3122552-52bd-4aff-85c6-8b158c43b8a2 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:01:36.665180 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1248/2495] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:01:38.142648 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f0576-e460-4dd5-b190-26e45e91997f None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:01:38.143199 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f0576-e460-4dd5-b190-26e45e91997f None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:01:38.143199 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f0576-e460-4dd5-b190-26e45e91997f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:01:38.166631 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-8c9f0576-e460-4dd5-b190-26e45e91997f None None] MFA Rules not processed for user `985216f4610e4da19d73c5d3a823a134`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:01:38.168150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8c9f0576-e460-4dd5-b190-26e45e91997f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:01:38.229481 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1248/2496] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:01:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:01:40.810418 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf5d48-42ca-46df-ba46-4d45ce7ca561 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:01:40.810940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf5d48-42ca-46df-ba46-4d45ce7ca561 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:01:40.810940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf5d48-42ca-46df-ba46-4d45ce7ca561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:01:40.832407 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7edf5d48-42ca-46df-ba46-4d45ce7ca561 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:01:40.833833 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7edf5d48-42ca-46df-ba46-4d45ce7ca561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:01:40.843950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1249/2497] 10.222.0.45 () {58 vars in 1016 bytes} [Tue Aug 30 12:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:01:40.862741 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f0576-e460-4dd5-b190-26e45e91997f None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:01:40.876700 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f0576-e460-4dd5-b190-26e45e91997f None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:01:40.883572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36022ef6-7c0c-41c6-a9fc-3a1e5a6d8c96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:01:40.884201 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36022ef6-7c0c-41c6-a9fc-3a1e5a6d8c96 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:01:40.884476 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36022ef6-7c0c-41c6-a9fc-3a1e5a6d8c96 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:01:40.884741 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36022ef6-7c0c-41c6-a9fc-3a1e5a6d8c96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:01:40.893452 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36022ef6-7c0c-41c6-a9fc-3a1e5a6d8c96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:01:40.895119 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36022ef6-7c0c-41c6-a9fc-3a1e5a6d8c96 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:01:40.905474 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1249/2498] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:01:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:01:50.827042 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=27 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:01:50.901146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=67 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:02:10.735254 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d99bef-43e8-4639-87e4-37e2bf9bd348 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:10.735868 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d99bef-43e8-4639-87e4-37e2bf9bd348 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:10.735972 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d99bef-43e8-4639-87e4-37e2bf9bd348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:10.755943 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-29d99bef-43e8-4639-87e4-37e2bf9bd348 None None] MFA Rules not processed for user `588d11e6ed3b4eda8c74e782669a63af`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:02:10.757155 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-29d99bef-43e8-4639-87e4-37e2bf9bd348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:10.816142 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1250/2499] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:02:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:02:11.724845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36022ef6-7c0c-41c6-a9fc-3a1e5a6d8c96 service nova] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:11.726405 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-36022ef6-7c0c-41c6-a9fc-3a1e5a6d8c96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:11.749717 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36022ef6-7c0c-41c6-a9fc-3a1e5a6d8c96 service nova] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:11.756470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e565d5-4d09-43ff-8e8e-75390d4db033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:11.757829 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e565d5-4d09-43ff-8e8e-75390d4db033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:11.758111 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e565d5-4d09-43ff-8e8e-75390d4db033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:11.758364 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e565d5-4d09-43ff-8e8e-75390d4db033 admin admin] PATH_INFO: `/v3/users/cc64506c0e724221b1777a05a6a715c6` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:11.759773 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e565d5-4d09-43ff-8e8e-75390d4db033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc64506c0e724221b1777a05a6a715c6)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:11.761876 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e565d5-4d09-43ff-8e8e-75390d4db033 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:11.818220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-70e565d5-4d09-43ff-8e8e-75390d4db033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc64506c0e724221b1777a05a6a715c6'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:11.826626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-70e565d5-4d09-43ff-8e8e-75390d4db033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc64506c0e724221b1777a05a6a715c6'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:11.836468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-70e565d5-4d09-43ff-8e8e-75390d4db033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc64506c0e724221b1777a05a6a715c6'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:11.837175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-70e565d5-4d09-43ff-8e8e-75390d4db033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc64506c0e724221b1777a05a6a715c6'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:11.853767 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-70e565d5-4d09-43ff-8e8e-75390d4db033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc64506c0e724221b1777a05a6a715c6'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:11.860335 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1250/2500] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:02:11 2022] DELETE /identity/v3/users/cc64506c0e724221b1777a05a6a715c6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:02:12.043800 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d99bef-43e8-4639-87e4-37e2bf9bd348 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:12.073213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d99bef-43e8-4639-87e4-37e2bf9bd348 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:12.145842 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4dfb9-b566-403f-a95f-faa1c1c07db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:12.146843 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4dfb9-b566-403f-a95f-faa1c1c07db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:12.147121 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4dfb9-b566-403f-a95f-faa1c1c07db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:12.147580 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4dfb9-b566-403f-a95f-faa1c1c07db2 admin admin] PATH_INFO: `/v3/projects/12d28772f08044e289747b782de23b25` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:12.148726 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4dfb9-b566-403f-a95f-faa1c1c07db2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12d28772f08044e289747b782de23b25)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:12.150873 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4dfb9-b566-403f-a95f-faa1c1c07db2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:12.204750 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e7c4dfb9-b566-403f-a95f-faa1c1c07db2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12d28772f08044e289747b782de23b25', 'request_id': 'req-e7c4dfb9-b566-403f-a95f-faa1c1c07db2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:12.213389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e7c4dfb9-b566-403f-a95f-faa1c1c07db2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12d28772f08044e289747b782de23b25', 'request_id': 'req-e7c4dfb9-b566-403f-a95f-faa1c1c07db2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:12.221151 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e7c4dfb9-b566-403f-a95f-faa1c1c07db2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12d28772f08044e289747b782de23b25', 'request_id': 'req-e7c4dfb9-b566-403f-a95f-faa1c1c07db2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:12.236544 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e7c4dfb9-b566-403f-a95f-faa1c1c07db2 admin admin] The token cache is being invalidate because project 12d28772f08044e289747b782de23b25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:02:12.236828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e7c4dfb9-b566-403f-a95f-faa1c1c07db2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:12.237759 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e7c4dfb9-b566-403f-a95f-faa1c1c07db2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:12.240203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1251/2501] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:02:12 2022] DELETE /identity/v3/projects/12d28772f08044e289747b782de23b25 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:02:16.977391 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afbd8c-0825-4c0e-9608-cdb51a4c0cab None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:16.977953 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afbd8c-0825-4c0e-9608-cdb51a4c0cab None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:16.978050 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afbd8c-0825-4c0e-9608-cdb51a4c0cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:16.999196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e6afbd8c-0825-4c0e-9608-cdb51a4c0cab None None] MFA Rules not processed for user `e9a57b9a59f84e16ac1e34d557d63a65`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:02:17.000649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e6afbd8c-0825-4c0e-9608-cdb51a4c0cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:17.066428 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1251/2502] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:02:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 12:02:22.233295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:02:27.058693 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:02:40.124403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4dfb9-b566-403f-a95f-faa1c1c07db2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:40.126099 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e7c4dfb9-b566-403f-a95f-faa1c1c07db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:40.189563 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4dfb9-b566-403f-a95f-faa1c1c07db2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:40.193702 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a2f37-86b1-476a-9f36-e159490ded41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:40.194343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a2f37-86b1-476a-9f36-e159490ded41 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:40.194632 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a2f37-86b1-476a-9f36-e159490ded41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:40.194897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a2f37-86b1-476a-9f36-e159490ded41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:40.197382 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-871a2f37-86b1-476a-9f36-e159490ded41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:40.282265 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a2f37-86b1-476a-9f36-e159490ded41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:40.283845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a2f37-86b1-476a-9f36-e159490ded41 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:40.297573 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1252/2503] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:02:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:02:41.581425 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afbd8c-0825-4c0e-9608-cdb51a4c0cab None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:41.592219 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afbd8c-0825-4c0e-9608-cdb51a4c0cab None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:41.596699 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca59eb6-068b-41bc-95c7-ee491f8d45f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:41.597147 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca59eb6-068b-41bc-95c7-ee491f8d45f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:41.597425 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca59eb6-068b-41bc-95c7-ee491f8d45f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:41.597700 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca59eb6-068b-41bc-95c7-ee491f8d45f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:41.599818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9ca59eb6-068b-41bc-95c7-ee491f8d45f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:41.614258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca59eb6-068b-41bc-95c7-ee491f8d45f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:41.616313 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca59eb6-068b-41bc-95c7-ee491f8d45f1 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:41.631457 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1252/2504] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:02:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:02:46.441267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a2f37-86b1-476a-9f36-e159490ded41 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:46.442839 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-871a2f37-86b1-476a-9f36-e159490ded41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:46.454249 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a2f37-86b1-476a-9f36-e159490ded41 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:46.458650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67588718-8327-40f3-9f72-9173c42dcd9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:46.459252 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67588718-8327-40f3-9f72-9173c42dcd9d service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:46.459549 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67588718-8327-40f3-9f72-9173c42dcd9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:46.459815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67588718-8327-40f3-9f72-9173c42dcd9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:46.461655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-67588718-8327-40f3-9f72-9173c42dcd9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:46.528969 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67588718-8327-40f3-9f72-9173c42dcd9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:46.530325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67588718-8327-40f3-9f72-9173c42dcd9d service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:46.541491 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1253/2505] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:02:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:02:49.828797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca59eb6-068b-41bc-95c7-ee491f8d45f1 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:49.830370 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9ca59eb6-068b-41bc-95c7-ee491f8d45f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:49.847637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca59eb6-068b-41bc-95c7-ee491f8d45f1 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:49.854045 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746241b-b4b1-4122-b35d-650b045ed129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:49.854722 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746241b-b4b1-4122-b35d-650b045ed129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:49.855019 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746241b-b4b1-4122-b35d-650b045ed129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:49.855375 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746241b-b4b1-4122-b35d-650b045ed129 admin admin] PATH_INFO: `/v3/users/985216f4610e4da19d73c5d3a823a134` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:49.856614 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746241b-b4b1-4122-b35d-650b045ed129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=985216f4610e4da19d73c5d3a823a134)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:49.858573 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746241b-b4b1-4122-b35d-650b045ed129 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:49.916127 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c746241b-b4b1-4122-b35d-650b045ed129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '985216f4610e4da19d73c5d3a823a134'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:49.924229 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c746241b-b4b1-4122-b35d-650b045ed129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '985216f4610e4da19d73c5d3a823a134'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:49.933604 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c746241b-b4b1-4122-b35d-650b045ed129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '985216f4610e4da19d73c5d3a823a134'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:49.934214 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c746241b-b4b1-4122-b35d-650b045ed129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '985216f4610e4da19d73c5d3a823a134'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:49.946932 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c746241b-b4b1-4122-b35d-650b045ed129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '985216f4610e4da19d73c5d3a823a134'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:49.952817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1253/2506] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:02:49 2022] DELETE /identity/v3/users/985216f4610e4da19d73c5d3a823a134 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:02:50.133640 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67588718-8327-40f3-9f72-9173c42dcd9d service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:50.146432 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67588718-8327-40f3-9f72-9173c42dcd9d service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:50.182542 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:02:50.208614 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e50a7c-6618-4cf0-9720-8b43f0df1e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:50.209249 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e50a7c-6618-4cf0-9720-8b43f0df1e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:50.209525 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e50a7c-6618-4cf0-9720-8b43f0df1e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:50.209805 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e50a7c-6618-4cf0-9720-8b43f0df1e05 admin admin] PATH_INFO: `/v3/projects/48cb907899ab4ea4b28ef88c3917d0ac` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:50.210916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e50a7c-6618-4cf0-9720-8b43f0df1e05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48cb907899ab4ea4b28ef88c3917d0ac)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:50.212904 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e50a7c-6618-4cf0-9720-8b43f0df1e05 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:50.261034 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-47e50a7c-6618-4cf0-9720-8b43f0df1e05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48cb907899ab4ea4b28ef88c3917d0ac', 'request_id': 'req-47e50a7c-6618-4cf0-9720-8b43f0df1e05'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:50.269233 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-47e50a7c-6618-4cf0-9720-8b43f0df1e05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48cb907899ab4ea4b28ef88c3917d0ac', 'request_id': 'req-47e50a7c-6618-4cf0-9720-8b43f0df1e05'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:50.275028 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-47e50a7c-6618-4cf0-9720-8b43f0df1e05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48cb907899ab4ea4b28ef88c3917d0ac', 'request_id': 'req-47e50a7c-6618-4cf0-9720-8b43f0df1e05'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:50.286333 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-47e50a7c-6618-4cf0-9720-8b43f0df1e05 admin admin] The token cache is being invalidate because project 48cb907899ab4ea4b28ef88c3917d0ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:02:50.286622 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-47e50a7c-6618-4cf0-9720-8b43f0df1e05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:50.287327 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-47e50a7c-6618-4cf0-9720-8b43f0df1e05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:50.289003 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1254/2507] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:02:50 2022] DELETE /identity/v3/projects/48cb907899ab4ea4b28ef88c3917d0ac => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:02:50.294079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80868d-317e-452e-b701-d160d0b69ea9 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:50.294367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80868d-317e-452e-b701-d160d0b69ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:50.294639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80868d-317e-452e-b701-d160d0b69ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:50.315893 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-6e80868d-317e-452e-b701-d160d0b69ea9 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:02:50.317082 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6e80868d-317e-452e-b701-d160d0b69ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:50.381562 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1254/2508] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:02:50.389638 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebd487-2ef7-4913-bc39-91e579cf0c4d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:50.389927 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebd487-2ef7-4913-bc39-91e579cf0c4d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:50.390201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebd487-2ef7-4913-bc39-91e579cf0c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:50.410202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2bebd487-2ef7-4913-bc39-91e579cf0c4d None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:02:50.411422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2bebd487-2ef7-4913-bc39-91e579cf0c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:50.419689 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1255/2509] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:02:50.424925 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80868d-317e-452e-b701-d160d0b69ea9 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:50.440541 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80868d-317e-452e-b701-d160d0b69ea9 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:50.449318 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31fafb-85af-4542-851d-2fd8b007df50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:50.450154 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31fafb-85af-4542-851d-2fd8b007df50 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:50.450551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31fafb-85af-4542-851d-2fd8b007df50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:50.450908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31fafb-85af-4542-851d-2fd8b007df50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:50.451891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31fafb-85af-4542-851d-2fd8b007df50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 12:02:50.452191 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31fafb-85af-4542-851d-2fd8b007df50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:50.454834 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31fafb-85af-4542-851d-2fd8b007df50 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:50.466888 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1255/2510] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 12:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 12:02:50.473264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebd487-2ef7-4913-bc39-91e579cf0c4d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:50.486986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebd487-2ef7-4913-bc39-91e579cf0c4d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:50.492880 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7dd74-f168-4d3e-b5d2-933f96767d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:50.493481 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7dd74-f168-4d3e-b5d2-933f96767d8a admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:50.493755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7dd74-f168-4d3e-b5d2-933f96767d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:50.494022 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7dd74-f168-4d3e-b5d2-933f96767d8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:50.494659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7dd74-f168-4d3e-b5d2-933f96767d8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:50.496622 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7dd74-f168-4d3e-b5d2-933f96767d8a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:50.531973 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1256/2511] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:02:50 2022] POST /identity/v3/projects => generated 405 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:02:50.536577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31fafb-85af-4542-851d-2fd8b007df50 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:50.548131 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31fafb-85af-4542-851d-2fd8b007df50 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:50.602913 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:02:50.617443 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f05993-5ce8-41df-997b-5be0bc23781a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:50.618048 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f05993-5ce8-41df-997b-5be0bc23781a admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:50.618323 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f05993-5ce8-41df-997b-5be0bc23781a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:50.618592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f05993-5ce8-41df-997b-5be0bc23781a admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:50.619212 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f05993-5ce8-41df-997b-5be0bc23781a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:50.621195 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f05993-5ce8-41df-997b-5be0bc23781a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:50.644592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1256/2512] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:02:50 2022] POST /identity/v3/users => generated 303 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:02:50.648898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7dd74-f168-4d3e-b5d2-933f96767d8a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:50.660001 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7dd74-f168-4d3e-b5d2-933f96767d8a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:50.665645 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bf569-0f4c-4064-aaa2-d14d449336ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:50.666285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bf569-0f4c-4064-aaa2-d14d449336ce admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:50.666560 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bf569-0f4c-4064-aaa2-d14d449336ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:50.666828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bf569-0f4c-4064-aaa2-d14d449336ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:50.667506 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bf569-0f4c-4064-aaa2-d14d449336ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:50.669115 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bf569-0f4c-4064-aaa2-d14d449336ce admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:50.680162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1257/2513] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:02:50.684165 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f05993-5ce8-41df-997b-5be0bc23781a admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:50.695322 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f05993-5ce8-41df-997b-5be0bc23781a admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:50.701410 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6814ca-7827-4868-a65a-d0381b32d14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:50.702036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6814ca-7827-4868-a65a-d0381b32d14f admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:50.702297 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6814ca-7827-4868-a65a-d0381b32d14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:50.702563 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6814ca-7827-4868-a65a-d0381b32d14f admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:50.703240 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6814ca-7827-4868-a65a-d0381b32d14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:50.705257 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6814ca-7827-4868-a65a-d0381b32d14f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:50.716621 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1257/2514] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:02:50.721226 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bf569-0f4c-4064-aaa2-d14d449336ce admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:50.731330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bf569-0f4c-4064-aaa2-d14d449336ce admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:50.736557 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8028c-e774-4e4a-a2d0-a53496e1039c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:50.737208 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8028c-e774-4e4a-a2d0-a53496e1039c admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:50.737499 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8028c-e774-4e4a-a2d0-a53496e1039c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:50.737775 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8028c-e774-4e4a-a2d0-a53496e1039c admin admin] PATH_INFO: `/v3/projects/616dc7d46f174510bb26afbfbb724a29/users/7f022828707d496c91be1adc7897e5a9/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:50.752843 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca8028c-e774-4e4a-a2d0-a53496e1039c admin admin] RBAC: Authorizing `identity:create_grant(project_id=616dc7d46f174510bb26afbfbb724a29, user_id=7f022828707d496c91be1adc7897e5a9, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:50.755522 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca8028c-e774-4e4a-a2d0-a53496e1039c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:50.771228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1258/2515] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:02:50 2022] PUT /identity/v3/projects/616dc7d46f174510bb26afbfbb724a29/users/7f022828707d496c91be1adc7897e5a9/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:02:50.781517 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452415cb-d803-4097-a7f7-a21a50fd5ade None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:50.781805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452415cb-d803-4097-a7f7-a21a50fd5ade None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:50.782129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452415cb-d803-4097-a7f7-a21a50fd5ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:50.811395 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-452415cb-d803-4097-a7f7-a21a50fd5ade None None] MFA Rules not processed for user `7f022828707d496c91be1adc7897e5a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:02:50.812616 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-452415cb-d803-4097-a7f7-a21a50fd5ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:50.883481 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1258/2516] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:02:50 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:02:50.888270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8028c-e774-4e4a-a2d0-a53496e1039c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:50.952343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8028c-e774-4e4a-a2d0-a53496e1039c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:50.957808 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6d690-21dd-40e8-a1e7-069b9ddffc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:50.958416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6d690-21dd-40e8-a1e7-069b9ddffc35 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:50.958688 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6d690-21dd-40e8-a1e7-069b9ddffc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:50.958963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6d690-21dd-40e8-a1e7-069b9ddffc35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:50.959627 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6d690-21dd-40e8-a1e7-069b9ddffc35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:50.961528 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6d690-21dd-40e8-a1e7-069b9ddffc35 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:50.967105 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:02:50.994921 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1259/2517] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:02:50 2022] POST /identity/v3/projects => generated 405 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:02:50.999117 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452415cb-d803-4097-a7f7-a21a50fd5ade None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:51.009976 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452415cb-d803-4097-a7f7-a21a50fd5ade None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:51.071235 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c59f0-5a0c-4a08-a8ed-747dca3c94d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:51.071882 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c59f0-5a0c-4a08-a8ed-747dca3c94d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:51.072158 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c59f0-5a0c-4a08-a8ed-747dca3c94d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:51.072422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c59f0-5a0c-4a08-a8ed-747dca3c94d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:51.073067 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c59f0-5a0c-4a08-a8ed-747dca3c94d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:51.074991 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c59f0-5a0c-4a08-a8ed-747dca3c94d6 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:51.099260 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1259/2518] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:02:50 2022] POST /identity/v3/users => generated 309 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 12:02:51.103477 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6d690-21dd-40e8-a1e7-069b9ddffc35 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:51.114586 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6d690-21dd-40e8-a1e7-069b9ddffc35 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:51.119937 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8a018-bd50-449f-addb-b38d6f991509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:51.120544 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8a018-bd50-449f-addb-b38d6f991509 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:51.120845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8a018-bd50-449f-addb-b38d6f991509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:51.121119 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8a018-bd50-449f-addb-b38d6f991509 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:51.121746 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8a018-bd50-449f-addb-b38d6f991509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:51.123373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8a018-bd50-449f-addb-b38d6f991509 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:51.134062 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1260/2519] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 12:02:51.139807 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c59f0-5a0c-4a08-a8ed-747dca3c94d6 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:51.150795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c59f0-5a0c-4a08-a8ed-747dca3c94d6 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:51.156770 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539c3b7-b719-4853-9905-e1dff423213e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:51.157469 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539c3b7-b719-4853-9905-e1dff423213e admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:51.157744 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539c3b7-b719-4853-9905-e1dff423213e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:51.158006 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539c3b7-b719-4853-9905-e1dff423213e admin admin] PATH_INFO: `/v3/projects/17095329a87b48689e9119fc51d32bf1/users/a1abe873c49e4b5cb701e6c81ffb0e52/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:51.175189 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539c3b7-b719-4853-9905-e1dff423213e admin admin] RBAC: Authorizing `identity:create_grant(project_id=17095329a87b48689e9119fc51d32bf1, user_id=a1abe873c49e4b5cb701e6c81ffb0e52, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:51.177941 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539c3b7-b719-4853-9905-e1dff423213e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:51.194681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1260/2520] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:02:51 2022] PUT /identity/v3/projects/17095329a87b48689e9119fc51d32bf1/users/a1abe873c49e4b5cb701e6c81ffb0e52/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:02:51.198506 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8a018-bd50-449f-addb-b38d6f991509 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:51.209595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8a018-bd50-449f-addb-b38d6f991509 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:51.270775 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62a88b-4c61-4124-9abf-d8667f3b19ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:51.271288 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62a88b-4c61-4124-9abf-d8667f3b19ba admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:51.271595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62a88b-4c61-4124-9abf-d8667f3b19ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:51.271864 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62a88b-4c61-4124-9abf-d8667f3b19ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:51.272505 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62a88b-4c61-4124-9abf-d8667f3b19ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:51.274093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62a88b-4c61-4124-9abf-d8667f3b19ba admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:51.284090 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1261/2521] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 12:02:51.288527 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539c3b7-b719-4853-9905-e1dff423213e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:51.300754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539c3b7-b719-4853-9905-e1dff423213e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:51.305507 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce82105-acf1-4fe6-a6dd-49c46930459c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:51.306160 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce82105-acf1-4fe6-a6dd-49c46930459c admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:51.306433 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce82105-acf1-4fe6-a6dd-49c46930459c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:51.306699 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce82105-acf1-4fe6-a6dd-49c46930459c admin admin] PATH_INFO: `/v3/projects/17095329a87b48689e9119fc51d32bf1/users/a1abe873c49e4b5cb701e6c81ffb0e52/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:51.308627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce82105-acf1-4fe6-a6dd-49c46930459c admin admin] RBAC: Authorizing `identity:create_grant(project_id=17095329a87b48689e9119fc51d32bf1, user_id=a1abe873c49e4b5cb701e6c81ffb0e52, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:51.311583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce82105-acf1-4fe6-a6dd-49c46930459c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:51.322211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1261/2522] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:02:51 2022] PUT /identity/v3/projects/17095329a87b48689e9119fc51d32bf1/users/a1abe873c49e4b5cb701e6c81ffb0e52/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:02:51.338359 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a6721-f262-4f90-8ea0-edb42d704504 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:51.338648 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a6721-f262-4f90-8ea0-edb42d704504 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:51.338923 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a6721-f262-4f90-8ea0-edb42d704504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:51.370391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-203a6721-f262-4f90-8ea0-edb42d704504 None None] MFA Rules not processed for user `a1abe873c49e4b5cb701e6c81ffb0e52`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:02:51.371663 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-203a6721-f262-4f90-8ea0-edb42d704504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:51.456595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1262/2523] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:02:51 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:02:51.471468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce82105-acf1-4fe6-a6dd-49c46930459c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:51.473455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9ce82105-acf1-4fe6-a6dd-49c46930459c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:51.483849 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:02:51.537742 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce82105-acf1-4fe6-a6dd-49c46930459c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:51.542032 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a817e38-eb86-4956-bdfb-39fd44e26cc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:51.542639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a817e38-eb86-4956-bdfb-39fd44e26cc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:51.542912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a817e38-eb86-4956-bdfb-39fd44e26cc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:51.543301 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a817e38-eb86-4956-bdfb-39fd44e26cc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:51.553673 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a817e38-eb86-4956-bdfb-39fd44e26cc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:51.555126 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a817e38-eb86-4956-bdfb-39fd44e26cc6 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:51.567205 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1262/2524] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:02:51 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:02:51.714965 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a6721-f262-4f90-8ea0-edb42d704504 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:51.784008 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:02:51.789121 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a6721-f262-4f90-8ea0-edb42d704504 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:51.795102 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3568198-0f8b-4cb5-885f-117aa2918c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:51.795778 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3568198-0f8b-4cb5-885f-117aa2918c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:51.796057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3568198-0f8b-4cb5-885f-117aa2918c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:51.796330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3568198-0f8b-4cb5-885f-117aa2918c8d admin admin] PATH_INFO: `/v3/users/7f022828707d496c91be1adc7897e5a9` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:51.797936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3568198-0f8b-4cb5-885f-117aa2918c8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f022828707d496c91be1adc7897e5a9)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:51.800043 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3568198-0f8b-4cb5-885f-117aa2918c8d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:51.848538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b3568198-0f8b-4cb5-885f-117aa2918c8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f022828707d496c91be1adc7897e5a9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:51.855265 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b3568198-0f8b-4cb5-885f-117aa2918c8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f022828707d496c91be1adc7897e5a9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:51.864027 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b3568198-0f8b-4cb5-885f-117aa2918c8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f022828707d496c91be1adc7897e5a9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:51.876527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b3568198-0f8b-4cb5-885f-117aa2918c8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f022828707d496c91be1adc7897e5a9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:51.877811 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b3568198-0f8b-4cb5-885f-117aa2918c8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f022828707d496c91be1adc7897e5a9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:51.883957 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1263/2525] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:02:51 2022] DELETE /identity/v3/users/7f022828707d496c91be1adc7897e5a9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:02:51.888717 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116779b-2c72-49c2-8066-9e07c26b8363 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:51.889220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116779b-2c72-49c2-8066-9e07c26b8363 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:51.889220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116779b-2c72-49c2-8066-9e07c26b8363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:51.909702 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2116779b-2c72-49c2-8066-9e07c26b8363 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:02:51.910954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2116779b-2c72-49c2-8066-9e07c26b8363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:51.976954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1263/2526] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:02:51.987092 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3568198-0f8b-4cb5-885f-117aa2918c8d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:51.988649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b3568198-0f8b-4cb5-885f-117aa2918c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:52.054663 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3568198-0f8b-4cb5-885f-117aa2918c8d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:52.059210 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68048a-138d-49ec-849d-23a39bff3fe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:52.059847 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68048a-138d-49ec-849d-23a39bff3fe7 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:52.060123 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68048a-138d-49ec-849d-23a39bff3fe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:52.060392 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68048a-138d-49ec-849d-23a39bff3fe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:52.070691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68048a-138d-49ec-849d-23a39bff3fe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:52.072202 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68048a-138d-49ec-849d-23a39bff3fe7 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:52.081966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1264/2527] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:02:52.358708 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116779b-2c72-49c2-8066-9e07c26b8363 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:52.360201 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2116779b-2c72-49c2-8066-9e07c26b8363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:52.374437 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116779b-2c72-49c2-8066-9e07c26b8363 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:52.379661 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530e75c-5a56-4811-8b8a-899503d81d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:52.380316 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530e75c-5a56-4811-8b8a-899503d81d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:52.380594 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530e75c-5a56-4811-8b8a-899503d81d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:52.380866 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530e75c-5a56-4811-8b8a-899503d81d63 admin admin] PATH_INFO: `/v3/projects/616dc7d46f174510bb26afbfbb724a29` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:52.382073 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530e75c-5a56-4811-8b8a-899503d81d63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=616dc7d46f174510bb26afbfbb724a29)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:52.384667 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530e75c-5a56-4811-8b8a-899503d81d63 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:52.436093 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b530e75c-5a56-4811-8b8a-899503d81d63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '616dc7d46f174510bb26afbfbb724a29', 'request_id': 'req-b530e75c-5a56-4811-8b8a-899503d81d63'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:52.442387 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b530e75c-5a56-4811-8b8a-899503d81d63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '616dc7d46f174510bb26afbfbb724a29', 'request_id': 'req-b530e75c-5a56-4811-8b8a-899503d81d63'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:52.448485 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b530e75c-5a56-4811-8b8a-899503d81d63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '616dc7d46f174510bb26afbfbb724a29', 'request_id': 'req-b530e75c-5a56-4811-8b8a-899503d81d63'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:52.464745 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b530e75c-5a56-4811-8b8a-899503d81d63 admin admin] The token cache is being invalidate because project 616dc7d46f174510bb26afbfbb724a29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:02:52.465040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b530e75c-5a56-4811-8b8a-899503d81d63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:52.465679 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-b530e75c-5a56-4811-8b8a-899503d81d63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:52.467195 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1264/2528] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:02:52 2022] DELETE /identity/v3/projects/616dc7d46f174510bb26afbfbb724a29 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:02:52.471308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68048a-138d-49ec-849d-23a39bff3fe7 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:52.482312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68048a-138d-49ec-849d-23a39bff3fe7 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:52.542867 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e47c8-78a2-4d1b-9e5e-60d16b429936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:52.543562 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e47c8-78a2-4d1b-9e5e-60d16b429936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:52.543840 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e47c8-78a2-4d1b-9e5e-60d16b429936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:52.544107 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e47c8-78a2-4d1b-9e5e-60d16b429936 admin admin] PATH_INFO: `/v3/users/a1abe873c49e4b5cb701e6c81ffb0e52` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:52.545328 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e47c8-78a2-4d1b-9e5e-60d16b429936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1abe873c49e4b5cb701e6c81ffb0e52)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:52.547671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e47c8-78a2-4d1b-9e5e-60d16b429936 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:52.571339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:02:52.608113 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bd3e47c8-78a2-4d1b-9e5e-60d16b429936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1abe873c49e4b5cb701e6c81ffb0e52'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:52.616087 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bd3e47c8-78a2-4d1b-9e5e-60d16b429936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1abe873c49e4b5cb701e6c81ffb0e52'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:52.624369 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bd3e47c8-78a2-4d1b-9e5e-60d16b429936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1abe873c49e4b5cb701e6c81ffb0e52'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:52.636942 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bd3e47c8-78a2-4d1b-9e5e-60d16b429936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1abe873c49e4b5cb701e6c81ffb0e52'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:52.637702 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bd3e47c8-78a2-4d1b-9e5e-60d16b429936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1abe873c49e4b5cb701e6c81ffb0e52'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:52.644020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1265/2529] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:02:52 2022] DELETE /identity/v3/users/a1abe873c49e4b5cb701e6c81ffb0e52 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:02:53.163729 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530e75c-5a56-4811-8b8a-899503d81d63 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:53.165185 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-b530e75c-5a56-4811-8b8a-899503d81d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:53.182484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530e75c-5a56-4811-8b8a-899503d81d63 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:53.227570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:02:53.262263 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c4f77-2b57-4203-8d1b-8afe3ecf8ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:53.262914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c4f77-2b57-4203-8d1b-8afe3ecf8ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:53.263187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c4f77-2b57-4203-8d1b-8afe3ecf8ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:53.263502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c4f77-2b57-4203-8d1b-8afe3ecf8ae8 admin admin] PATH_INFO: `/v3/projects/17095329a87b48689e9119fc51d32bf1` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:53.264634 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c4f77-2b57-4203-8d1b-8afe3ecf8ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17095329a87b48689e9119fc51d32bf1)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:53.266618 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c4f77-2b57-4203-8d1b-8afe3ecf8ae8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:53.318696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-209c4f77-2b57-4203-8d1b-8afe3ecf8ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17095329a87b48689e9119fc51d32bf1', 'request_id': 'req-209c4f77-2b57-4203-8d1b-8afe3ecf8ae8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:53.327465 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-209c4f77-2b57-4203-8d1b-8afe3ecf8ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17095329a87b48689e9119fc51d32bf1', 'request_id': 'req-209c4f77-2b57-4203-8d1b-8afe3ecf8ae8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:53.333949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-209c4f77-2b57-4203-8d1b-8afe3ecf8ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17095329a87b48689e9119fc51d32bf1', 'request_id': 'req-209c4f77-2b57-4203-8d1b-8afe3ecf8ae8'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:53.352704 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-209c4f77-2b57-4203-8d1b-8afe3ecf8ae8 admin admin] The token cache is being invalidate because project 17095329a87b48689e9119fc51d32bf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:02:53.352704 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-209c4f77-2b57-4203-8d1b-8afe3ecf8ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:53.353153 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-209c4f77-2b57-4203-8d1b-8afe3ecf8ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:53.355620 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1265/2530] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:02:53 2022] DELETE /identity/v3/projects/17095329a87b48689e9119fc51d32bf1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:02:53.361119 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424e778-e399-4901-a5c7-3a52f45da657 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:53.362167 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424e778-e399-4901-a5c7-3a52f45da657 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:53.362570 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424e778-e399-4901-a5c7-3a52f45da657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:53.388627 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2424e778-e399-4901-a5c7-3a52f45da657 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:02:53.390082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2424e778-e399-4901-a5c7-3a52f45da657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:53.470153 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1266/2531] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:02:53.478637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178854b5-53f3-4590-985e-934a0c9a3687 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:53.478933 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178854b5-53f3-4590-985e-934a0c9a3687 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:53.479184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178854b5-53f3-4590-985e-934a0c9a3687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:53.500942 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-178854b5-53f3-4590-985e-934a0c9a3687 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:02:53.502481 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-178854b5-53f3-4590-985e-934a0c9a3687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:53.514592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1266/2532] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:02:53.516050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424e778-e399-4901-a5c7-3a52f45da657 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:53.526716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424e778-e399-4901-a5c7-3a52f45da657 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:53.531835 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c43a3-e31a-4578-b067-cc1f35bbad81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:53.532483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c43a3-e31a-4578-b067-cc1f35bbad81 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:53.532759 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c43a3-e31a-4578-b067-cc1f35bbad81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:53.533235 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c43a3-e31a-4578-b067-cc1f35bbad81 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:53.533919 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c43a3-e31a-4578-b067-cc1f35bbad81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 12:02:53.534221 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c43a3-e31a-4578-b067-cc1f35bbad81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:53.535865 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c43a3-e31a-4578-b067-cc1f35bbad81 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:53.552967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1267/2533] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 12:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 12:02:53.554328 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178854b5-53f3-4590-985e-934a0c9a3687 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:53.564578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178854b5-53f3-4590-985e-934a0c9a3687 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:53.569499 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f765fed-9dc2-45b1-bd2c-97faa750b523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:53.570148 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f765fed-9dc2-45b1-bd2c-97faa750b523 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:53.570431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f765fed-9dc2-45b1-bd2c-97faa750b523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:53.570706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f765fed-9dc2-45b1-bd2c-97faa750b523 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:53.571381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f765fed-9dc2-45b1-bd2c-97faa750b523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:53.573308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f765fed-9dc2-45b1-bd2c-97faa750b523 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:53.608350 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1267/2534] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:02:53 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:02:53.609661 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c43a3-e31a-4578-b067-cc1f35bbad81 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:53.620316 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c43a3-e31a-4578-b067-cc1f35bbad81 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:53.683910 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eac514-de75-46a7-a2f7-2cb27711fafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:53.684530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eac514-de75-46a7-a2f7-2cb27711fafd admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:53.684819 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eac514-de75-46a7-a2f7-2cb27711fafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:53.685086 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eac514-de75-46a7-a2f7-2cb27711fafd admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:53.685868 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eac514-de75-46a7-a2f7-2cb27711fafd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:53.687864 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eac514-de75-46a7-a2f7-2cb27711fafd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:53.714223 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1268/2535] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:02:53 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:02:53.715599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f765fed-9dc2-45b1-bd2c-97faa750b523 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:53.728934 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f765fed-9dc2-45b1-bd2c-97faa750b523 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:53.733679 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a18928-9be3-4c41-87dd-aa2bf879f6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:53.734358 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a18928-9be3-4c41-87dd-aa2bf879f6aa admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:53.734699 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a18928-9be3-4c41-87dd-aa2bf879f6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:53.734976 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a18928-9be3-4c41-87dd-aa2bf879f6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:53.735647 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a18928-9be3-4c41-87dd-aa2bf879f6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:53.737389 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a18928-9be3-4c41-87dd-aa2bf879f6aa admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:53.750873 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1268/2536] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:02:53.752894 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eac514-de75-46a7-a2f7-2cb27711fafd admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:53.762824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eac514-de75-46a7-a2f7-2cb27711fafd admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:53.767691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577914b-10cf-4921-ac10-db9da702278c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:53.768317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577914b-10cf-4921-ac10-db9da702278c admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:53.768626 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577914b-10cf-4921-ac10-db9da702278c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:53.768848 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577914b-10cf-4921-ac10-db9da702278c admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:53.769523 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577914b-10cf-4921-ac10-db9da702278c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:53.771101 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577914b-10cf-4921-ac10-db9da702278c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:53.782809 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1269/2537] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:02:53.786963 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a18928-9be3-4c41-87dd-aa2bf879f6aa admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:53.798062 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a18928-9be3-4c41-87dd-aa2bf879f6aa admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:53.803582 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368aef0-d028-4a5c-b334-2f3f7dc7afee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:53.804245 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368aef0-d028-4a5c-b334-2f3f7dc7afee admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:53.804524 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368aef0-d028-4a5c-b334-2f3f7dc7afee admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:53.804790 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368aef0-d028-4a5c-b334-2f3f7dc7afee admin admin] PATH_INFO: `/v3/projects/bc910f080c7a45ffb7fb7e72f394c73c/users/c73aa95f55664330af3d8431d9be4de5/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:53.825376 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368aef0-d028-4a5c-b334-2f3f7dc7afee admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc910f080c7a45ffb7fb7e72f394c73c, user_id=c73aa95f55664330af3d8431d9be4de5, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:53.828109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368aef0-d028-4a5c-b334-2f3f7dc7afee admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:53.842966 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1269/2538] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:02:53 2022] PUT /identity/v3/projects/bc910f080c7a45ffb7fb7e72f394c73c/users/c73aa95f55664330af3d8431d9be4de5/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:02:53.853954 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04ff58-46df-45ec-816f-5567e2917884 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:53.854240 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04ff58-46df-45ec-816f-5567e2917884 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:53.854510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04ff58-46df-45ec-816f-5567e2917884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:53.863332 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:02:53.886479 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bf04ff58-46df-45ec-816f-5567e2917884 None None] MFA Rules not processed for user `c73aa95f55664330af3d8431d9be4de5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:02:53.887777 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bf04ff58-46df-45ec-816f-5567e2917884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:53.957777 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1270/2539] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:02:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:02:53.962468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368aef0-d028-4a5c-b334-2f3f7dc7afee admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:54.027772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368aef0-d028-4a5c-b334-2f3f7dc7afee admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:54.032830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe923d-d8c8-4c78-9749-239e31d670a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:54.033440 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe923d-d8c8-4c78-9749-239e31d670a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:54.033714 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe923d-d8c8-4c78-9749-239e31d670a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:54.033980 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe923d-d8c8-4c78-9749-239e31d670a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:54.034642 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe923d-d8c8-4c78-9749-239e31d670a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:54.036693 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe923d-d8c8-4c78-9749-239e31d670a8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:54.041478 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:02:54.071436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1270/2540] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:02:53 2022] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:02:54.073125 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04ff58-46df-45ec-816f-5567e2917884 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:54.084882 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04ff58-46df-45ec-816f-5567e2917884 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:54.146749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b4372-20e6-4878-af5f-68f3911be91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:54.147348 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b4372-20e6-4878-af5f-68f3911be91f admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:54.147630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b4372-20e6-4878-af5f-68f3911be91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:54.147918 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b4372-20e6-4878-af5f-68f3911be91f admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:54.148532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b4372-20e6-4878-af5f-68f3911be91f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:54.150455 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b4372-20e6-4878-af5f-68f3911be91f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:54.177730 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1271/2541] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:02:54 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:02:54.179085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe923d-d8c8-4c78-9749-239e31d670a8 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:54.189970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe923d-d8c8-4c78-9749-239e31d670a8 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:54.195685 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39549700-bfe2-4ab4-9625-2a5b39067df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:54.196285 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39549700-bfe2-4ab4-9625-2a5b39067df9 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:54.196592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39549700-bfe2-4ab4-9625-2a5b39067df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:54.196826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39549700-bfe2-4ab4-9625-2a5b39067df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:54.197525 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39549700-bfe2-4ab4-9625-2a5b39067df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:54.200167 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39549700-bfe2-4ab4-9625-2a5b39067df9 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:54.210145 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1271/2542] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:02:54.214314 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b4372-20e6-4878-af5f-68f3911be91f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:54.224389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b4372-20e6-4878-af5f-68f3911be91f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:54.228978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4325ff-6211-4346-9a7a-7059a62aae0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:54.229643 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4325ff-6211-4346-9a7a-7059a62aae0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:54.229917 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4325ff-6211-4346-9a7a-7059a62aae0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:54.230184 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4325ff-6211-4346-9a7a-7059a62aae0d admin admin] PATH_INFO: `/v3/projects/76ff8f6f1465484aa26da1f24c960478/users/759a5e7cd58148b38ee01f0d56d4de69/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:54.246132 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4325ff-6211-4346-9a7a-7059a62aae0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ff8f6f1465484aa26da1f24c960478, user_id=759a5e7cd58148b38ee01f0d56d4de69, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:54.248874 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4325ff-6211-4346-9a7a-7059a62aae0d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:54.264951 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1272/2543] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:02:54 2022] PUT /identity/v3/projects/76ff8f6f1465484aa26da1f24c960478/users/759a5e7cd58148b38ee01f0d56d4de69/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:02:54.269127 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39549700-bfe2-4ab4-9625-2a5b39067df9 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:54.279747 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39549700-bfe2-4ab4-9625-2a5b39067df9 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:54.342788 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e84ac4-257d-4cc5-b4d2-40f4f062140f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:54.343451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e84ac4-257d-4cc5-b4d2-40f4f062140f admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:54.343726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e84ac4-257d-4cc5-b4d2-40f4f062140f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:54.343995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e84ac4-257d-4cc5-b4d2-40f4f062140f admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:54.344634 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e84ac4-257d-4cc5-b4d2-40f4f062140f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:54.346353 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e84ac4-257d-4cc5-b4d2-40f4f062140f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:54.356706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1272/2544] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:02:54.360797 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4325ff-6211-4346-9a7a-7059a62aae0d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:54.371626 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4325ff-6211-4346-9a7a-7059a62aae0d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:54.377373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8938aa-aab5-41bb-8a9b-a5092e709a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:54.378286 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8938aa-aab5-41bb-8a9b-a5092e709a04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:54.378460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8938aa-aab5-41bb-8a9b-a5092e709a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:54.378615 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8938aa-aab5-41bb-8a9b-a5092e709a04 admin admin] PATH_INFO: `/v3/projects/76ff8f6f1465484aa26da1f24c960478/users/759a5e7cd58148b38ee01f0d56d4de69/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:54.380653 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8938aa-aab5-41bb-8a9b-a5092e709a04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ff8f6f1465484aa26da1f24c960478, user_id=759a5e7cd58148b38ee01f0d56d4de69, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:54.385323 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8938aa-aab5-41bb-8a9b-a5092e709a04 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:54.398150 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1273/2545] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:02:54 2022] PUT /identity/v3/projects/76ff8f6f1465484aa26da1f24c960478/users/759a5e7cd58148b38ee01f0d56d4de69/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:02:54.409830 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6bc01-4414-4bbd-80f5-1babb5a165ad None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:54.410395 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6bc01-4414-4bbd-80f5-1babb5a165ad None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:54.410875 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6bc01-4414-4bbd-80f5-1babb5a165ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:54.443325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-82a6bc01-4414-4bbd-80f5-1babb5a165ad None None] MFA Rules not processed for user `759a5e7cd58148b38ee01f0d56d4de69`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:02:54.444480 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-82a6bc01-4414-4bbd-80f5-1babb5a165ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:54.521607 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1273/2546] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:02:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:02:54.534085 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8938aa-aab5-41bb-8a9b-a5092e709a04 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:54.536454 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-be8938aa-aab5-41bb-8a9b-a5092e709a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:54.613953 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:02:54.620091 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8938aa-aab5-41bb-8a9b-a5092e709a04 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:54.625422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cec1e-d446-4377-a61f-f4f0d3435771 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:54.626612 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cec1e-d446-4377-a61f-f4f0d3435771 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:54.627114 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cec1e-d446-4377-a61f-f4f0d3435771 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:54.631824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cec1e-d446-4377-a61f-f4f0d3435771 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:54.642776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cec1e-d446-4377-a61f-f4f0d3435771 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:54.644664 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cec1e-d446-4377-a61f-f4f0d3435771 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:54.655952 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1274/2547] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:02:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:02:55.206630 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6bc01-4414-4bbd-80f5-1babb5a165ad None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:55.271225 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:02:55.276134 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6bc01-4414-4bbd-80f5-1babb5a165ad None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:55.282958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44052a4f-99ec-4b14-ae41-9d13800b0649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:55.283725 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44052a4f-99ec-4b14-ae41-9d13800b0649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:55.284957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44052a4f-99ec-4b14-ae41-9d13800b0649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:55.285240 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44052a4f-99ec-4b14-ae41-9d13800b0649 admin admin] PATH_INFO: `/v3/users/c73aa95f55664330af3d8431d9be4de5` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:55.288132 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44052a4f-99ec-4b14-ae41-9d13800b0649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c73aa95f55664330af3d8431d9be4de5)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:55.290092 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44052a4f-99ec-4b14-ae41-9d13800b0649 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:55.361600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-44052a4f-99ec-4b14-ae41-9d13800b0649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c73aa95f55664330af3d8431d9be4de5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:55.372960 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-44052a4f-99ec-4b14-ae41-9d13800b0649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c73aa95f55664330af3d8431d9be4de5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:55.383656 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-44052a4f-99ec-4b14-ae41-9d13800b0649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c73aa95f55664330af3d8431d9be4de5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:55.384602 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-44052a4f-99ec-4b14-ae41-9d13800b0649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c73aa95f55664330af3d8431d9be4de5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:55.397822 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-44052a4f-99ec-4b14-ae41-9d13800b0649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c73aa95f55664330af3d8431d9be4de5'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:55.404033 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1274/2548] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:02:55 2022] DELETE /identity/v3/users/c73aa95f55664330af3d8431d9be4de5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:02:55.409078 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17aca8-a7d7-4f7b-9318-14a0e8c88c57 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:55.409450 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17aca8-a7d7-4f7b-9318-14a0e8c88c57 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:55.409789 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17aca8-a7d7-4f7b-9318-14a0e8c88c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:55.429115 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0c17aca8-a7d7-4f7b-9318-14a0e8c88c57 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:02:55.430391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0c17aca8-a7d7-4f7b-9318-14a0e8c88c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:55.495464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1275/2549] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:02:55.502488 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44052a4f-99ec-4b14-ae41-9d13800b0649 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:55.504083 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-44052a4f-99ec-4b14-ae41-9d13800b0649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:55.576883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44052a4f-99ec-4b14-ae41-9d13800b0649 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:55.581649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5c200-d20d-4ca1-a96e-e347bda423b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:55.582280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5c200-d20d-4ca1-a96e-e347bda423b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:55.582556 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5c200-d20d-4ca1-a96e-e347bda423b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:55.582820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5c200-d20d-4ca1-a96e-e347bda423b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:55.608156 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5c200-d20d-4ca1-a96e-e347bda423b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:55.609680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5c200-d20d-4ca1-a96e-e347bda423b8 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:55.622006 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1275/2550] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:02:55.959488 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17aca8-a7d7-4f7b-9318-14a0e8c88c57 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:55.961804 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0c17aca8-a7d7-4f7b-9318-14a0e8c88c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:55.977275 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17aca8-a7d7-4f7b-9318-14a0e8c88c57 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:55.982000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abba709-d8d7-45d6-b11b-50759ee87d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:55.982645 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abba709-d8d7-45d6-b11b-50759ee87d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:55.983736 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abba709-d8d7-45d6-b11b-50759ee87d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:55.984016 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abba709-d8d7-45d6-b11b-50759ee87d6b admin admin] PATH_INFO: `/v3/projects/bc910f080c7a45ffb7fb7e72f394c73c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:55.985139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abba709-d8d7-45d6-b11b-50759ee87d6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc910f080c7a45ffb7fb7e72f394c73c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:55.987581 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abba709-d8d7-45d6-b11b-50759ee87d6b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:56.039319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7abba709-d8d7-45d6-b11b-50759ee87d6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc910f080c7a45ffb7fb7e72f394c73c', 'request_id': 'req-7abba709-d8d7-45d6-b11b-50759ee87d6b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:56.047892 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7abba709-d8d7-45d6-b11b-50759ee87d6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc910f080c7a45ffb7fb7e72f394c73c', 'request_id': 'req-7abba709-d8d7-45d6-b11b-50759ee87d6b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:56.054521 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7abba709-d8d7-45d6-b11b-50759ee87d6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc910f080c7a45ffb7fb7e72f394c73c', 'request_id': 'req-7abba709-d8d7-45d6-b11b-50759ee87d6b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:56.066681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7abba709-d8d7-45d6-b11b-50759ee87d6b admin admin] The token cache is being invalidate because project bc910f080c7a45ffb7fb7e72f394c73c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:02:56.067037 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7abba709-d8d7-45d6-b11b-50759ee87d6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:56.067875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7abba709-d8d7-45d6-b11b-50759ee87d6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:56.069388 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1276/2551] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:02:55 2022] DELETE /identity/v3/projects/bc910f080c7a45ffb7fb7e72f394c73c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:02:56.073356 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5c200-d20d-4ca1-a96e-e347bda423b8 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:56.083347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5c200-d20d-4ca1-a96e-e347bda423b8 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:56.150626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae2d11-4431-4d42-983e-298816e1f45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:56.151438 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae2d11-4431-4d42-983e-298816e1f45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:56.151722 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae2d11-4431-4d42-983e-298816e1f45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:56.151999 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae2d11-4431-4d42-983e-298816e1f45b admin admin] PATH_INFO: `/v3/users/759a5e7cd58148b38ee01f0d56d4de69` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:56.153457 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae2d11-4431-4d42-983e-298816e1f45b admin admin] RBAC: Authorizing `identity:delete_user(user_id=759a5e7cd58148b38ee01f0d56d4de69)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:56.155605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae2d11-4431-4d42-983e-298816e1f45b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:56.179513 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:02:56.209583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fbae2d11-4431-4d42-983e-298816e1f45b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '759a5e7cd58148b38ee01f0d56d4de69'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:56.217221 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fbae2d11-4431-4d42-983e-298816e1f45b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '759a5e7cd58148b38ee01f0d56d4de69'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:56.226919 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fbae2d11-4431-4d42-983e-298816e1f45b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '759a5e7cd58148b38ee01f0d56d4de69'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:56.227827 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fbae2d11-4431-4d42-983e-298816e1f45b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '759a5e7cd58148b38ee01f0d56d4de69'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:56.243915 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-fbae2d11-4431-4d42-983e-298816e1f45b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '759a5e7cd58148b38ee01f0d56d4de69'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:56.250546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1276/2552] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:02:56 2022] DELETE /identity/v3/users/759a5e7cd58148b38ee01f0d56d4de69 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:02:56.542116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abba709-d8d7-45d6-b11b-50759ee87d6b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:56.543763 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7abba709-d8d7-45d6-b11b-50759ee87d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:56.559568 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abba709-d8d7-45d6-b11b-50759ee87d6b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:56.621388 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a65717-7db4-4306-affa-18be1f4eb5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:56.622028 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a65717-7db4-4306-affa-18be1f4eb5e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:56.622311 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a65717-7db4-4306-affa-18be1f4eb5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:56.622588 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a65717-7db4-4306-affa-18be1f4eb5e1 admin admin] PATH_INFO: `/v3/projects/76ff8f6f1465484aa26da1f24c960478` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:56.623755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a65717-7db4-4306-affa-18be1f4eb5e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76ff8f6f1465484aa26da1f24c960478)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:56.625738 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a65717-7db4-4306-affa-18be1f4eb5e1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:56.642653 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:02:56.677483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a0a65717-7db4-4306-affa-18be1f4eb5e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76ff8f6f1465484aa26da1f24c960478', 'request_id': 'req-a0a65717-7db4-4306-affa-18be1f4eb5e1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:56.686767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a0a65717-7db4-4306-affa-18be1f4eb5e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76ff8f6f1465484aa26da1f24c960478', 'request_id': 'req-a0a65717-7db4-4306-affa-18be1f4eb5e1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:56.692812 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a0a65717-7db4-4306-affa-18be1f4eb5e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76ff8f6f1465484aa26da1f24c960478', 'request_id': 'req-a0a65717-7db4-4306-affa-18be1f4eb5e1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:56.704351 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a0a65717-7db4-4306-affa-18be1f4eb5e1 admin admin] The token cache is being invalidate because project 76ff8f6f1465484aa26da1f24c960478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:02:56.704641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a0a65717-7db4-4306-affa-18be1f4eb5e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:56.705379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a0a65717-7db4-4306-affa-18be1f4eb5e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:02:56.707032 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1277/2553] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:02:56 2022] DELETE /identity/v3/projects/76ff8f6f1465484aa26da1f24c960478 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:02:56.712142 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba169f5-7b17-4d52-bd3c-4f141e698a83 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:56.712432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba169f5-7b17-4d52-bd3c-4f141e698a83 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:56.712736 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba169f5-7b17-4d52-bd3c-4f141e698a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:56.733681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-6ba169f5-7b17-4d52-bd3c-4f141e698a83 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:02:56.734932 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6ba169f5-7b17-4d52-bd3c-4f141e698a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:56.797323 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1277/2554] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:02:56.809878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc360421-9e17-47eb-8967-2bfdbb46bc82 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:56.810197 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc360421-9e17-47eb-8967-2bfdbb46bc82 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:56.810572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc360421-9e17-47eb-8967-2bfdbb46bc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:56.833421 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cc360421-9e17-47eb-8967-2bfdbb46bc82 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:02:56.834591 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cc360421-9e17-47eb-8967-2bfdbb46bc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:56.842822 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1278/2555] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:02:56.847635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba169f5-7b17-4d52-bd3c-4f141e698a83 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:56.857964 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba169f5-7b17-4d52-bd3c-4f141e698a83 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:56.863061 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fc071-d7a8-4dc6-860e-91b384ddb367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:56.863702 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fc071-d7a8-4dc6-860e-91b384ddb367 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:56.863978 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fc071-d7a8-4dc6-860e-91b384ddb367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:56.864242 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fc071-d7a8-4dc6-860e-91b384ddb367 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:56.864878 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fc071-d7a8-4dc6-860e-91b384ddb367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 12:02:56.865175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fc071-d7a8-4dc6-860e-91b384ddb367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:56.866817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fc071-d7a8-4dc6-860e-91b384ddb367 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:56.878658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1278/2556] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 12:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 12:02:56.883134 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc360421-9e17-47eb-8967-2bfdbb46bc82 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:56.892979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc360421-9e17-47eb-8967-2bfdbb46bc82 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:56.898364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1f537-0fb0-4feb-8aa6-a38d5ac0a73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:56.898953 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1f537-0fb0-4feb-8aa6-a38d5ac0a73b admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:56.899228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1f537-0fb0-4feb-8aa6-a38d5ac0a73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:56.899530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1f537-0fb0-4feb-8aa6-a38d5ac0a73b admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:56.900155 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1f537-0fb0-4feb-8aa6-a38d5ac0a73b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:56.902043 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1f537-0fb0-4feb-8aa6-a38d5ac0a73b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:56.931178 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1279/2557] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:02:56 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:02:56.935333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fc071-d7a8-4dc6-860e-91b384ddb367 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:56.945275 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fc071-d7a8-4dc6-860e-91b384ddb367 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:57.005959 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0aec4-1697-49e5-bba9-02a84ff19051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:57.006571 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0aec4-1697-49e5-bba9-02a84ff19051 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:57.006853 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0aec4-1697-49e5-bba9-02a84ff19051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:57.007120 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0aec4-1697-49e5-bba9-02a84ff19051 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:57.007772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0aec4-1697-49e5-bba9-02a84ff19051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:57.009730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0aec4-1697-49e5-bba9-02a84ff19051 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:57.032692 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1279/2558] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:02:56 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:02:57.038834 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1f537-0fb0-4feb-8aa6-a38d5ac0a73b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:57.049933 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1f537-0fb0-4feb-8aa6-a38d5ac0a73b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:57.054610 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e471c81-b5a8-47ae-a767-5ca158488f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:57.055232 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e471c81-b5a8-47ae-a767-5ca158488f69 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:57.055543 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e471c81-b5a8-47ae-a767-5ca158488f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:57.055841 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e471c81-b5a8-47ae-a767-5ca158488f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:57.056480 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e471c81-b5a8-47ae-a767-5ca158488f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:57.058081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e471c81-b5a8-47ae-a767-5ca158488f69 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:57.068496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1280/2559] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:02:57.072652 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0aec4-1697-49e5-bba9-02a84ff19051 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:57.083820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0aec4-1697-49e5-bba9-02a84ff19051 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:57.089150 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f3ac7-28ad-46db-92d0-1005338bf4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:57.089747 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f3ac7-28ad-46db-92d0-1005338bf4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:57.090047 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f3ac7-28ad-46db-92d0-1005338bf4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:57.090316 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f3ac7-28ad-46db-92d0-1005338bf4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:57.090951 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f3ac7-28ad-46db-92d0-1005338bf4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:57.092587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f3ac7-28ad-46db-92d0-1005338bf4b3 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:57.106439 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1280/2560] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:02:57.107715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e471c81-b5a8-47ae-a767-5ca158488f69 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:57.120063 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e471c81-b5a8-47ae-a767-5ca158488f69 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:57.125778 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3715777-da8e-4002-b980-c6787b02f5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:57.126442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3715777-da8e-4002-b980-c6787b02f5f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:57.126720 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3715777-da8e-4002-b980-c6787b02f5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:57.126989 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3715777-da8e-4002-b980-c6787b02f5f5 admin admin] PATH_INFO: `/v3/projects/568b8e9951b648abbe9251c52c6c6e93/users/2871c9ed3c4e4dff8b57508cf15f1539/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:57.143379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3715777-da8e-4002-b980-c6787b02f5f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=568b8e9951b648abbe9251c52c6c6e93, user_id=2871c9ed3c4e4dff8b57508cf15f1539, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:57.146189 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3715777-da8e-4002-b980-c6787b02f5f5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:57.161958 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1281/2561] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:02:57 2022] PUT /identity/v3/projects/568b8e9951b648abbe9251c52c6c6e93/users/2871c9ed3c4e4dff8b57508cf15f1539/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:02:57.174296 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda3a90-fcc4-4593-9941-55a6182bdc50 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:57.174715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda3a90-fcc4-4593-9941-55a6182bdc50 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:57.174981 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda3a90-fcc4-4593-9941-55a6182bdc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:57.182529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:02:57.207839 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-6cda3a90-fcc4-4593-9941-55a6182bdc50 None None] MFA Rules not processed for user `2871c9ed3c4e4dff8b57508cf15f1539`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:02:57.209052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-6cda3a90-fcc4-4593-9941-55a6182bdc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:57.277628 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1281/2562] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:02:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 12:02:57.282432 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3715777-da8e-4002-b980-c6787b02f5f5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:57.357632 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3715777-da8e-4002-b980-c6787b02f5f5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:57.362813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a29aaa-30ed-4ae6-9dc2-3d9d70d0fdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:57.363463 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a29aaa-30ed-4ae6-9dc2-3d9d70d0fdf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:57.363756 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a29aaa-30ed-4ae6-9dc2-3d9d70d0fdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:57.364048 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a29aaa-30ed-4ae6-9dc2-3d9d70d0fdf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:57.364727 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a29aaa-30ed-4ae6-9dc2-3d9d70d0fdf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:57.366636 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a29aaa-30ed-4ae6-9dc2-3d9d70d0fdf2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:57.400769 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1282/2563] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:02:57 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:02:57.405136 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda3a90-fcc4-4593-9941-55a6182bdc50 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:57.418139 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda3a90-fcc4-4593-9941-55a6182bdc50 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:57.478283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053650b-5c69-4d93-9006-714dc23c6ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:57.478899 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053650b-5c69-4d93-9006-714dc23c6ebe admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:57.479200 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053650b-5c69-4d93-9006-714dc23c6ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:57.479503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053650b-5c69-4d93-9006-714dc23c6ebe admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:57.480206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053650b-5c69-4d93-9006-714dc23c6ebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:57.482130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053650b-5c69-4d93-9006-714dc23c6ebe admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:57.505442 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1282/2564] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:02:57 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:02:57.509505 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a29aaa-30ed-4ae6-9dc2-3d9d70d0fdf2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:57.519921 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a29aaa-30ed-4ae6-9dc2-3d9d70d0fdf2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:57.524609 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa9c20-0aa8-4952-b0db-6841c6112bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:57.525206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa9c20-0aa8-4952-b0db-6841c6112bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:57.525481 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa9c20-0aa8-4952-b0db-6841c6112bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:57.525749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa9c20-0aa8-4952-b0db-6841c6112bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:57.526382 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa9c20-0aa8-4952-b0db-6841c6112bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:57.528017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa9c20-0aa8-4952-b0db-6841c6112bc2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:57.538640 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1283/2565] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:02:57.542779 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053650b-5c69-4d93-9006-714dc23c6ebe admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:57.553615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053650b-5c69-4d93-9006-714dc23c6ebe admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:57.558348 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c78ea-fb3d-412f-bd09-c03499efb596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:57.558987 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c78ea-fb3d-412f-bd09-c03499efb596 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:57.559264 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c78ea-fb3d-412f-bd09-c03499efb596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:57.559552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c78ea-fb3d-412f-bd09-c03499efb596 admin admin] PATH_INFO: `/v3/projects/39c44a1fff6a476188426941cca50a2f/users/9d64f47a178348b58382729f48eb8724/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:57.575479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c78ea-fb3d-412f-bd09-c03499efb596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39c44a1fff6a476188426941cca50a2f, user_id=9d64f47a178348b58382729f48eb8724, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:57.578559 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c78ea-fb3d-412f-bd09-c03499efb596 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:57.598371 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1283/2566] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:02:57 2022] PUT /identity/v3/projects/39c44a1fff6a476188426941cca50a2f/users/9d64f47a178348b58382729f48eb8724/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:02:57.602550 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa9c20-0aa8-4952-b0db-6841c6112bc2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:57.614173 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa9c20-0aa8-4952-b0db-6841c6112bc2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:57.623897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:02:57.682036 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10f859-2d64-43c4-80ea-650eed8b627e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:57.682647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10f859-2d64-43c4-80ea-650eed8b627e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:57.682922 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10f859-2d64-43c4-80ea-650eed8b627e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:57.683182 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10f859-2d64-43c4-80ea-650eed8b627e admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:57.683842 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10f859-2d64-43c4-80ea-650eed8b627e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:57.685444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10f859-2d64-43c4-80ea-650eed8b627e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:57.695244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1284/2567] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:02:57.699735 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c78ea-fb3d-412f-bd09-c03499efb596 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:57.710946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c78ea-fb3d-412f-bd09-c03499efb596 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:57.716114 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e100ac-ede0-4c45-9963-a6e4d214610c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:57.716755 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e100ac-ede0-4c45-9963-a6e4d214610c admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:57.717028 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e100ac-ede0-4c45-9963-a6e4d214610c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:57.717308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e100ac-ede0-4c45-9963-a6e4d214610c admin admin] PATH_INFO: `/v3/projects/39c44a1fff6a476188426941cca50a2f/users/9d64f47a178348b58382729f48eb8724/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:57.719300 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e100ac-ede0-4c45-9963-a6e4d214610c admin admin] RBAC: Authorizing `identity:create_grant(project_id=39c44a1fff6a476188426941cca50a2f, user_id=9d64f47a178348b58382729f48eb8724, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:57.722272 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e100ac-ede0-4c45-9963-a6e4d214610c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:57.732668 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1284/2568] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:02:57 2022] PUT /identity/v3/projects/39c44a1fff6a476188426941cca50a2f/users/9d64f47a178348b58382729f48eb8724/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:02:57.743347 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498ca85-b1df-4701-89ca-d500b601e0c4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:57.743667 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498ca85-b1df-4701-89ca-d500b601e0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:57.743940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498ca85-b1df-4701-89ca-d500b601e0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:57.773346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1498ca85-b1df-4701-89ca-d500b601e0c4 None None] MFA Rules not processed for user `9d64f47a178348b58382729f48eb8724`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:02:57.774543 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1498ca85-b1df-4701-89ca-d500b601e0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:57.853844 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1285/2569] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:02:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:02:57.867039 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e100ac-ede0-4c45-9963-a6e4d214610c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:57.869600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-04e100ac-ede0-4c45-9963-a6e4d214610c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:57.920814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:02:57.933945 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e100ac-ede0-4c45-9963-a6e4d214610c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:57.938313 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd365647-1941-4322-a2a4-b8e0e1ed9f6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:57.938910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd365647-1941-4322-a2a4-b8e0e1ed9f6c service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:57.939189 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd365647-1941-4322-a2a4-b8e0e1ed9f6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:57.939483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd365647-1941-4322-a2a4-b8e0e1ed9f6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:57.995505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd365647-1941-4322-a2a4-b8e0e1ed9f6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:57.996945 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd365647-1941-4322-a2a4-b8e0e1ed9f6c service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:58.005808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1285/2570] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:02:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:02:59.383312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498ca85-b1df-4701-89ca-d500b601e0c4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:02:59.384983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1498ca85-b1df-4701-89ca-d500b601e0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:02:59.397990 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498ca85-b1df-4701-89ca-d500b601e0c4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:02:59.402196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8442a61-7200-4963-98d2-06c5e8bacc15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:02:59.402821 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8442a61-7200-4963-98d2-06c5e8bacc15 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:02:59.403101 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8442a61-7200-4963-98d2-06c5e8bacc15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:02:59.403383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8442a61-7200-4963-98d2-06c5e8bacc15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:02:59.413353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8442a61-7200-4963-98d2-06c5e8bacc15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:02:59.414831 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8442a61-7200-4963-98d2-06c5e8bacc15 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:02:59.425074 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1286/2571] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:02:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:03:00.909143 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49e075-f077-43f6-93d4-b49d41bd9ea1 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:00.909985 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49e075-f077-43f6-93d4-b49d41bd9ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:00.909985 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49e075-f077-43f6-93d4-b49d41bd9ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:00.937705 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-ed49e075-f077-43f6-93d4-b49d41bd9ea1 None None] MFA Rules not processed for user `58c86110ce97463e9b3d53691ae3e12c`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:00.937705 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ed49e075-f077-43f6-93d4-b49d41bd9ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:00.997359 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1286/2572] 10.222.0.27 () {58 vars in 967 bytes} [Tue Aug 30 12:03:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:03:01.046345 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8442a61-7200-4963-98d2-06c5e8bacc15 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:01.048965 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c8442a61-7200-4963-98d2-06c5e8bacc15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:01.126136 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8442a61-7200-4963-98d2-06c5e8bacc15 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:01.132222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80f62b-ce76-4039-8aed-386aa65998c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d27bfb8c0b64763b7db7cffa5f230f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:01.132853 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80f62b-ce76-4039-8aed-386aa65998c0 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:01.133120 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80f62b-ce76-4039-8aed-386aa65998c0 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:01.133383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80f62b-ce76-4039-8aed-386aa65998c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:01.142352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80f62b-ce76-4039-8aed-386aa65998c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:01.144082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80f62b-ce76-4039-8aed-386aa65998c0 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:01.152804 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1287/2573] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Aug 30 12:03:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 12:03:03.285640 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49e075-f077-43f6-93d4-b49d41bd9ea1 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:03.359589 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49e075-f077-43f6-93d4-b49d41bd9ea1 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:03.364261 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a09ee-7755-47cd-8162-4f00495b62ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:03.364908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a09ee-7755-47cd-8162-4f00495b62ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:03.365182 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a09ee-7755-47cd-8162-4f00495b62ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:03.365452 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a09ee-7755-47cd-8162-4f00495b62ff admin admin] PATH_INFO: `/v3/users/2871c9ed3c4e4dff8b57508cf15f1539` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:03.366623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a09ee-7755-47cd-8162-4f00495b62ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=2871c9ed3c4e4dff8b57508cf15f1539)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:03.368591 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a09ee-7755-47cd-8162-4f00495b62ff admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:03.423702 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:03.425772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a71a09ee-7755-47cd-8162-4f00495b62ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2871c9ed3c4e4dff8b57508cf15f1539'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:03.435064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a71a09ee-7755-47cd-8162-4f00495b62ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2871c9ed3c4e4dff8b57508cf15f1539'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:03.444825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a71a09ee-7755-47cd-8162-4f00495b62ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2871c9ed3c4e4dff8b57508cf15f1539'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:03.445697 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a71a09ee-7755-47cd-8162-4f00495b62ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2871c9ed3c4e4dff8b57508cf15f1539'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:03.461058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-a71a09ee-7755-47cd-8162-4f00495b62ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2871c9ed3c4e4dff8b57508cf15f1539'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:03.471668 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1287/2574] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:03:03 2022] DELETE /identity/v3/users/2871c9ed3c4e4dff8b57508cf15f1539 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:03:03.473393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487e143-fc17-4418-aaa4-94dde29f7dfc None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:03.473861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487e143-fc17-4418-aaa4-94dde29f7dfc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:03.473944 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487e143-fc17-4418-aaa4-94dde29f7dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:03.494224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1487e143-fc17-4418-aaa4-94dde29f7dfc None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:03.495804 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1487e143-fc17-4418-aaa4-94dde29f7dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:03.501126 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:03.562236 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1288/2575] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:03:03.572392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a09ee-7755-47cd-8162-4f00495b62ff admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:03.574182 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a71a09ee-7755-47cd-8162-4f00495b62ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:03.649592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a09ee-7755-47cd-8162-4f00495b62ff admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:03.653717 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69791377-1155-4cf5-8361-0b297455c909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:03.654566 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69791377-1155-4cf5-8361-0b297455c909 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:03.654994 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69791377-1155-4cf5-8361-0b297455c909 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:03.655492 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69791377-1155-4cf5-8361-0b297455c909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:03.666221 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69791377-1155-4cf5-8361-0b297455c909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:03.668144 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69791377-1155-4cf5-8361-0b297455c909 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:03.679312 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1288/2576] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:03:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:03:03.954950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487e143-fc17-4418-aaa4-94dde29f7dfc None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:03.957198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1487e143-fc17-4418-aaa4-94dde29f7dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:03.969540 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487e143-fc17-4418-aaa4-94dde29f7dfc None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:03.977116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4928b18-a621-4b4a-9896-bc1495ef2630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:03.977928 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4928b18-a621-4b4a-9896-bc1495ef2630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:03.978212 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4928b18-a621-4b4a-9896-bc1495ef2630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:03.978422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4928b18-a621-4b4a-9896-bc1495ef2630 admin admin] PATH_INFO: `/v3/projects/568b8e9951b648abbe9251c52c6c6e93` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:03.984293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4928b18-a621-4b4a-9896-bc1495ef2630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=568b8e9951b648abbe9251c52c6c6e93)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:03.986140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4928b18-a621-4b4a-9896-bc1495ef2630 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:04.042760 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f4928b18-a621-4b4a-9896-bc1495ef2630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '568b8e9951b648abbe9251c52c6c6e93', 'request_id': 'req-f4928b18-a621-4b4a-9896-bc1495ef2630'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:04.052855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f4928b18-a621-4b4a-9896-bc1495ef2630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '568b8e9951b648abbe9251c52c6c6e93', 'request_id': 'req-f4928b18-a621-4b4a-9896-bc1495ef2630'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:04.060006 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f4928b18-a621-4b4a-9896-bc1495ef2630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '568b8e9951b648abbe9251c52c6c6e93', 'request_id': 'req-f4928b18-a621-4b4a-9896-bc1495ef2630'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:04.072296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f4928b18-a621-4b4a-9896-bc1495ef2630 admin admin] The token cache is being invalidate because project 568b8e9951b648abbe9251c52c6c6e93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:03:04.072667 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f4928b18-a621-4b4a-9896-bc1495ef2630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:04.073408 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f4928b18-a621-4b4a-9896-bc1495ef2630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:04.075405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1289/2577] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:03:03 2022] DELETE /identity/v3/projects/568b8e9951b648abbe9251c52c6c6e93 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:03:04.079026 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69791377-1155-4cf5-8361-0b297455c909 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:04.089713 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69791377-1155-4cf5-8361-0b297455c909 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:04.179178 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f6cf8-c247-476e-be0f-3eb916181a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:04.179976 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f6cf8-c247-476e-be0f-3eb916181a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:04.180301 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f6cf8-c247-476e-be0f-3eb916181a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:04.180639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f6cf8-c247-476e-be0f-3eb916181a2d admin admin] PATH_INFO: `/v3/users/9d64f47a178348b58382729f48eb8724` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:04.181874 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f6cf8-c247-476e-be0f-3eb916181a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d64f47a178348b58382729f48eb8724)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:04.183922 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f6cf8-c247-476e-be0f-3eb916181a2d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:04.236203 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1a9f6cf8-c247-476e-be0f-3eb916181a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d64f47a178348b58382729f48eb8724'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:04.243239 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1a9f6cf8-c247-476e-be0f-3eb916181a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d64f47a178348b58382729f48eb8724'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:04.252880 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1a9f6cf8-c247-476e-be0f-3eb916181a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d64f47a178348b58382729f48eb8724'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:04.253542 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1a9f6cf8-c247-476e-be0f-3eb916181a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d64f47a178348b58382729f48eb8724'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:04.260314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:04.268324 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1a9f6cf8-c247-476e-be0f-3eb916181a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d64f47a178348b58382729f48eb8724'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:04.277799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1289/2578] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:03:04 2022] DELETE /identity/v3/users/9d64f47a178348b58382729f48eb8724 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:03:04.769687 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4928b18-a621-4b4a-9896-bc1495ef2630 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:04.772440 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f4928b18-a621-4b4a-9896-bc1495ef2630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:04.790053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4928b18-a621-4b4a-9896-bc1495ef2630 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:04.866732 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79c8d4-7d3b-4aec-8425-75c3e1e25bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:04.867421 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79c8d4-7d3b-4aec-8425-75c3e1e25bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:04.867702 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79c8d4-7d3b-4aec-8425-75c3e1e25bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:04.867973 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79c8d4-7d3b-4aec-8425-75c3e1e25bd8 admin admin] PATH_INFO: `/v3/projects/39c44a1fff6a476188426941cca50a2f` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:04.869132 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79c8d4-7d3b-4aec-8425-75c3e1e25bd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39c44a1fff6a476188426941cca50a2f)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:04.871069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79c8d4-7d3b-4aec-8425-75c3e1e25bd8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:04.916907 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:04.927408 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-aa79c8d4-7d3b-4aec-8425-75c3e1e25bd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39c44a1fff6a476188426941cca50a2f', 'request_id': 'req-aa79c8d4-7d3b-4aec-8425-75c3e1e25bd8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:04.936806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-aa79c8d4-7d3b-4aec-8425-75c3e1e25bd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39c44a1fff6a476188426941cca50a2f', 'request_id': 'req-aa79c8d4-7d3b-4aec-8425-75c3e1e25bd8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:04.942640 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-aa79c8d4-7d3b-4aec-8425-75c3e1e25bd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39c44a1fff6a476188426941cca50a2f', 'request_id': 'req-aa79c8d4-7d3b-4aec-8425-75c3e1e25bd8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:04.956386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-aa79c8d4-7d3b-4aec-8425-75c3e1e25bd8 admin admin] The token cache is being invalidate because project 39c44a1fff6a476188426941cca50a2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:03:04.956676 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-aa79c8d4-7d3b-4aec-8425-75c3e1e25bd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:04.957464 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-aa79c8d4-7d3b-4aec-8425-75c3e1e25bd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:04.959332 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1290/2579] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:03:04 2022] DELETE /identity/v3/projects/39c44a1fff6a476188426941cca50a2f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:03:04.964858 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce494a54-8c21-4f93-bf4c-9a641a9aa009 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:04.965335 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce494a54-8c21-4f93-bf4c-9a641a9aa009 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:04.965643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce494a54-8c21-4f93-bf4c-9a641a9aa009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:04.994167 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-ce494a54-8c21-4f93-bf4c-9a641a9aa009 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:04.995484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ce494a54-8c21-4f93-bf4c-9a641a9aa009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:05.062184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1290/2580] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:03:05.069887 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c2f97-f95a-451a-a74f-4cda5cf60e0c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:05.070180 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c2f97-f95a-451a-a74f-4cda5cf60e0c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:05.070452 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c2f97-f95a-451a-a74f-4cda5cf60e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:05.091146 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-fc9c2f97-f95a-451a-a74f-4cda5cf60e0c None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:05.092452 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fc9c2f97-f95a-451a-a74f-4cda5cf60e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:05.103233 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1291/2581] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 12:03:05.108747 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce494a54-8c21-4f93-bf4c-9a641a9aa009 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:05.119229 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce494a54-8c21-4f93-bf4c-9a641a9aa009 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:05.124368 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d807dea-9b8d-486f-b7c2-4a624fc9922e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:05.125180 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d807dea-9b8d-486f-b7c2-4a624fc9922e admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:05.125455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d807dea-9b8d-486f-b7c2-4a624fc9922e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:05.125726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d807dea-9b8d-486f-b7c2-4a624fc9922e admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:05.126366 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d807dea-9b8d-486f-b7c2-4a624fc9922e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 12:03:05.126665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d807dea-9b8d-486f-b7c2-4a624fc9922e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:05.128970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d807dea-9b8d-486f-b7c2-4a624fc9922e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:05.143410 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1291/2582] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 12:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 12:03:05.146051 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c2f97-f95a-451a-a74f-4cda5cf60e0c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:05.155696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c2f97-f95a-451a-a74f-4cda5cf60e0c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:05.161552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef7103-e616-4ff6-98f8-1e1c85778046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:05.162174 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef7103-e616-4ff6-98f8-1e1c85778046 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:05.162454 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef7103-e616-4ff6-98f8-1e1c85778046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:05.162724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef7103-e616-4ff6-98f8-1e1c85778046 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:05.163386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef7103-e616-4ff6-98f8-1e1c85778046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:05.165394 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef7103-e616-4ff6-98f8-1e1c85778046 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:05.200349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1292/2583] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:03:05 2022] POST /identity/v3/projects => generated 361 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:03:05.204361 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d807dea-9b8d-486f-b7c2-4a624fc9922e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:05.215018 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d807dea-9b8d-486f-b7c2-4a624fc9922e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:05.280698 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07bb71-fae8-41ef-afa4-bae8ab3ccf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:05.281800 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07bb71-fae8-41ef-afa4-bae8ab3ccf5f admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:05.281920 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07bb71-fae8-41ef-afa4-bae8ab3ccf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:05.282130 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07bb71-fae8-41ef-afa4-bae8ab3ccf5f admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:05.282772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07bb71-fae8-41ef-afa4-bae8ab3ccf5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:05.284999 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07bb71-fae8-41ef-afa4-bae8ab3ccf5f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:05.311784 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1292/2584] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:03:05 2022] POST /identity/v3/users => generated 281 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 12:03:05.315979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef7103-e616-4ff6-98f8-1e1c85778046 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:05.329035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef7103-e616-4ff6-98f8-1e1c85778046 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:05.333879 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d9691-995b-499a-a77a-514fd2af28f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:05.334496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d9691-995b-499a-a77a-514fd2af28f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:05.334792 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d9691-995b-499a-a77a-514fd2af28f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:05.335055 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d9691-995b-499a-a77a-514fd2af28f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:05.335722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d9691-995b-499a-a77a-514fd2af28f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:05.337344 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d9691-995b-499a-a77a-514fd2af28f6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:05.347761 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1293/2585] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:03:05.351897 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07bb71-fae8-41ef-afa4-bae8ab3ccf5f admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:05.362471 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07bb71-fae8-41ef-afa4-bae8ab3ccf5f admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:05.367064 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a84b3-a71d-4392-a7ec-249aabb1ab85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:05.367702 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a84b3-a71d-4392-a7ec-249aabb1ab85 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:05.367980 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a84b3-a71d-4392-a7ec-249aabb1ab85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:05.368244 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a84b3-a71d-4392-a7ec-249aabb1ab85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:05.368878 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a84b3-a71d-4392-a7ec-249aabb1ab85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:05.370488 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a84b3-a71d-4392-a7ec-249aabb1ab85 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:05.381557 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1293/2586] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:03:05.385909 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d9691-995b-499a-a77a-514fd2af28f6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:05.396306 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d9691-995b-499a-a77a-514fd2af28f6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:05.401069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971dbcc1-e548-4db0-b103-b79d8080a68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:05.401876 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971dbcc1-e548-4db0-b103-b79d8080a68d admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:05.402181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971dbcc1-e548-4db0-b103-b79d8080a68d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:05.402450 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971dbcc1-e548-4db0-b103-b79d8080a68d admin admin] PATH_INFO: `/v3/projects/373ec778f0af41759ccf1a59a262236d/users/6960c63ec7874da589c41e9e751ed4df/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:05.417195 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971dbcc1-e548-4db0-b103-b79d8080a68d admin admin] RBAC: Authorizing `identity:create_grant(project_id=373ec778f0af41759ccf1a59a262236d, user_id=6960c63ec7874da589c41e9e751ed4df, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:05.419868 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971dbcc1-e548-4db0-b103-b79d8080a68d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:05.435031 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1294/2587] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:03:05 2022] PUT /identity/v3/projects/373ec778f0af41759ccf1a59a262236d/users/6960c63ec7874da589c41e9e751ed4df/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:03:05.446641 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7ff01-ae23-43bd-aef2-f6fd4aaf9d77 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:05.447035 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7ff01-ae23-43bd-aef2-f6fd4aaf9d77 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:05.447460 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7ff01-ae23-43bd-aef2-f6fd4aaf9d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:05.477297 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-51c7ff01-ae23-43bd-aef2-f6fd4aaf9d77 None None] MFA Rules not processed for user `6960c63ec7874da589c41e9e751ed4df`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:05.478617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-51c7ff01-ae23-43bd-aef2-f6fd4aaf9d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:05.520033 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:05.547189 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1294/2588] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:03:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 12:03:05.580538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971dbcc1-e548-4db0-b103-b79d8080a68d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:05.582555 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-971dbcc1-e548-4db0-b103-b79d8080a68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:05.641990 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971dbcc1-e548-4db0-b103-b79d8080a68d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:05.646583 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9592cc-66bd-440b-87a9-de27b2553b96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:05.647203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9592cc-66bd-440b-87a9-de27b2553b96 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:05.647517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9592cc-66bd-440b-87a9-de27b2553b96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:05.647786 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9592cc-66bd-440b-87a9-de27b2553b96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:05.657261 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9592cc-66bd-440b-87a9-de27b2553b96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:05.658767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9592cc-66bd-440b-87a9-de27b2553b96 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:05.668750 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1295/2589] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:03:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:03:05.684334 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7ff01-ae23-43bd-aef2-f6fd4aaf9d77 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:05.752759 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7ff01-ae23-43bd-aef2-f6fd4aaf9d77 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:05.757582 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c90975-5554-4c24-8b86-200c6659cb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:05.758226 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c90975-5554-4c24-8b86-200c6659cb23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:05.758506 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c90975-5554-4c24-8b86-200c6659cb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:05.758772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c90975-5554-4c24-8b86-200c6659cb23 admin admin] PATH_INFO: `/v3/users/6960c63ec7874da589c41e9e751ed4df` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:05.760066 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c90975-5554-4c24-8b86-200c6659cb23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6960c63ec7874da589c41e9e751ed4df)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:05.762108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c90975-5554-4c24-8b86-200c6659cb23 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:05.809905 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-37c90975-5554-4c24-8b86-200c6659cb23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6960c63ec7874da589c41e9e751ed4df'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:05.816983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-37c90975-5554-4c24-8b86-200c6659cb23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6960c63ec7874da589c41e9e751ed4df'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:05.825134 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-37c90975-5554-4c24-8b86-200c6659cb23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6960c63ec7874da589c41e9e751ed4df'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:05.825735 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-37c90975-5554-4c24-8b86-200c6659cb23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6960c63ec7874da589c41e9e751ed4df'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:05.840272 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-37c90975-5554-4c24-8b86-200c6659cb23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6960c63ec7874da589c41e9e751ed4df'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:05.847726 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1295/2590] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:03:05 2022] DELETE /identity/v3/users/6960c63ec7874da589c41e9e751ed4df => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:03:05.852212 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66d339-1f6c-4124-bcf8-1092196ccc77 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:05.852761 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66d339-1f6c-4124-bcf8-1092196ccc77 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:05.852761 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66d339-1f6c-4124-bcf8-1092196ccc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:05.871992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-fa66d339-1f6c-4124-bcf8-1092196ccc77 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:05.873209 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fa66d339-1f6c-4124-bcf8-1092196ccc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:05.942813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1296/2591] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 12:03:05.952729 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c90975-5554-4c24-8b86-200c6659cb23 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:05.954327 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-37c90975-5554-4c24-8b86-200c6659cb23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:06.022344 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c90975-5554-4c24-8b86-200c6659cb23 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:06.026795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ad381-f466-4768-8fff-f33ef04e6397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:06.027458 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ad381-f466-4768-8fff-f33ef04e6397 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:06.027739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ad381-f466-4768-8fff-f33ef04e6397 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:06.028015 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ad381-f466-4768-8fff-f33ef04e6397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:06.051461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ad381-f466-4768-8fff-f33ef04e6397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:06.052979 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ad381-f466-4768-8fff-f33ef04e6397 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:06.064062 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1296/2592] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:03:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 12:03:06.337689 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66d339-1f6c-4124-bcf8-1092196ccc77 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:06.339691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fa66d339-1f6c-4124-bcf8-1092196ccc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:06.353089 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:06.357620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66d339-1f6c-4124-bcf8-1092196ccc77 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:06.374596 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc61707-5254-4ec7-8030-caca68da7ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:06.375398 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc61707-5254-4ec7-8030-caca68da7ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:06.375696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc61707-5254-4ec7-8030-caca68da7ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:06.376342 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc61707-5254-4ec7-8030-caca68da7ed3 admin admin] PATH_INFO: `/v3/projects/373ec778f0af41759ccf1a59a262236d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:06.379025 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc61707-5254-4ec7-8030-caca68da7ed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=373ec778f0af41759ccf1a59a262236d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:06.381005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc61707-5254-4ec7-8030-caca68da7ed3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:06.436375 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7bc61707-5254-4ec7-8030-caca68da7ed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '373ec778f0af41759ccf1a59a262236d', 'request_id': 'req-7bc61707-5254-4ec7-8030-caca68da7ed3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:06.445404 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7bc61707-5254-4ec7-8030-caca68da7ed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '373ec778f0af41759ccf1a59a262236d', 'request_id': 'req-7bc61707-5254-4ec7-8030-caca68da7ed3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:06.452048 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7bc61707-5254-4ec7-8030-caca68da7ed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '373ec778f0af41759ccf1a59a262236d', 'request_id': 'req-7bc61707-5254-4ec7-8030-caca68da7ed3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:06.464495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7bc61707-5254-4ec7-8030-caca68da7ed3 admin admin] The token cache is being invalidate because project 373ec778f0af41759ccf1a59a262236d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:03:06.464786 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7bc61707-5254-4ec7-8030-caca68da7ed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:06.465431 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7bc61707-5254-4ec7-8030-caca68da7ed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:06.466928 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1297/2593] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:03:06 2022] DELETE /identity/v3/projects/373ec778f0af41759ccf1a59a262236d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:03:06.472102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf30c9d-36f0-4520-844d-aa5e41a0da92 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:06.472571 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf30c9d-36f0-4520-844d-aa5e41a0da92 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:06.473268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf30c9d-36f0-4520-844d-aa5e41a0da92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:06.482029 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:06.497754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-dbf30c9d-36f0-4520-844d-aa5e41a0da92 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:06.499518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-dbf30c9d-36f0-4520-844d-aa5e41a0da92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:06.572682 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1297/2594] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:03:06.574479 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b11c23-189c-4345-839c-acbf498d13aa None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:06.574763 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b11c23-189c-4345-839c-acbf498d13aa None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:06.575035 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b11c23-189c-4345-839c-acbf498d13aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:06.596040 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-22b11c23-189c-4345-839c-acbf498d13aa None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:06.597385 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-22b11c23-189c-4345-839c-acbf498d13aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:06.607140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1298/2595] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:03:06.611886 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf30c9d-36f0-4520-844d-aa5e41a0da92 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:06.625942 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf30c9d-36f0-4520-844d-aa5e41a0da92 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:06.631051 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9d00a-087c-48d3-bff5-f58cff080cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:06.631557 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9d00a-087c-48d3-bff5-f58cff080cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:06.631927 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9d00a-087c-48d3-bff5-f58cff080cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:06.632284 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9d00a-087c-48d3-bff5-f58cff080cd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:06.633191 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9d00a-087c-48d3-bff5-f58cff080cd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 12:03:06.633587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9d00a-087c-48d3-bff5-f58cff080cd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:06.635995 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9d00a-087c-48d3-bff5-f58cff080cd6 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:06.649965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1298/2596] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 12:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 12:03:06.654305 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b11c23-189c-4345-839c-acbf498d13aa None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:06.663851 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b11c23-189c-4345-839c-acbf498d13aa None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:06.668453 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360527a-a121-487a-bafd-f80110f356af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:06.669063 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360527a-a121-487a-bafd-f80110f356af admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:06.669337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360527a-a121-487a-bafd-f80110f356af admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:06.669611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360527a-a121-487a-bafd-f80110f356af admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:06.670277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360527a-a121-487a-bafd-f80110f356af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:06.672585 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360527a-a121-487a-bafd-f80110f356af admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:06.704228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1299/2597] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:03:06 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:03:06.708862 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9d00a-087c-48d3-bff5-f58cff080cd6 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:06.720346 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9d00a-087c-48d3-bff5-f58cff080cd6 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:06.785594 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad902f1-6912-444b-b90d-8c1737fe743e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:06.786214 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad902f1-6912-444b-b90d-8c1737fe743e admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:06.786697 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad902f1-6912-444b-b90d-8c1737fe743e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:06.786817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad902f1-6912-444b-b90d-8c1737fe743e admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:06.787427 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad902f1-6912-444b-b90d-8c1737fe743e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:06.789468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad902f1-6912-444b-b90d-8c1737fe743e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:06.820578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1299/2598] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:03:06 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:03:06.821923 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360527a-a121-487a-bafd-f80110f356af admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:06.834077 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360527a-a121-487a-bafd-f80110f356af admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:06.839138 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa6630-c3e9-44dc-97f2-6cfa589720d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:06.839891 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa6630-c3e9-44dc-97f2-6cfa589720d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:06.840232 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa6630-c3e9-44dc-97f2-6cfa589720d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:06.840546 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa6630-c3e9-44dc-97f2-6cfa589720d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:06.841364 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa6630-c3e9-44dc-97f2-6cfa589720d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:06.843167 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa6630-c3e9-44dc-97f2-6cfa589720d6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:06.856816 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1300/2599] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:03:06.861135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad902f1-6912-444b-b90d-8c1737fe743e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:06.874996 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad902f1-6912-444b-b90d-8c1737fe743e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:06.880426 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4c905-96ac-4830-8d10-e1a979a95866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:06.881049 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4c905-96ac-4830-8d10-e1a979a95866 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:06.881367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4c905-96ac-4830-8d10-e1a979a95866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:06.881678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4c905-96ac-4830-8d10-e1a979a95866 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:06.882601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4c905-96ac-4830-8d10-e1a979a95866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:06.884253 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4c905-96ac-4830-8d10-e1a979a95866 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:06.896183 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1300/2600] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:03:06.902203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa6630-c3e9-44dc-97f2-6cfa589720d6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:06.915632 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa6630-c3e9-44dc-97f2-6cfa589720d6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:06.920776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189315a-2ca2-404d-82b8-bd778aa8444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:06.922019 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189315a-2ca2-404d-82b8-bd778aa8444e admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:06.922426 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189315a-2ca2-404d-82b8-bd778aa8444e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:06.922769 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189315a-2ca2-404d-82b8-bd778aa8444e admin admin] PATH_INFO: `/v3/projects/b4f9b9fbdd9744eda3bf8b5a02be41e6/users/5515f27475284528869c89e21b1f216e/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:06.939936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189315a-2ca2-404d-82b8-bd778aa8444e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4f9b9fbdd9744eda3bf8b5a02be41e6, user_id=5515f27475284528869c89e21b1f216e, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:06.943026 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189315a-2ca2-404d-82b8-bd778aa8444e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:06.965697 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1301/2601] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:03:06 2022] PUT /identity/v3/projects/b4f9b9fbdd9744eda3bf8b5a02be41e6/users/5515f27475284528869c89e21b1f216e/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:03:06.968184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c6043-3b2d-45dc-b767-8f92e5218363 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:06.968471 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c6043-3b2d-45dc-b767-8f92e5218363 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:06.968739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c6043-3b2d-45dc-b767-8f92e5218363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:06.998352 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-431c6043-3b2d-45dc-b767-8f92e5218363 None None] MFA Rules not processed for user `5515f27475284528869c89e21b1f216e`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:06.999639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-431c6043-3b2d-45dc-b767-8f92e5218363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:07.081457 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:07.088812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1301/2602] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:03:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:03:07.100560 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189315a-2ca2-404d-82b8-bd778aa8444e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:07.117361 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7189315a-2ca2-404d-82b8-bd778aa8444e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:07.185213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189315a-2ca2-404d-82b8-bd778aa8444e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:07.192802 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c183c3-d17f-4aae-92fd-12ef6afdb9e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:07.193505 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c183c3-d17f-4aae-92fd-12ef6afdb9e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:07.193870 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c183c3-d17f-4aae-92fd-12ef6afdb9e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:07.194246 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c183c3-d17f-4aae-92fd-12ef6afdb9e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:07.203992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c183c3-d17f-4aae-92fd-12ef6afdb9e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:07.205656 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c183c3-d17f-4aae-92fd-12ef6afdb9e2 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:07.221910 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1302/2603] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:03:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:03:08.348322 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c6043-3b2d-45dc-b767-8f92e5218363 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:08.349856 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-431c6043-3b2d-45dc-b767-8f92e5218363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:08.417423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c6043-3b2d-45dc-b767-8f92e5218363 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:08.422223 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd3873-f82b-4504-bd18-e78991f44e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:08.422847 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd3873-f82b-4504-bd18-e78991f44e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:08.423118 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd3873-f82b-4504-bd18-e78991f44e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:08.423396 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd3873-f82b-4504-bd18-e78991f44e25 admin admin] PATH_INFO: `/v3/users/c7ceaf4cecaa4ecc80dd4357371330bf` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:08.424623 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd3873-f82b-4504-bd18-e78991f44e25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7ceaf4cecaa4ecc80dd4357371330bf)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:08.426543 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd3873-f82b-4504-bd18-e78991f44e25 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:08.476857 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d2cd3873-f82b-4504-bd18-e78991f44e25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7ceaf4cecaa4ecc80dd4357371330bf'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:08.483986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d2cd3873-f82b-4504-bd18-e78991f44e25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7ceaf4cecaa4ecc80dd4357371330bf'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:08.491883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d2cd3873-f82b-4504-bd18-e78991f44e25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7ceaf4cecaa4ecc80dd4357371330bf'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:08.492484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d2cd3873-f82b-4504-bd18-e78991f44e25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7ceaf4cecaa4ecc80dd4357371330bf'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:08.504228 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d2cd3873-f82b-4504-bd18-e78991f44e25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7ceaf4cecaa4ecc80dd4357371330bf'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:08.509954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1302/2604] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:03:08 2022] DELETE /identity/v3/users/c7ceaf4cecaa4ecc80dd4357371330bf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:03:08.686217 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c183c3-d17f-4aae-92fd-12ef6afdb9e2 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:08.700273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c183c3-d17f-4aae-92fd-12ef6afdb9e2 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:08.734664 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:08.775314 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caec401-4f1c-4f75-8861-0edd8e6b9021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:08.775985 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caec401-4f1c-4f75-8861-0edd8e6b9021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:08.776260 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caec401-4f1c-4f75-8861-0edd8e6b9021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:08.776529 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caec401-4f1c-4f75-8861-0edd8e6b9021 admin admin] PATH_INFO: `/v3/projects/05f1b3d58a4d41418b518eea903c4c0e` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:08.777653 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caec401-4f1c-4f75-8861-0edd8e6b9021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05f1b3d58a4d41418b518eea903c4c0e)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:08.779631 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caec401-4f1c-4f75-8861-0edd8e6b9021 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:08.832128 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6caec401-4f1c-4f75-8861-0edd8e6b9021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05f1b3d58a4d41418b518eea903c4c0e', 'request_id': 'req-6caec401-4f1c-4f75-8861-0edd8e6b9021'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:08.840438 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6caec401-4f1c-4f75-8861-0edd8e6b9021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05f1b3d58a4d41418b518eea903c4c0e', 'request_id': 'req-6caec401-4f1c-4f75-8861-0edd8e6b9021'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:08.846282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6caec401-4f1c-4f75-8861-0edd8e6b9021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05f1b3d58a4d41418b518eea903c4c0e', 'request_id': 'req-6caec401-4f1c-4f75-8861-0edd8e6b9021'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:08.863561 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6caec401-4f1c-4f75-8861-0edd8e6b9021 admin admin] The token cache is being invalidate because project 05f1b3d58a4d41418b518eea903c4c0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:03:08.863910 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6caec401-4f1c-4f75-8861-0edd8e6b9021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:08.864571 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6caec401-4f1c-4f75-8861-0edd8e6b9021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:08.866254 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1303/2605] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:03:08 2022] DELETE /identity/v3/projects/05f1b3d58a4d41418b518eea903c4c0e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:03:08.870664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd3873-f82b-4504-bd18-e78991f44e25 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:08.872285 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d2cd3873-f82b-4504-bd18-e78991f44e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:08.887165 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd3873-f82b-4504-bd18-e78991f44e25 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:08.947876 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401e33e-c8a6-49d0-af3e-32513001c3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:08.948551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401e33e-c8a6-49d0-af3e-32513001c3be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:08.948826 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401e33e-c8a6-49d0-af3e-32513001c3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:08.949097 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401e33e-c8a6-49d0-af3e-32513001c3be admin admin] PATH_INFO: `/v3/users/1f259a1b49244fa0847c300d6d555b2d` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:08.950262 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401e33e-c8a6-49d0-af3e-32513001c3be admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f259a1b49244fa0847c300d6d555b2d)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:08.952535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401e33e-c8a6-49d0-af3e-32513001c3be admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:08.976630 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:09.024996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caec401-4f1c-4f75-8861-0edd8e6b9021 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:09.026509 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6caec401-4f1c-4f75-8861-0edd8e6b9021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:09.028200 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2401e33e-c8a6-49d0-af3e-32513001c3be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f259a1b49244fa0847c300d6d555b2d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:09.037419 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2401e33e-c8a6-49d0-af3e-32513001c3be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f259a1b49244fa0847c300d6d555b2d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:09.057176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2401e33e-c8a6-49d0-af3e-32513001c3be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f259a1b49244fa0847c300d6d555b2d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:09.057910 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2401e33e-c8a6-49d0-af3e-32513001c3be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f259a1b49244fa0847c300d6d555b2d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:09.073972 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-2401e33e-c8a6-49d0-af3e-32513001c3be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f259a1b49244fa0847c300d6d555b2d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:09.080401 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1303/2606] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:03:08 2022] DELETE /identity/v3/users/1f259a1b49244fa0847c300d6d555b2d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:03:09.134878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caec401-4f1c-4f75-8861-0edd8e6b9021 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:09.198725 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:09.239439 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abe737-1b7e-4f21-a88f-705fa21e3531 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:09.240507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abe737-1b7e-4f21-a88f-705fa21e3531 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:09.240507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abe737-1b7e-4f21-a88f-705fa21e3531 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:09.240872 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abe737-1b7e-4f21-a88f-705fa21e3531 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:09.243058 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-37abe737-1b7e-4f21-a88f-705fa21e3531 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:09.302574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401e33e-c8a6-49d0-af3e-32513001c3be admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:09.305070 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2401e33e-c8a6-49d0-af3e-32513001c3be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:09.352203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37abe737-1b7e-4f21-a88f-705fa21e3531 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:09.353830 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37abe737-1b7e-4f21-a88f-705fa21e3531 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:09.364809 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1304/2607] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:03:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:03:09.393964 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401e33e-c8a6-49d0-af3e-32513001c3be admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:09.401401 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33c51b-abde-456b-9d93-4007439a02c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:09.402338 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33c51b-abde-456b-9d93-4007439a02c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:09.402682 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33c51b-abde-456b-9d93-4007439a02c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:09.403039 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33c51b-abde-456b-9d93-4007439a02c3 admin admin] PATH_INFO: `/v3/projects/edab11f5ff974f9193ba6cd7bb292a94` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:09.404401 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33c51b-abde-456b-9d93-4007439a02c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edab11f5ff974f9193ba6cd7bb292a94)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:09.406740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33c51b-abde-456b-9d93-4007439a02c3 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:09.469680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6a33c51b-abde-456b-9d93-4007439a02c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edab11f5ff974f9193ba6cd7bb292a94', 'request_id': 'req-6a33c51b-abde-456b-9d93-4007439a02c3'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:09.476205 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6a33c51b-abde-456b-9d93-4007439a02c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edab11f5ff974f9193ba6cd7bb292a94', 'request_id': 'req-6a33c51b-abde-456b-9d93-4007439a02c3'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:09.483094 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6a33c51b-abde-456b-9d93-4007439a02c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edab11f5ff974f9193ba6cd7bb292a94', 'request_id': 'req-6a33c51b-abde-456b-9d93-4007439a02c3'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:09.497243 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6a33c51b-abde-456b-9d93-4007439a02c3 admin admin] The token cache is being invalidate because project edab11f5ff974f9193ba6cd7bb292a94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:03:09.497531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6a33c51b-abde-456b-9d93-4007439a02c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:09.498146 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-6a33c51b-abde-456b-9d93-4007439a02c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:09.499689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1304/2608] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:03:09 2022] DELETE /identity/v3/projects/edab11f5ff974f9193ba6cd7bb292a94 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:03:10.486162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abe737-1b7e-4f21-a88f-705fa21e3531 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:10.488051 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-37abe737-1b7e-4f21-a88f-705fa21e3531 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:10.502022 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abe737-1b7e-4f21-a88f-705fa21e3531 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:10.568610 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddfb44-1960-4d85-be1c-c5415697b892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:10.569243 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddfb44-1960-4d85-be1c-c5415697b892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:10.569524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddfb44-1960-4d85-be1c-c5415697b892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:10.569800 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddfb44-1960-4d85-be1c-c5415697b892 admin admin] PATH_INFO: `/v3/users/5515f27475284528869c89e21b1f216e` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:10.571001 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddfb44-1960-4d85-be1c-c5415697b892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5515f27475284528869c89e21b1f216e)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:10.572959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddfb44-1960-4d85-be1c-c5415697b892 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:10.622625 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c6ddfb44-1960-4d85-be1c-c5415697b892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5515f27475284528869c89e21b1f216e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:10.629550 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c6ddfb44-1960-4d85-be1c-c5415697b892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5515f27475284528869c89e21b1f216e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:10.638135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c6ddfb44-1960-4d85-be1c-c5415697b892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5515f27475284528869c89e21b1f216e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:10.650473 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c6ddfb44-1960-4d85-be1c-c5415697b892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5515f27475284528869c89e21b1f216e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:10.651093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c6ddfb44-1960-4d85-be1c-c5415697b892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5515f27475284528869c89e21b1f216e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:10.657164 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1305/2609] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:03:10 2022] DELETE /identity/v3/users/5515f27475284528869c89e21b1f216e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:03:10.661909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2edc07-72fe-43c9-b7ae-0cfe47261066 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:10.662390 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2edc07-72fe-43c9-b7ae-0cfe47261066 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:10.662484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2edc07-72fe-43c9-b7ae-0cfe47261066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:10.682296 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-1f2edc07-72fe-43c9-b7ae-0cfe47261066 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:10.683585 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1f2edc07-72fe-43c9-b7ae-0cfe47261066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:10.706337 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:10.748845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1305/2610] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 12:03:10.758688 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddfb44-1960-4d85-be1c-c5415697b892 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:10.761856 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c6ddfb44-1960-4d85-be1c-c5415697b892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:10.776416 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:10.826735 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddfb44-1960-4d85-be1c-c5415697b892 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:10.830776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5669a0b-cab0-4a09-9a45-db8cee9dc5b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:10.831802 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5669a0b-cab0-4a09-9a45-db8cee9dc5b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:10.832273 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5669a0b-cab0-4a09-9a45-db8cee9dc5b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:10.832533 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5669a0b-cab0-4a09-9a45-db8cee9dc5b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:10.842454 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5669a0b-cab0-4a09-9a45-db8cee9dc5b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:10.843966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5669a0b-cab0-4a09-9a45-db8cee9dc5b7 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:10.853602 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1306/2611] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:03:10.901200 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2edc07-72fe-43c9-b7ae-0cfe47261066 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:10.903395 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1f2edc07-72fe-43c9-b7ae-0cfe47261066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:10.989486 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2edc07-72fe-43c9-b7ae-0cfe47261066 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:10.996151 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dfa1f-f251-4682-b35f-f4880ef550c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:10.996775 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dfa1f-f251-4682-b35f-f4880ef550c2 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:10.997055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dfa1f-f251-4682-b35f-f4880ef550c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:10.997327 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dfa1f-f251-4682-b35f-f4880ef550c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:10.999204 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-941dfa1f-f251-4682-b35f-f4880ef550c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:11.066416 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941dfa1f-f251-4682-b35f-f4880ef550c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:11.068112 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941dfa1f-f251-4682-b35f-f4880ef550c2 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:11.077201 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1306/2612] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:03:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:03:11.138832 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5669a0b-cab0-4a09-9a45-db8cee9dc5b7 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:11.140466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e5669a0b-cab0-4a09-9a45-db8cee9dc5b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:11.158213 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5669a0b-cab0-4a09-9a45-db8cee9dc5b7 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:11.167455 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17550c30-b1ea-413f-a430-5ef718a7a11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:11.168426 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17550c30-b1ea-413f-a430-5ef718a7a11c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:11.168803 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17550c30-b1ea-413f-a430-5ef718a7a11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:11.169148 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17550c30-b1ea-413f-a430-5ef718a7a11c admin admin] PATH_INFO: `/v3/projects/b4f9b9fbdd9744eda3bf8b5a02be41e6` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:11.170379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17550c30-b1ea-413f-a430-5ef718a7a11c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4f9b9fbdd9744eda3bf8b5a02be41e6)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:11.172792 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17550c30-b1ea-413f-a430-5ef718a7a11c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:11.259085 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-17550c30-b1ea-413f-a430-5ef718a7a11c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4f9b9fbdd9744eda3bf8b5a02be41e6', 'request_id': 'req-17550c30-b1ea-413f-a430-5ef718a7a11c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:11.269329 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-17550c30-b1ea-413f-a430-5ef718a7a11c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4f9b9fbdd9744eda3bf8b5a02be41e6', 'request_id': 'req-17550c30-b1ea-413f-a430-5ef718a7a11c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:11.276259 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-17550c30-b1ea-413f-a430-5ef718a7a11c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4f9b9fbdd9744eda3bf8b5a02be41e6', 'request_id': 'req-17550c30-b1ea-413f-a430-5ef718a7a11c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:11.288662 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-17550c30-b1ea-413f-a430-5ef718a7a11c admin admin] The token cache is being invalidate because project b4f9b9fbdd9744eda3bf8b5a02be41e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:03:11.288980 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-17550c30-b1ea-413f-a430-5ef718a7a11c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:11.289776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-17550c30-b1ea-413f-a430-5ef718a7a11c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:11.291409 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1307/2613] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:03:11 2022] DELETE /identity/v3/projects/b4f9b9fbdd9744eda3bf8b5a02be41e6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:03:11.296800 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4d730-afa7-4a7a-8bf9-f66802d369a9 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:11.297085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4d730-afa7-4a7a-8bf9-f66802d369a9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:11.297355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4d730-afa7-4a7a-8bf9-f66802d369a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:11.323309 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-75f4d730-afa7-4a7a-8bf9-f66802d369a9 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:11.324767 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-75f4d730-afa7-4a7a-8bf9-f66802d369a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:11.413629 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1307/2614] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 12:03:11.422481 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152284dd-50e3-471c-bb6a-e31a67d62051 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:11.422768 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152284dd-50e3-471c-bb6a-e31a67d62051 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:11.423037 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152284dd-50e3-471c-bb6a-e31a67d62051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:11.455829 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-152284dd-50e3-471c-bb6a-e31a67d62051 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:11.457344 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-152284dd-50e3-471c-bb6a-e31a67d62051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:11.466739 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1308/2615] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:03:11.471808 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4d730-afa7-4a7a-8bf9-f66802d369a9 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:11.479795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:11.489074 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4d730-afa7-4a7a-8bf9-f66802d369a9 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:11.495209 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee01f2f-2f39-41ab-afe1-d09eca4bf431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:11.495864 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee01f2f-2f39-41ab-afe1-d09eca4bf431 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:11.496139 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee01f2f-2f39-41ab-afe1-d09eca4bf431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:11.496407 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee01f2f-2f39-41ab-afe1-d09eca4bf431 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:11.497056 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee01f2f-2f39-41ab-afe1-d09eca4bf431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 12:03:11.497355 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee01f2f-2f39-41ab-afe1-d09eca4bf431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:11.499007 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee01f2f-2f39-41ab-afe1-d09eca4bf431 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:11.513686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1308/2616] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 12:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 12:03:11.518555 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152284dd-50e3-471c-bb6a-e31a67d62051 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:11.530748 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152284dd-50e3-471c-bb6a-e31a67d62051 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:11.536053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd1a70-cf4f-4d11-9932-54232733fb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:11.536677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd1a70-cf4f-4d11-9932-54232733fb01 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:11.537325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd1a70-cf4f-4d11-9932-54232733fb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:11.537325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd1a70-cf4f-4d11-9932-54232733fb01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:11.537999 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd1a70-cf4f-4d11-9932-54232733fb01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:11.540352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd1a70-cf4f-4d11-9932-54232733fb01 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:11.581485 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1309/2617] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:03:11 2022] POST /identity/v3/projects => generated 391 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:03:11.582941 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee01f2f-2f39-41ab-afe1-d09eca4bf431 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:11.594682 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee01f2f-2f39-41ab-afe1-d09eca4bf431 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:11.659023 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aade10-c8e3-4c3c-aec4-850a91566ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:11.659763 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aade10-c8e3-4c3c-aec4-850a91566ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:11.660046 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aade10-c8e3-4c3c-aec4-850a91566ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:11.660330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aade10-c8e3-4c3c-aec4-850a91566ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:11.660993 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aade10-c8e3-4c3c-aec4-850a91566ad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:11.663045 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aade10-c8e3-4c3c-aec4-850a91566ad7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:11.687220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1309/2618] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:03:11 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 12:03:11.692053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd1a70-cf4f-4d11-9932-54232733fb01 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:11.704046 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd1a70-cf4f-4d11-9932-54232733fb01 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:11.711592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b2854-dbce-4e74-bd11-b6c29f4118db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:11.711592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b2854-dbce-4e74-bd11-b6c29f4118db admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:11.711592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b2854-dbce-4e74-bd11-b6c29f4118db admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:11.711592 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b2854-dbce-4e74-bd11-b6c29f4118db admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:11.711987 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b2854-dbce-4e74-bd11-b6c29f4118db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:11.712408 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b2854-dbce-4e74-bd11-b6c29f4118db admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:11.724569 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1310/2619] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 12:03:11.728571 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aade10-c8e3-4c3c-aec4-850a91566ad7 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:11.738678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aade10-c8e3-4c3c-aec4-850a91566ad7 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:11.743384 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91005a-0691-4785-a19d-2a345e3f0778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:11.743998 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91005a-0691-4785-a19d-2a345e3f0778 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:11.744279 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91005a-0691-4785-a19d-2a345e3f0778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:11.744550 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91005a-0691-4785-a19d-2a345e3f0778 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:11.745192 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91005a-0691-4785-a19d-2a345e3f0778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:11.746842 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91005a-0691-4785-a19d-2a345e3f0778 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:11.757752 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1310/2620] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:03:11.762002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b2854-dbce-4e74-bd11-b6c29f4118db admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:11.772252 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b2854-dbce-4e74-bd11-b6c29f4118db admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:11.777804 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2b358-2775-4860-974f-ff034e91fa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:11.778454 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2b358-2775-4860-974f-ff034e91fa7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:11.778733 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2b358-2775-4860-974f-ff034e91fa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:11.778993 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2b358-2775-4860-974f-ff034e91fa7e admin admin] PATH_INFO: `/v3/projects/982ce239a8c549cd8c4ec3e993816810/users/93b8e30d888f408c88faa254a6214c29/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:11.794911 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2b358-2775-4860-974f-ff034e91fa7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=982ce239a8c549cd8c4ec3e993816810, user_id=93b8e30d888f408c88faa254a6214c29, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:11.797947 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2b358-2775-4860-974f-ff034e91fa7e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:11.813224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1311/2621] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:03:11 2022] PUT /identity/v3/projects/982ce239a8c549cd8c4ec3e993816810/users/93b8e30d888f408c88faa254a6214c29/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:03:11.823697 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddd136-8208-46f0-b454-ea2ffb35ef80 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:11.823986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddd136-8208-46f0-b454-ea2ffb35ef80 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:11.824260 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddd136-8208-46f0-b454-ea2ffb35ef80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:11.861710 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-52ddd136-8208-46f0-b454-ea2ffb35ef80 None None] MFA Rules not processed for user `93b8e30d888f408c88faa254a6214c29`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:11.863422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-52ddd136-8208-46f0-b454-ea2ffb35ef80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:11.949389 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1311/2622] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:03:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:03:11.964774 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2b358-2775-4860-974f-ff034e91fa7e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:11.967436 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7cc2b358-2775-4860-974f-ff034e91fa7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:12.010340 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:12.033673 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2b358-2775-4860-974f-ff034e91fa7e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:12.038050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcdd65-8b39-4474-b262-bf47a0081547 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:12.038655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcdd65-8b39-4474-b262-bf47a0081547 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:12.038929 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcdd65-8b39-4474-b262-bf47a0081547 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:12.039197 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcdd65-8b39-4474-b262-bf47a0081547 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:12.048593 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bcdd65-8b39-4474-b262-bf47a0081547 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:12.050203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bcdd65-8b39-4474-b262-bf47a0081547 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:12.059588 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1312/2623] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:03:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:03:21.944475 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=70,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:22.055753 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=11 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:22.253118 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddd136-8208-46f0-b454-ea2ffb35ef80 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:22.327550 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddd136-8208-46f0-b454-ea2ffb35ef80 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:22.332065 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c226077-305e-4abe-b617-60aff65229fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:22.332700 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c226077-305e-4abe-b617-60aff65229fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:22.332978 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c226077-305e-4abe-b617-60aff65229fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:22.333244 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c226077-305e-4abe-b617-60aff65229fe admin admin] PATH_INFO: `/v3/users/93b8e30d888f408c88faa254a6214c29` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:22.334378 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c226077-305e-4abe-b617-60aff65229fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=93b8e30d888f408c88faa254a6214c29)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:22.336320 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c226077-305e-4abe-b617-60aff65229fe admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:22.387507 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8c226077-305e-4abe-b617-60aff65229fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93b8e30d888f408c88faa254a6214c29'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:22.394174 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8c226077-305e-4abe-b617-60aff65229fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93b8e30d888f408c88faa254a6214c29'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:22.403205 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8c226077-305e-4abe-b617-60aff65229fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93b8e30d888f408c88faa254a6214c29'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:22.403824 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8c226077-305e-4abe-b617-60aff65229fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93b8e30d888f408c88faa254a6214c29'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:22.415554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8c226077-305e-4abe-b617-60aff65229fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93b8e30d888f408c88faa254a6214c29'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:22.421698 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1312/2624] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:03:22 2022] DELETE /identity/v3/users/93b8e30d888f408c88faa254a6214c29 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:03:22.426253 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785771be-0bd6-4ad4-af3c-81d799e1c70c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:22.426533 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785771be-0bd6-4ad4-af3c-81d799e1c70c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:22.426796 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785771be-0bd6-4ad4-af3c-81d799e1c70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:22.446152 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-785771be-0bd6-4ad4-af3c-81d799e1c70c None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:22.447458 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-785771be-0bd6-4ad4-af3c-81d799e1c70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:22.514199 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1313/2625] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 12:03:22.524802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c226077-305e-4abe-b617-60aff65229fe admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:22.526408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-8c226077-305e-4abe-b617-60aff65229fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:22.584908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c226077-305e-4abe-b617-60aff65229fe admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:22.588686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d84ac-5364-4218-afe6-0346f95e8027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:22.589299 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d84ac-5364-4218-afe6-0346f95e8027 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:22.589575 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d84ac-5364-4218-afe6-0346f95e8027 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:22.589842 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d84ac-5364-4218-afe6-0346f95e8027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:22.599149 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d84ac-5364-4218-afe6-0346f95e8027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:22.600715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d84ac-5364-4218-afe6-0346f95e8027 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:22.610940 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1313/2626] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:03:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:03:22.886514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785771be-0bd6-4ad4-af3c-81d799e1c70c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:22.888223 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-785771be-0bd6-4ad4-af3c-81d799e1c70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:22.902063 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785771be-0bd6-4ad4-af3c-81d799e1c70c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:22.907981 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f651d0-fa8b-42ba-9a63-be5cd064918e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:22.908782 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f651d0-fa8b-42ba-9a63-be5cd064918e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:22.908918 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f651d0-fa8b-42ba-9a63-be5cd064918e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:22.909180 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f651d0-fa8b-42ba-9a63-be5cd064918e admin admin] PATH_INFO: `/v3/projects/982ce239a8c549cd8c4ec3e993816810` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:22.910507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f651d0-fa8b-42ba-9a63-be5cd064918e admin admin] RBAC: Authorizing `identity:delete_project(project_id=982ce239a8c549cd8c4ec3e993816810)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:22.912451 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f651d0-fa8b-42ba-9a63-be5cd064918e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:22.961096 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a7f651d0-fa8b-42ba-9a63-be5cd064918e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '982ce239a8c549cd8c4ec3e993816810', 'request_id': 'req-a7f651d0-fa8b-42ba-9a63-be5cd064918e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:22.968180 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a7f651d0-fa8b-42ba-9a63-be5cd064918e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '982ce239a8c549cd8c4ec3e993816810', 'request_id': 'req-a7f651d0-fa8b-42ba-9a63-be5cd064918e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:22.974663 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a7f651d0-fa8b-42ba-9a63-be5cd064918e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '982ce239a8c549cd8c4ec3e993816810', 'request_id': 'req-a7f651d0-fa8b-42ba-9a63-be5cd064918e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:22.987188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a7f651d0-fa8b-42ba-9a63-be5cd064918e admin admin] The token cache is being invalidate because project 982ce239a8c549cd8c4ec3e993816810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:03:22.987515 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a7f651d0-fa8b-42ba-9a63-be5cd064918e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:22.988249 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a7f651d0-fa8b-42ba-9a63-be5cd064918e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:22.989926 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1314/2627] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:03:22 2022] DELETE /identity/v3/projects/982ce239a8c549cd8c4ec3e993816810 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:03:24.366802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d84ac-5364-4218-afe6-0346f95e8027 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:24.369089 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-178d84ac-5364-4218-afe6-0346f95e8027 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:24.404080 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:24.501007 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d84ac-5364-4218-afe6-0346f95e8027 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:24.620820 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10ac5f-8fd4-41e3-ba2e-cb5208b4afcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:24.621462 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10ac5f-8fd4-41e3-ba2e-cb5208b4afcc service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:24.621746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10ac5f-8fd4-41e3-ba2e-cb5208b4afcc service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:24.622089 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10ac5f-8fd4-41e3-ba2e-cb5208b4afcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:24.628600 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2d10ac5f-8fd4-41e3-ba2e-cb5208b4afcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:24.655705 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10ac5f-8fd4-41e3-ba2e-cb5208b4afcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:24.658747 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10ac5f-8fd4-41e3-ba2e-cb5208b4afcc service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:24.685397 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1314/2628] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:03:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:03:25.546397 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594527ac-0893-47d6-a68c-5f9cc6d1c889 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:25.546898 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594527ac-0893-47d6-a68c-5f9cc6d1c889 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:25.547002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594527ac-0893-47d6-a68c-5f9cc6d1c889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:25.572279 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-594527ac-0893-47d6-a68c-5f9cc6d1c889 None None] MFA Rules not processed for user `58c86110ce97463e9b3d53691ae3e12c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:25.574729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-594527ac-0893-47d6-a68c-5f9cc6d1c889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:25.646119 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1315/2629] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Aug 30 12:03:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:03:25.659736 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10ac5f-8fd4-41e3-ba2e-cb5208b4afcc service nova] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:25.661254 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2d10ac5f-8fd4-41e3-ba2e-cb5208b4afcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:25.756862 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10ac5f-8fd4-41e3-ba2e-cb5208b4afcc service nova] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:25.766423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5f34e-44af-485a-9bf2-b41983364661 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d27bfb8c0b64763b7db7cffa5f230f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:25.767075 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5f34e-44af-485a-9bf2-b41983364661 service swift] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:25.767326 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5f34e-44af-485a-9bf2-b41983364661 service swift] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:25.771423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5f34e-44af-485a-9bf2-b41983364661 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:25.782370 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5f34e-44af-485a-9bf2-b41983364661 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:25.784505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5f34e-44af-485a-9bf2-b41983364661 service swift] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:25.794525 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1315/2630] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Aug 30 12:03:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 12:03:27.296999 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594527ac-0893-47d6-a68c-5f9cc6d1c889 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:27.299436 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-594527ac-0893-47d6-a68c-5f9cc6d1c889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:27.347493 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594527ac-0893-47d6-a68c-5f9cc6d1c889 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:27.355226 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70a839-d42f-459f-9891-61757ecd151f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:27.355226 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70a839-d42f-459f-9891-61757ecd151f service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:27.355226 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70a839-d42f-459f-9891-61757ecd151f service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:27.355226 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70a839-d42f-459f-9891-61757ecd151f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:27.355601 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cd70a839-d42f-459f-9891-61757ecd151f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:27.369039 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70a839-d42f-459f-9891-61757ecd151f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:27.370718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70a839-d42f-459f-9891-61757ecd151f service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:27.384598 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1316/2631] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:03:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:03:29.893398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5f34e-44af-485a-9bf2-b41983364661 service swift] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:29.895195 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f0e5f34e-44af-485a-9bf2-b41983364661 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:29.939939 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:29.961124 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5f34e-44af-485a-9bf2-b41983364661 service swift] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:29.965934 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2719d68-1c98-44c4-893b-c030fbc3f0b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:29.965934 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2719d68-1c98-44c4-893b-c030fbc3f0b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:29.966194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2719d68-1c98-44c4-893b-c030fbc3f0b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:29.966402 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2719d68-1c98-44c4-893b-c030fbc3f0b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:29.968257 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c2719d68-1c98-44c4-893b-c030fbc3f0b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:29.979088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2719d68-1c98-44c4-893b-c030fbc3f0b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:29.980586 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2719d68-1c98-44c4-893b-c030fbc3f0b7 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:29.989208 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1316/2632] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:03:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:03:30.493478 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70a839-d42f-459f-9891-61757ecd151f service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:30.495060 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cd70a839-d42f-459f-9891-61757ecd151f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:30.512201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70a839-d42f-459f-9891-61757ecd151f service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:30.517536 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b88db-44ad-468e-89c7-34979b6f6333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:30.518304 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b88db-44ad-468e-89c7-34979b6f6333 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:30.518782 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b88db-44ad-468e-89c7-34979b6f6333 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:30.519243 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b88db-44ad-468e-89c7-34979b6f6333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:30.521200 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0a4b88db-44ad-468e-89c7-34979b6f6333 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:30.562785 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:30.633799 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b88db-44ad-468e-89c7-34979b6f6333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:30.635301 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b88db-44ad-468e-89c7-34979b6f6333 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:30.647028 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1317/2633] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:03:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:03:33.956913 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2719d68-1c98-44c4-893b-c030fbc3f0b7 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:33.966742 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2719d68-1c98-44c4-893b-c030fbc3f0b7 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:33.976485 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ea2e2-d311-4214-a2c9-72acb4e2ac6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:33.977426 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ea2e2-d311-4214-a2c9-72acb4e2ac6d service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:33.978000 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ea2e2-d311-4214-a2c9-72acb4e2ac6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:33.978282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ea2e2-d311-4214-a2c9-72acb4e2ac6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:33.980367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-263ea2e2-d311-4214-a2c9-72acb4e2ac6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:34.001436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ea2e2-d311-4214-a2c9-72acb4e2ac6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:34.003269 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ea2e2-d311-4214-a2c9-72acb4e2ac6d service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:34.018814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1317/2634] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:03:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:03:34.220536 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53d7f1-87a7-4b3d-bd32-85407935b954 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:34.221552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53d7f1-87a7-4b3d-bd32-85407935b954 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:34.221986 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53d7f1-87a7-4b3d-bd32-85407935b954 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:34.223546 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1318/2635] 10.222.0.27 () {54 vars in 921 bytes} [Tue Aug 30 12:03:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 12:03:34.233345 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dbced-6a80-42d2-a593-94c6c4095766 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:34.234070 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dbced-6a80-42d2-a593-94c6c4095766 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:34.234532 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dbced-6a80-42d2-a593-94c6c4095766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:34.258959 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-224dbced-6a80-42d2-a593-94c6c4095766 None None] MFA Rules not processed for user `f3be96d37b4e4dd889be755b004bfe52`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:34.261014 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-224dbced-6a80-42d2-a593-94c6c4095766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:34.269509 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1318/2636] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Aug 30 12:03:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:03:34.291593 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53d7f1-87a7-4b3d-bd32-85407935b954 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:34.309915 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53d7f1-87a7-4b3d-bd32-85407935b954 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:34.313766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9628c0-60a1-49c4-9c79-66a9af6af05d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:34.314580 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9628c0-60a1-49c4-9c79-66a9af6af05d service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:34.314671 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9628c0-60a1-49c4-9c79-66a9af6af05d service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:34.314951 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9628c0-60a1-49c4-9c79-66a9af6af05d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:34.327454 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9628c0-60a1-49c4-9c79-66a9af6af05d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:34.327454 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9628c0-60a1-49c4-9c79-66a9af6af05d service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:34.339500 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1319/2637] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:03:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:03:34.553979 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd1503-8ea5-426d-92ce-6e1fe01193c8 None None] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:34.554271 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd1503-8ea5-426d-92ce-6e1fe01193c8 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:34.554710 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd1503-8ea5-426d-92ce-6e1fe01193c8 None None] PATH_INFO: `/` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:34.556461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1319/2638] 10.222.0.27 () {54 vars in 921 bytes} [Tue Aug 30 12:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 12:03:34.573418 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510ad42-474a-4e46-81e1-335efefdd89a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:34.573917 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510ad42-474a-4e46-81e1-335efefdd89a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:34.574372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510ad42-474a-4e46-81e1-335efefdd89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:34.607951 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f510ad42-474a-4e46-81e1-335efefdd89a None None] MFA Rules not processed for user `8d17f1d0577a41ed8859706073f79d77`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:34.615674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f510ad42-474a-4e46-81e1-335efefdd89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:34.637390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1320/2639] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Aug 30 12:03:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:03:34.645888 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd1503-8ea5-426d-92ce-6e1fe01193c8 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:34.657152 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd1503-8ea5-426d-92ce-6e1fe01193c8 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:34.660754 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0a819-3406-4fca-8759-cae70512c6fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:34.661359 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0a819-3406-4fca-8759-cae70512c6fe service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:34.661637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0a819-3406-4fca-8759-cae70512c6fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:34.661905 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0a819-3406-4fca-8759-cae70512c6fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:34.674052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0a819-3406-4fca-8759-cae70512c6fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:34.675092 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0a819-3406-4fca-8759-cae70512c6fe service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:34.690601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1320/2640] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:03:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:03:34.806821 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcff32-52fd-4bdf-b156-f7fb2e73588f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:34.809691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcff32-52fd-4bdf-b156-f7fb2e73588f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:34.810184 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcff32-52fd-4bdf-b156-f7fb2e73588f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:34.812639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1321/2641] 10.222.0.27 () {54 vars in 961 bytes} [Tue Aug 30 12:03:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 12:03:34.820829 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eef4d1-5345-43f5-b00b-4d8745b09f63 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:34.821489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eef4d1-5345-43f5-b00b-4d8745b09f63 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:34.822060 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eef4d1-5345-43f5-b00b-4d8745b09f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:34.881947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e8eef4d1-5345-43f5-b00b-4d8745b09f63 None None] MFA Rules not processed for user `9efd2ac7fc4a42558e8dc48c408ce525`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:34.883671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e8eef4d1-5345-43f5-b00b-4d8745b09f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:35.026599 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1321/2642] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Aug 30 12:03:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 30 12:03:35.034616 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcff32-52fd-4bdf-b156-f7fb2e73588f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:35.050690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcff32-52fd-4bdf-b156-f7fb2e73588f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:35.057331 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ae690-026c-4e72-8306-0d7faa0e50eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9efd2ac7fc4a42558e8dc48c408ce525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:35.058389 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ae690-026c-4e72-8306-0d7faa0e50eb service placement] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:35.058873 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ae690-026c-4e72-8306-0d7faa0e50eb service placement] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:35.059381 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ae690-026c-4e72-8306-0d7faa0e50eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:35.062176 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-aa2ae690-026c-4e72-8306-0d7faa0e50eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:35.078966 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ae690-026c-4e72-8306-0d7faa0e50eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:35.081401 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ae690-026c-4e72-8306-0d7faa0e50eb service placement] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:35.107062 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1322/2643] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:03:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 12:03:35.347465 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eef4d1-5345-43f5-b00b-4d8745b09f63 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:35.349415 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e8eef4d1-5345-43f5-b00b-4d8745b09f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:35.373483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eef4d1-5345-43f5-b00b-4d8745b09f63 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:35.380842 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e131f3-0630-4127-9f1d-a2afb9143180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:35.381693 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e131f3-0630-4127-9f1d-a2afb9143180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:35.382344 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e131f3-0630-4127-9f1d-a2afb9143180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:35.384681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e131f3-0630-4127-9f1d-a2afb9143180 admin admin] PATH_INFO: `/v3/users/e9a57b9a59f84e16ac1e34d557d63a65` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:35.386144 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e131f3-0630-4127-9f1d-a2afb9143180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9a57b9a59f84e16ac1e34d557d63a65)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:35.390858 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e131f3-0630-4127-9f1d-a2afb9143180 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:35.511110 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-23e131f3-0630-4127-9f1d-a2afb9143180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9a57b9a59f84e16ac1e34d557d63a65'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:35.524693 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-23e131f3-0630-4127-9f1d-a2afb9143180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9a57b9a59f84e16ac1e34d557d63a65'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:35.543322 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-23e131f3-0630-4127-9f1d-a2afb9143180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9a57b9a59f84e16ac1e34d557d63a65'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:35.545412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-23e131f3-0630-4127-9f1d-a2afb9143180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9a57b9a59f84e16ac1e34d557d63a65'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:35.593364 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-23e131f3-0630-4127-9f1d-a2afb9143180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9a57b9a59f84e16ac1e34d557d63a65'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:35.625732 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1322/2644] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:03:35 2022] DELETE /identity/v3/users/e9a57b9a59f84e16ac1e34d557d63a65 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:03:35.890729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ae690-026c-4e72-8306-0d7faa0e50eb service placement] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:35.908573 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ae690-026c-4e72-8306-0d7faa0e50eb service placement] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:35.977608 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822906c-2406-4d5c-aeb0-018da8ffdf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:35.978758 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822906c-2406-4d5c-aeb0-018da8ffdf36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:35.978985 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822906c-2406-4d5c-aeb0-018da8ffdf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:35.979263 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822906c-2406-4d5c-aeb0-018da8ffdf36 admin admin] PATH_INFO: `/v3/projects/2f55b491c5594685b3fce63b764b1321` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:35.980599 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822906c-2406-4d5c-aeb0-018da8ffdf36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f55b491c5594685b3fce63b764b1321)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:35.982734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822906c-2406-4d5c-aeb0-018da8ffdf36 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:36.036956 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c822906c-2406-4d5c-aeb0-018da8ffdf36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f55b491c5594685b3fce63b764b1321', 'request_id': 'req-c822906c-2406-4d5c-aeb0-018da8ffdf36'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:36.046171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c822906c-2406-4d5c-aeb0-018da8ffdf36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f55b491c5594685b3fce63b764b1321', 'request_id': 'req-c822906c-2406-4d5c-aeb0-018da8ffdf36'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:36.053300 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c822906c-2406-4d5c-aeb0-018da8ffdf36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f55b491c5594685b3fce63b764b1321', 'request_id': 'req-c822906c-2406-4d5c-aeb0-018da8ffdf36'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:36.065778 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c822906c-2406-4d5c-aeb0-018da8ffdf36 admin admin] The token cache is being invalidate because project 2f55b491c5594685b3fce63b764b1321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:03:36.066144 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c822906c-2406-4d5c-aeb0-018da8ffdf36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:36.066843 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c822906c-2406-4d5c-aeb0-018da8ffdf36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:03:36.068448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1323/2645] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:03:35 2022] DELETE /identity/v3/projects/2f55b491c5594685b3fce63b764b1321 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:03:36.073702 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109a51f-06bf-4880-b4a3-9db427749ad9 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:36.074174 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109a51f-06bf-4880-b4a3-9db427749ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:36.074423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109a51f-06bf-4880-b4a3-9db427749ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:36.095280 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-0109a51f-06bf-4880-b4a3-9db427749ad9 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:36.096465 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0109a51f-06bf-4880-b4a3-9db427749ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:36.106765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:36.166451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1323/2646] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:03:36.174622 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f15575-cc22-4253-8ead-9126d45e9be9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:36.174942 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f15575-cc22-4253-8ead-9126d45e9be9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:36.175222 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f15575-cc22-4253-8ead-9126d45e9be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:36.191256 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:36.197710 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-72f15575-cc22-4253-8ead-9126d45e9be9 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:36.199640 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-72f15575-cc22-4253-8ead-9126d45e9be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:36.207904 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1324/2647] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 12:03:36.212497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109a51f-06bf-4880-b4a3-9db427749ad9 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:36.222583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109a51f-06bf-4880-b4a3-9db427749ad9 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:36.228264 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762cdd9-ae49-469b-a567-672a59364191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:36.228859 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762cdd9-ae49-469b-a567-672a59364191 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:36.229137 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762cdd9-ae49-469b-a567-672a59364191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:36.229436 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762cdd9-ae49-469b-a567-672a59364191 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:36.230087 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762cdd9-ae49-469b-a567-672a59364191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 12:03:36.230404 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762cdd9-ae49-469b-a567-672a59364191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:36.232072 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762cdd9-ae49-469b-a567-672a59364191 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:36.244879 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1324/2648] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 12:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 12:03:36.249368 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f15575-cc22-4253-8ead-9126d45e9be9 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:36.259048 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f15575-cc22-4253-8ead-9126d45e9be9 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:36.264583 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58a2f8-b0f4-4df3-99b9-b7daf814ce20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:36.265200 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58a2f8-b0f4-4df3-99b9-b7daf814ce20 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:36.265479 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58a2f8-b0f4-4df3-99b9-b7daf814ce20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:36.265751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58a2f8-b0f4-4df3-99b9-b7daf814ce20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:36.266407 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58a2f8-b0f4-4df3-99b9-b7daf814ce20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:36.268341 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58a2f8-b0f4-4df3-99b9-b7daf814ce20 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:36.306007 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1325/2649] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:03:36 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:03:36.311974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762cdd9-ae49-469b-a567-672a59364191 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:36.323543 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762cdd9-ae49-469b-a567-672a59364191 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:36.387227 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293b278-94ef-4dbc-b1c6-e0bc0e9e19fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:36.387812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293b278-94ef-4dbc-b1c6-e0bc0e9e19fd admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:36.388094 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293b278-94ef-4dbc-b1c6-e0bc0e9e19fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:36.388347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293b278-94ef-4dbc-b1c6-e0bc0e9e19fd admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:36.389187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293b278-94ef-4dbc-b1c6-e0bc0e9e19fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:36.391118 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293b278-94ef-4dbc-b1c6-e0bc0e9e19fd admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:36.418258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1325/2650] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:03:36 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:03:36.424480 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58a2f8-b0f4-4df3-99b9-b7daf814ce20 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:36.436357 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58a2f8-b0f4-4df3-99b9-b7daf814ce20 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:36.442366 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bab6d-aece-464b-85d4-d4a33215f4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:36.444287 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bab6d-aece-464b-85d4-d4a33215f4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:36.444644 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bab6d-aece-464b-85d4-d4a33215f4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:36.445191 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bab6d-aece-464b-85d4-d4a33215f4d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:36.446564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910bab6d-aece-464b-85d4-d4a33215f4d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:36.448514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910bab6d-aece-464b-85d4-d4a33215f4d6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:36.462534 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1326/2651] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:03:36.467971 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293b278-94ef-4dbc-b1c6-e0bc0e9e19fd admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:36.482108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293b278-94ef-4dbc-b1c6-e0bc0e9e19fd admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:36.488362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ad0fd-561a-4019-a26c-e582de52802d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:36.489078 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ad0fd-561a-4019-a26c-e582de52802d admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:36.489420 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ad0fd-561a-4019-a26c-e582de52802d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:36.489762 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ad0fd-561a-4019-a26c-e582de52802d admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:36.490523 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ad0fd-561a-4019-a26c-e582de52802d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:36.493369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ad0fd-561a-4019-a26c-e582de52802d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:36.505906 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1326/2652] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:03:36.510471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bab6d-aece-464b-85d4-d4a33215f4d6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:36.524326 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bab6d-aece-464b-85d4-d4a33215f4d6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:36.531868 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb267958-9672-44b4-999c-5acc1add057a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:36.533233 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb267958-9672-44b4-999c-5acc1add057a admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:36.533666 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb267958-9672-44b4-999c-5acc1add057a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:36.534024 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb267958-9672-44b4-999c-5acc1add057a admin admin] PATH_INFO: `/v3/projects/d3babbf0ce454415b96b5ada93fc9ddb/users/b7c2b1ed867340eaa82e319f528452b3/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:36.551482 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb267958-9672-44b4-999c-5acc1add057a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3babbf0ce454415b96b5ada93fc9ddb, user_id=b7c2b1ed867340eaa82e319f528452b3, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:36.554230 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb267958-9672-44b4-999c-5acc1add057a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:36.569604 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1327/2653] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:03:36 2022] PUT /identity/v3/projects/d3babbf0ce454415b96b5ada93fc9ddb/users/b7c2b1ed867340eaa82e319f528452b3/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:03:36.575024 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1159fc-d976-40bb-8336-2fc47fcc5fd2 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:36.575315 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1159fc-d976-40bb-8336-2fc47fcc5fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:36.575647 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1159fc-d976-40bb-8336-2fc47fcc5fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:36.595407 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-5f1159fc-d976-40bb-8336-2fc47fcc5fd2 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:36.596859 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5f1159fc-d976-40bb-8336-2fc47fcc5fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:36.685403 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1327/2654] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:03:36.694933 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb267958-9672-44b4-999c-5acc1add057a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:36.696995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bb267958-9672-44b4-999c-5acc1add057a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:36.772060 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb267958-9672-44b4-999c-5acc1add057a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:36.778107 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde234bb-86a0-4c47-9f5b-6d43dced63b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:36.778746 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde234bb-86a0-4c47-9f5b-6d43dced63b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:36.779038 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde234bb-86a0-4c47-9f5b-6d43dced63b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:36.779307 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde234bb-86a0-4c47-9f5b-6d43dced63b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:36.790070 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde234bb-86a0-4c47-9f5b-6d43dced63b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:36.791552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde234bb-86a0-4c47-9f5b-6d43dced63b7 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:36.804492 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1328/2655] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:03:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:03:42.024381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895735d8-7833-4b04-bb45-b0a9a7877a92 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:42.024862 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895735d8-7833-4b04-bb45-b0a9a7877a92 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:42.024965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895735d8-7833-4b04-bb45-b0a9a7877a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:42.078012 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-895735d8-7833-4b04-bb45-b0a9a7877a92 None None] MFA Rules not processed for user `b7c2b1ed867340eaa82e319f528452b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:42.079392 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-895735d8-7833-4b04-bb45-b0a9a7877a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:42.099063 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:42.222628 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1328/2656] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:03:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:03:42.231333 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde234bb-86a0-4c47-9f5b-6d43dced63b7 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:42.233062 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dde234bb-86a0-4c47-9f5b-6d43dced63b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:42.316301 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde234bb-86a0-4c47-9f5b-6d43dced63b7 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:42.321806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fdf80-b0dd-45db-a64f-2a1373cfa912 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:42.322463 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fdf80-b0dd-45db-a64f-2a1373cfa912 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:42.322772 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fdf80-b0dd-45db-a64f-2a1373cfa912 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:42.323048 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fdf80-b0dd-45db-a64f-2a1373cfa912 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:42.331824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93fdf80-b0dd-45db-a64f-2a1373cfa912 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:42.333500 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93fdf80-b0dd-45db-a64f-2a1373cfa912 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:42.342504 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1329/2657] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:03:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:03:42.920827 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae647f-3644-443f-a0b0-38388a3b1c68 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:42.921332 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae647f-3644-443f-a0b0-38388a3b1c68 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:42.921851 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae647f-3644-443f-a0b0-38388a3b1c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:42.943469 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-ebae647f-3644-443f-a0b0-38388a3b1c68 None None] MFA Rules not processed for user `58c86110ce97463e9b3d53691ae3e12c`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:42.944873 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-ebae647f-3644-443f-a0b0-38388a3b1c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:43.019387 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1329/2658] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Aug 30 12:03:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 12:03:43.035139 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fdf80-b0dd-45db-a64f-2a1373cfa912 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:43.036680 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b93fdf80-b0dd-45db-a64f-2a1373cfa912 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:43.075192 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:43.133241 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fdf80-b0dd-45db-a64f-2a1373cfa912 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:43.138611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f828c5-a3c2-40c0-b8ae-c11f25fdb6bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d27bfb8c0b64763b7db7cffa5f230f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:43.139247 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f828c5-a3c2-40c0-b8ae-c11f25fdb6bd service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:43.139589 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f828c5-a3c2-40c0-b8ae-c11f25fdb6bd service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:43.139868 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f828c5-a3c2-40c0-b8ae-c11f25fdb6bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:43.149302 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f828c5-a3c2-40c0-b8ae-c11f25fdb6bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:43.151230 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f828c5-a3c2-40c0-b8ae-c11f25fdb6bd service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:43.160224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1330/2659] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Aug 30 12:03:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 12:03:44.622338 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0f24e-ec09-47fd-9acd-cf02cb4c3715 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:44.622821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0f24e-ec09-47fd-9acd-cf02cb4c3715 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:44.623033 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0f24e-ec09-47fd-9acd-cf02cb4c3715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:44.659913 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-afc0f24e-ec09-47fd-9acd-cf02cb4c3715 None None] MFA Rules not processed for user `b7c2b1ed867340eaa82e319f528452b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:44.661639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-afc0f24e-ec09-47fd-9acd-cf02cb4c3715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:44.705310 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1330/2660] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:03:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:03:45.228172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f828c5-a3c2-40c0-b8ae-c11f25fdb6bd service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:45.241704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f828c5-a3c2-40c0-b8ae-c11f25fdb6bd service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:45.264491 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92542051-1602-4b29-95a7-c579f23bfb0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:45.265656 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92542051-1602-4b29-95a7-c579f23bfb0d service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:45.266167 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92542051-1602-4b29-95a7-c579f23bfb0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:45.266591 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92542051-1602-4b29-95a7-c579f23bfb0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:45.273312 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-92542051-1602-4b29-95a7-c579f23bfb0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:45.303027 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92542051-1602-4b29-95a7-c579f23bfb0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:45.306496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92542051-1602-4b29-95a7-c579f23bfb0d service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:45.338331 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1331/2661] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:03:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:03:54.644730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=51 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:55.321908 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=24 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:03:59.136116 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad9b30-21a3-4329-bea2-4fb9b690fb56 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:59.136579 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad9b30-21a3-4329-bea2-4fb9b690fb56 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:59.136699 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad9b30-21a3-4329-bea2-4fb9b690fb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:59.156322 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d5ad9b30-21a3-4329-bea2-4fb9b690fb56 None None] MFA Rules not processed for user `58c86110ce97463e9b3d53691ae3e12c`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:03:59.157507 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d5ad9b30-21a3-4329-bea2-4fb9b690fb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:03:59.164860 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1331/2662] 10.222.0.27 () {58 vars in 967 bytes} [Tue Aug 30 12:03:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:03:59.178206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92542051-1602-4b29-95a7-c579f23bfb0d service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:03:59.191692 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92542051-1602-4b29-95a7-c579f23bfb0d service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:03:59.197556 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2a83b-45be-4b1f-b88f-be6d52fc6cc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d27bfb8c0b64763b7db7cffa5f230f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:03:59.198297 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2a83b-45be-4b1f-b88f-be6d52fc6cc9 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:03:59.198577 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2a83b-45be-4b1f-b88f-be6d52fc6cc9 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:03:59.198843 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2a83b-45be-4b1f-b88f-be6d52fc6cc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:03:59.208143 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2a83b-45be-4b1f-b88f-be6d52fc6cc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:03:59.210171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2a83b-45be-4b1f-b88f-be6d52fc6cc9 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:03:59.219515 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1332/2663] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Aug 30 12:03:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 12:04:04.455934 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad9b30-21a3-4329-bea2-4fb9b690fb56 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:04.470332 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad9b30-21a3-4329-bea2-4fb9b690fb56 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:04.476021 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02264ae8-3a4d-4963-9eb6-c98b2c306038 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d17f1d0577a41ed8859706073f79d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:04.476629 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02264ae8-3a4d-4963-9eb6-c98b2c306038 service nova] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:04.476929 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02264ae8-3a4d-4963-9eb6-c98b2c306038 service nova] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:04.477195 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02264ae8-3a4d-4963-9eb6-c98b2c306038 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:04.479076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-02264ae8-3a4d-4963-9eb6-c98b2c306038 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:04.491429 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02264ae8-3a4d-4963-9eb6-c98b2c306038 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:04.493038 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02264ae8-3a4d-4963-9eb6-c98b2c306038 service nova] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:04.504042 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1332/2664] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:04:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:04:09.215692 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=6 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:04:14.499403 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=9 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:04:40.647610 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2a83b-45be-4b1f-b88f-be6d52fc6cc9 service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:40.648984 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-10f2a83b-45be-4b1f-b88f-be6d52fc6cc9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:40.661448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2a83b-45be-4b1f-b88f-be6d52fc6cc9 service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:40.666595 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963a860-5c47-4f2f-af8c-06c073c9c58f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:40.667476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963a860-5c47-4f2f-af8c-06c073c9c58f service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:40.667755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963a860-5c47-4f2f-af8c-06c073c9c58f service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:40.668027 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963a860-5c47-4f2f-af8c-06c073c9c58f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:40.670018 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d963a860-5c47-4f2f-af8c-06c073c9c58f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:40.685092 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963a860-5c47-4f2f-af8c-06c073c9c58f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:40.686946 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963a860-5c47-4f2f-af8c-06c073c9c58f service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:40.698486 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1333/2665] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:04:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:04:43.937039 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02264ae8-3a4d-4963-9eb6-c98b2c306038 service nova] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:43.939039 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-02264ae8-3a4d-4963-9eb6-c98b2c306038 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:44.004904 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963a860-5c47-4f2f-af8c-06c073c9c58f service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:44.006719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d963a860-5c47-4f2f-af8c-06c073c9c58f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:44.022164 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963a860-5c47-4f2f-af8c-06c073c9c58f service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:44.028014 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a4b3d-00f9-4589-bcac-100d25110f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:44.028658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a4b3d-00f9-4589-bcac-100d25110f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:44.028940 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a4b3d-00f9-4589-bcac-100d25110f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:44.029412 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a4b3d-00f9-4589-bcac-100d25110f67 admin admin] PATH_INFO: `/v3/users/588d11e6ed3b4eda8c74e782669a63af` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:44.030554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a4b3d-00f9-4589-bcac-100d25110f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=588d11e6ed3b4eda8c74e782669a63af)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:44.032678 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a4b3d-00f9-4589-bcac-100d25110f67 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:44.053119 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02264ae8-3a4d-4963-9eb6-c98b2c306038 service nova] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:44.063395 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a5363-22d5-479b-8868-67aa694b0079 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9efd2ac7fc4a42558e8dc48c408ce525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:44.064283 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a5363-22d5-479b-8868-67aa694b0079 service placement] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:44.064845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a5363-22d5-479b-8868-67aa694b0079 service placement] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:44.065091 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a5363-22d5-479b-8868-67aa694b0079 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:44.067768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1e6a5363-22d5-479b-8868-67aa694b0079 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:44.085724 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a5363-22d5-479b-8868-67aa694b0079 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:44.090095 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a5363-22d5-479b-8868-67aa694b0079 service placement] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:44.094195 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-094a4b3d-00f9-4589-bcac-100d25110f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '588d11e6ed3b4eda8c74e782669a63af'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:44.101695 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1333/2666] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:04:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:04:44.108813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-094a4b3d-00f9-4589-bcac-100d25110f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '588d11e6ed3b4eda8c74e782669a63af'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:44.124571 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-094a4b3d-00f9-4589-bcac-100d25110f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '588d11e6ed3b4eda8c74e782669a63af'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:44.140192 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-094a4b3d-00f9-4589-bcac-100d25110f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '588d11e6ed3b4eda8c74e782669a63af'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:44.148017 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-094a4b3d-00f9-4589-bcac-100d25110f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '588d11e6ed3b4eda8c74e782669a63af'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:44.155555 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1334/2667] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:04:44 2022] DELETE /identity/v3/users/588d11e6ed3b4eda8c74e782669a63af => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:04:44.346695 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a5363-22d5-479b-8868-67aa694b0079 service placement] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:44.358888 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a5363-22d5-479b-8868-67aa694b0079 service placement] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:44.431740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644bbfa-63ac-414f-b62b-e5da9932f9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:44.432376 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644bbfa-63ac-414f-b62b-e5da9932f9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:44.432648 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644bbfa-63ac-414f-b62b-e5da9932f9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:44.432912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644bbfa-63ac-414f-b62b-e5da9932f9ab admin admin] PATH_INFO: `/v3/projects/74303e62c3b84d2389603c8be4aa01fb` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:44.434021 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644bbfa-63ac-414f-b62b-e5da9932f9ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=74303e62c3b84d2389603c8be4aa01fb)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:44.435970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644bbfa-63ac-414f-b62b-e5da9932f9ab admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:44.489045 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5644bbfa-63ac-414f-b62b-e5da9932f9ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74303e62c3b84d2389603c8be4aa01fb', 'request_id': 'req-5644bbfa-63ac-414f-b62b-e5da9932f9ab'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:44.500309 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5644bbfa-63ac-414f-b62b-e5da9932f9ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74303e62c3b84d2389603c8be4aa01fb', 'request_id': 'req-5644bbfa-63ac-414f-b62b-e5da9932f9ab'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:44.507052 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5644bbfa-63ac-414f-b62b-e5da9932f9ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74303e62c3b84d2389603c8be4aa01fb', 'request_id': 'req-5644bbfa-63ac-414f-b62b-e5da9932f9ab'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:44.522038 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5644bbfa-63ac-414f-b62b-e5da9932f9ab admin admin] The token cache is being invalidate because project 74303e62c3b84d2389603c8be4aa01fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:04:44.522430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5644bbfa-63ac-414f-b62b-e5da9932f9ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:44.523125 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5644bbfa-63ac-414f-b62b-e5da9932f9ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:44.524728 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1334/2668] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:04:44 2022] DELETE /identity/v3/projects/74303e62c3b84d2389603c8be4aa01fb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:04:44.529928 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374527a-46c8-4f53-9662-a876a6c2d1b7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:44.530214 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374527a-46c8-4f53-9662-a876a6c2d1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:44.530487 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374527a-46c8-4f53-9662-a876a6c2d1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:44.553669 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3374527a-46c8-4f53-9662-a876a6c2d1b7 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:04:44.554957 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3374527a-46c8-4f53-9662-a876a6c2d1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:44.623330 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1335/2669] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:04:44.632500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691f946-30e2-495c-90a7-eef5d2732604 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:44.632776 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691f946-30e2-495c-90a7-eef5d2732604 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:44.633046 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691f946-30e2-495c-90a7-eef5d2732604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:44.654461 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2691f946-30e2-495c-90a7-eef5d2732604 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:04:44.655755 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2691f946-30e2-495c-90a7-eef5d2732604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:44.665176 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1335/2670] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:04:44.669518 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374527a-46c8-4f53-9662-a876a6c2d1b7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:44.679845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374527a-46c8-4f53-9662-a876a6c2d1b7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:44.685250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d50444-e351-4e24-a8fc-3fb3275955f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:44.685862 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d50444-e351-4e24-a8fc-3fb3275955f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:44.686140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d50444-e351-4e24-a8fc-3fb3275955f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:44.686409 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d50444-e351-4e24-a8fc-3fb3275955f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:44.687053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d50444-e351-4e24-a8fc-3fb3275955f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 12:04:44.687375 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d50444-e351-4e24-a8fc-3fb3275955f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:44.689011 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d50444-e351-4e24-a8fc-3fb3275955f3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:44.701157 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1336/2671] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 12:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 12:04:44.705607 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691f946-30e2-495c-90a7-eef5d2732604 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:44.715696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691f946-30e2-495c-90a7-eef5d2732604 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:44.722458 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84031d8-eb51-4011-b66b-e254e6555e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:44.723069 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84031d8-eb51-4011-b66b-e254e6555e57 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:44.723352 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84031d8-eb51-4011-b66b-e254e6555e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:44.724058 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84031d8-eb51-4011-b66b-e254e6555e57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:44.724704 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84031d8-eb51-4011-b66b-e254e6555e57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:44.726621 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84031d8-eb51-4011-b66b-e254e6555e57 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:44.738188 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:04:44.760167 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1336/2672] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:04:44 2022] POST /identity/v3/projects => generated 403 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:04:44.761461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d50444-e351-4e24-a8fc-3fb3275955f3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:44.772891 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d50444-e351-4e24-a8fc-3fb3275955f3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:44.818572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:04:44.838166 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa81abb-b9e9-4a20-a091-0452e2b4b0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:44.838791 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa81abb-b9e9-4a20-a091-0452e2b4b0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:44.839066 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa81abb-b9e9-4a20-a091-0452e2b4b0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:44.839308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa81abb-b9e9-4a20-a091-0452e2b4b0c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:44.839979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa81abb-b9e9-4a20-a091-0452e2b4b0c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:44.841905 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa81abb-b9e9-4a20-a091-0452e2b4b0c7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:44.867445 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1337/2673] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:04:44 2022] POST /identity/v3/users => generated 302 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:04:44.871668 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84031d8-eb51-4011-b66b-e254e6555e57 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:44.882504 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84031d8-eb51-4011-b66b-e254e6555e57 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:44.887806 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c421c-438b-4a01-8dc6-e753c1a68baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:44.888419 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c421c-438b-4a01-8dc6-e753c1a68baa admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:44.888694 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c421c-438b-4a01-8dc6-e753c1a68baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:44.888964 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c421c-438b-4a01-8dc6-e753c1a68baa admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:44.889595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c421c-438b-4a01-8dc6-e753c1a68baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:44.891326 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c421c-438b-4a01-8dc6-e753c1a68baa admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:44.903297 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1337/2674] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:04:44.906475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa81abb-b9e9-4a20-a091-0452e2b4b0c7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:44.917639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa81abb-b9e9-4a20-a091-0452e2b4b0c7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:44.922450 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd17c7e-ae48-4ee9-ae19-b6ac3df319b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:44.925371 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd17c7e-ae48-4ee9-ae19-b6ac3df319b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:44.925371 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd17c7e-ae48-4ee9-ae19-b6ac3df319b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:44.925371 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd17c7e-ae48-4ee9-ae19-b6ac3df319b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:44.925371 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd17c7e-ae48-4ee9-ae19-b6ac3df319b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:44.926350 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd17c7e-ae48-4ee9-ae19-b6ac3df319b2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:44.941258 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1338/2675] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:04:44.943592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c421c-438b-4a01-8dc6-e753c1a68baa admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:44.954450 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c421c-438b-4a01-8dc6-e753c1a68baa admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:44.960377 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf93ac-cfe2-42fb-8de0-4e5de83d543b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:44.961208 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf93ac-cfe2-42fb-8de0-4e5de83d543b admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:44.962008 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf93ac-cfe2-42fb-8de0-4e5de83d543b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:44.962385 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf93ac-cfe2-42fb-8de0-4e5de83d543b admin admin] PATH_INFO: `/v3/projects/e2bcde5d4a3947738743d6c633066fd8/users/410fd041f59f46a08227d7b0ab2be265/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:44.981023 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf93ac-cfe2-42fb-8de0-4e5de83d543b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2bcde5d4a3947738743d6c633066fd8, user_id=410fd041f59f46a08227d7b0ab2be265, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:44.984293 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf93ac-cfe2-42fb-8de0-4e5de83d543b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:45.000358 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1338/2676] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:04:44 2022] PUT /identity/v3/projects/e2bcde5d4a3947738743d6c633066fd8/users/410fd041f59f46a08227d7b0ab2be265/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:04:45.006090 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e293c-7692-41b0-9bcd-b718907dbea3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:45.006958 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e293c-7692-41b0-9bcd-b718907dbea3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:45.007232 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e293c-7692-41b0-9bcd-b718907dbea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:45.030001 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-943e293c-7692-41b0-9bcd-b718907dbea3 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:04:45.031215 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-943e293c-7692-41b0-9bcd-b718907dbea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:45.094191 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1339/2677] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:04:45.106210 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf93ac-cfe2-42fb-8de0-4e5de83d543b admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:45.108088 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-7cdf93ac-cfe2-42fb-8de0-4e5de83d543b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:45.169425 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf93ac-cfe2-42fb-8de0-4e5de83d543b admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:45.174673 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285314e7-61f8-4232-ab92-14be8e1e94e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:45.175552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285314e7-61f8-4232-ab92-14be8e1e94e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:45.175843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285314e7-61f8-4232-ab92-14be8e1e94e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:45.176114 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285314e7-61f8-4232-ab92-14be8e1e94e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:45.186817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285314e7-61f8-4232-ab92-14be8e1e94e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:45.188624 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285314e7-61f8-4232-ab92-14be8e1e94e1 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:45.199704 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1339/2678] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:04:45.368583 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1a6f8-adb7-48de-bb41-e21509c51245 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:45.369348 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1a6f8-adb7-48de-bb41-e21509c51245 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:45.369698 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1a6f8-adb7-48de-bb41-e21509c51245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:45.392529 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-88f1a6f8-adb7-48de-bb41-e21509c51245 None None] MFA Rules not processed for user `b7c2b1ed867340eaa82e319f528452b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:04:45.394234 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-88f1a6f8-adb7-48de-bb41-e21509c51245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:45.457144 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1340/2679] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:04:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:04:45.853589 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5831f55-da11-4679-8b0f-c0226c1cdd21 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:45.853909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5831f55-da11-4679-8b0f-c0226c1cdd21 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:45.854187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5831f55-da11-4679-8b0f-c0226c1cdd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:45.884875 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f5831f55-da11-4679-8b0f-c0226c1cdd21 None None] MFA Rules not processed for user `410fd041f59f46a08227d7b0ab2be265`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:04:45.886235 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f5831f55-da11-4679-8b0f-c0226c1cdd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:45.961484 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1340/2680] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:04:45 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:04:45.966225 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1a6f8-adb7-48de-bb41-e21509c51245 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:45.978547 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1a6f8-adb7-48de-bb41-e21509c51245 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:45.983093 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48889a18-89f9-4b76-9c5c-e813ac2f0880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:45.983819 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48889a18-89f9-4b76-9c5c-e813ac2f0880 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:45.984283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48889a18-89f9-4b76-9c5c-e813ac2f0880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:45.984620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48889a18-89f9-4b76-9c5c-e813ac2f0880 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:45.985317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48889a18-89f9-4b76-9c5c-e813ac2f0880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:45.987377 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48889a18-89f9-4b76-9c5c-e813ac2f0880 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:46.026058 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1341/2681] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:04:45 2022] POST /identity/v3/projects => generated 405 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 12:04:46.027201 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5831f55-da11-4679-8b0f-c0226c1cdd21 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:46.038702 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5831f55-da11-4679-8b0f-c0226c1cdd21 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:46.091955 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:04:46.105572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f715e-b313-40d5-ad3f-dcfc920d7820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:46.106287 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f715e-b313-40d5-ad3f-dcfc920d7820 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:46.106639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f715e-b313-40d5-ad3f-dcfc920d7820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:46.106982 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f715e-b313-40d5-ad3f-dcfc920d7820 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:46.107746 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f715e-b313-40d5-ad3f-dcfc920d7820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:46.109759 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f715e-b313-40d5-ad3f-dcfc920d7820 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:46.141100 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1341/2682] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:04:46 2022] POST /identity/v3/users => generated 309 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:04:46.145205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48889a18-89f9-4b76-9c5c-e813ac2f0880 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:46.156167 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48889a18-89f9-4b76-9c5c-e813ac2f0880 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:46.162372 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caba0a-35ca-4484-8445-8f6e6c348e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:46.163248 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caba0a-35ca-4484-8445-8f6e6c348e1a admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:46.163724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caba0a-35ca-4484-8445-8f6e6c348e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:46.164568 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caba0a-35ca-4484-8445-8f6e6c348e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:46.165390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0caba0a-35ca-4484-8445-8f6e6c348e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:46.167195 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0caba0a-35ca-4484-8445-8f6e6c348e1a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:46.181798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1342/2683] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:04:46.183761 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f715e-b313-40d5-ad3f-dcfc920d7820 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:46.200241 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f715e-b313-40d5-ad3f-dcfc920d7820 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:46.204991 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2f971-8bb2-47f3-9792-c51d04f4bdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:46.205874 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2f971-8bb2-47f3-9792-c51d04f4bdec admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:46.206210 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2f971-8bb2-47f3-9792-c51d04f4bdec admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:46.206479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2f971-8bb2-47f3-9792-c51d04f4bdec admin admin] PATH_INFO: `/v3/projects/386ad11db6eb425b9366f9f18926b618/users/a06685eaff3b4263945840d28077341f/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:46.222040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2f971-8bb2-47f3-9792-c51d04f4bdec admin admin] RBAC: Authorizing `identity:create_grant(project_id=386ad11db6eb425b9366f9f18926b618, user_id=a06685eaff3b4263945840d28077341f, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:46.224748 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2f971-8bb2-47f3-9792-c51d04f4bdec admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:46.239628 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1342/2684] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:04:46 2022] PUT /identity/v3/projects/386ad11db6eb425b9366f9f18926b618/users/a06685eaff3b4263945840d28077341f/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:04:46.243594 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caba0a-35ca-4484-8445-8f6e6c348e1a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:46.255600 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caba0a-35ca-4484-8445-8f6e6c348e1a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:46.293424 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:04:46.317144 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15d67d-add8-42b9-93c1-3cc60f70005a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:46.317849 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15d67d-add8-42b9-93c1-3cc60f70005a admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:46.318125 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15d67d-add8-42b9-93c1-3cc60f70005a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:46.318397 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15d67d-add8-42b9-93c1-3cc60f70005a admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:46.319075 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15d67d-add8-42b9-93c1-3cc60f70005a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:46.320733 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15d67d-add8-42b9-93c1-3cc60f70005a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:46.334480 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1343/2685] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:04:46.335717 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2f971-8bb2-47f3-9792-c51d04f4bdec admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:46.353817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2f971-8bb2-47f3-9792-c51d04f4bdec admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:46.359163 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87049455-ea95-4f49-b85e-efeb53d81e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:46.359944 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87049455-ea95-4f49-b85e-efeb53d81e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:46.360229 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87049455-ea95-4f49-b85e-efeb53d81e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:46.360518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87049455-ea95-4f49-b85e-efeb53d81e95 admin admin] PATH_INFO: `/v3/projects/386ad11db6eb425b9366f9f18926b618/users/a06685eaff3b4263945840d28077341f/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:46.363012 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87049455-ea95-4f49-b85e-efeb53d81e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=386ad11db6eb425b9366f9f18926b618, user_id=a06685eaff3b4263945840d28077341f, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:46.365752 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87049455-ea95-4f49-b85e-efeb53d81e95 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:46.378317 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1343/2686] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:04:46 2022] PUT /identity/v3/projects/386ad11db6eb425b9366f9f18926b618/users/a06685eaff3b4263945840d28077341f/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:04:47.057647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbe467-3bfd-4c92-b289-48733f91a764 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:47.058212 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbe467-3bfd-4c92-b289-48733f91a764 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:47.058375 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbe467-3bfd-4c92-b289-48733f91a764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:47.087287 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8edbe467-3bfd-4c92-b289-48733f91a764 None None] MFA Rules not processed for user `a06685eaff3b4263945840d28077341f`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:04:47.088563 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8edbe467-3bfd-4c92-b289-48733f91a764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:47.169618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1344/2687] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:04:47 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:04:48.430997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87049455-ea95-4f49-b85e-efeb53d81e95 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:48.434475 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-87049455-ea95-4f49-b85e-efeb53d81e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:48.505357 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbe467-3bfd-4c92-b289-48733f91a764 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:48.565041 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87049455-ea95-4f49-b85e-efeb53d81e95 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:48.570314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fb52a-ceac-4291-8a8a-71c022f6d4ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9efd2ac7fc4a42558e8dc48c408ce525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:48.571158 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fb52a-ceac-4291-8a8a-71c022f6d4ab service placement] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:48.571635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fb52a-ceac-4291-8a8a-71c022f6d4ab service placement] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:48.572047 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fb52a-ceac-4291-8a8a-71c022f6d4ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:48.574053 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bc2fb52a-ceac-4291-8a8a-71c022f6d4ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:48.587569 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fb52a-ceac-4291-8a8a-71c022f6d4ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:48.589558 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fb52a-ceac-4291-8a8a-71c022f6d4ab service placement] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:48.603134 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1344/2688] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:04:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:04:48.616555 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbe467-3bfd-4c92-b289-48733f91a764 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:48.621948 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d845cd3-2cff-43ce-9ce4-1f4e86524b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:48.622942 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d845cd3-2cff-43ce-9ce4-1f4e86524b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:48.623269 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d845cd3-2cff-43ce-9ce4-1f4e86524b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:48.623639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d845cd3-2cff-43ce-9ce4-1f4e86524b8d admin admin] PATH_INFO: `/v3/users/410fd041f59f46a08227d7b0ab2be265` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:48.624842 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d845cd3-2cff-43ce-9ce4-1f4e86524b8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=410fd041f59f46a08227d7b0ab2be265)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:48.627255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d845cd3-2cff-43ce-9ce4-1f4e86524b8d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:48.693887 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5d845cd3-2cff-43ce-9ce4-1f4e86524b8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '410fd041f59f46a08227d7b0ab2be265'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:48.701151 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5d845cd3-2cff-43ce-9ce4-1f4e86524b8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '410fd041f59f46a08227d7b0ab2be265'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:48.706611 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:04:48.711895 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5d845cd3-2cff-43ce-9ce4-1f4e86524b8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '410fd041f59f46a08227d7b0ab2be265'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:48.725206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5d845cd3-2cff-43ce-9ce4-1f4e86524b8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '410fd041f59f46a08227d7b0ab2be265'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:48.725936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5d845cd3-2cff-43ce-9ce4-1f4e86524b8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '410fd041f59f46a08227d7b0ab2be265'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:48.732269 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1345/2689] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:04:48 2022] DELETE /identity/v3/users/410fd041f59f46a08227d7b0ab2be265 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:04:48.913526 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fb52a-ceac-4291-8a8a-71c022f6d4ab service placement] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:48.932773 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fb52a-ceac-4291-8a8a-71c022f6d4ab service placement] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:49.139009 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b42087-b501-4de0-b939-b0542204632a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:49.139672 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b42087-b501-4de0-b939-b0542204632a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:49.139949 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b42087-b501-4de0-b939-b0542204632a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:49.140220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b42087-b501-4de0-b939-b0542204632a admin admin] PATH_INFO: `/v3/projects/e2bcde5d4a3947738743d6c633066fd8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:49.141367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b42087-b501-4de0-b939-b0542204632a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2bcde5d4a3947738743d6c633066fd8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:49.143347 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b42087-b501-4de0-b939-b0542204632a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:49.180944 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:04:49.196258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d6b42087-b501-4de0-b939-b0542204632a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2bcde5d4a3947738743d6c633066fd8', 'request_id': 'req-d6b42087-b501-4de0-b939-b0542204632a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:49.202804 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d6b42087-b501-4de0-b939-b0542204632a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2bcde5d4a3947738743d6c633066fd8', 'request_id': 'req-d6b42087-b501-4de0-b939-b0542204632a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:49.208519 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d6b42087-b501-4de0-b939-b0542204632a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2bcde5d4a3947738743d6c633066fd8', 'request_id': 'req-d6b42087-b501-4de0-b939-b0542204632a'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:49.221670 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d6b42087-b501-4de0-b939-b0542204632a admin admin] The token cache is being invalidate because project e2bcde5d4a3947738743d6c633066fd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:04:49.222181 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d6b42087-b501-4de0-b939-b0542204632a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:49.222807 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d6b42087-b501-4de0-b939-b0542204632a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:49.224412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1345/2690] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:04:48 2022] DELETE /identity/v3/projects/e2bcde5d4a3947738743d6c633066fd8 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:04:49.228915 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d845cd3-2cff-43ce-9ce4-1f4e86524b8d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:49.230345 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5d845cd3-2cff-43ce-9ce4-1f4e86524b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:49.245081 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d845cd3-2cff-43ce-9ce4-1f4e86524b8d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:49.310370 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc05470-0613-44b9-a23b-42bcbf0a164e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:49.311020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc05470-0613-44b9-a23b-42bcbf0a164e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:49.311302 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc05470-0613-44b9-a23b-42bcbf0a164e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:49.311605 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc05470-0613-44b9-a23b-42bcbf0a164e admin admin] PATH_INFO: `/v3/users/a06685eaff3b4263945840d28077341f` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:49.312872 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc05470-0613-44b9-a23b-42bcbf0a164e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a06685eaff3b4263945840d28077341f)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:49.315554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc05470-0613-44b9-a23b-42bcbf0a164e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:49.366753 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6dc05470-0613-44b9-a23b-42bcbf0a164e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a06685eaff3b4263945840d28077341f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:49.373846 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6dc05470-0613-44b9-a23b-42bcbf0a164e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a06685eaff3b4263945840d28077341f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:49.382346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6dc05470-0613-44b9-a23b-42bcbf0a164e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a06685eaff3b4263945840d28077341f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:49.396340 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6dc05470-0613-44b9-a23b-42bcbf0a164e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a06685eaff3b4263945840d28077341f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:49.397107 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6dc05470-0613-44b9-a23b-42bcbf0a164e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a06685eaff3b4263945840d28077341f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:49.403071 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1346/2691] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:04:49 2022] DELETE /identity/v3/users/a06685eaff3b4263945840d28077341f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:04:49.585969 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b42087-b501-4de0-b939-b0542204632a admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:49.587341 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d6b42087-b501-4de0-b939-b0542204632a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:49.601179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b42087-b501-4de0-b939-b0542204632a admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:49.665940 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527031bd-6558-4e43-8c26-a752befd3ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:49.666583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527031bd-6558-4e43-8c26-a752befd3ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:49.666859 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527031bd-6558-4e43-8c26-a752befd3ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:49.667135 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527031bd-6558-4e43-8c26-a752befd3ed4 admin admin] PATH_INFO: `/v3/projects/386ad11db6eb425b9366f9f18926b618` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:49.668360 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527031bd-6558-4e43-8c26-a752befd3ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=386ad11db6eb425b9366f9f18926b618)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:49.670412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527031bd-6558-4e43-8c26-a752befd3ed4 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:49.729216 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-527031bd-6558-4e43-8c26-a752befd3ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '386ad11db6eb425b9366f9f18926b618', 'request_id': 'req-527031bd-6558-4e43-8c26-a752befd3ed4'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:49.735693 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-527031bd-6558-4e43-8c26-a752befd3ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '386ad11db6eb425b9366f9f18926b618', 'request_id': 'req-527031bd-6558-4e43-8c26-a752befd3ed4'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:49.741619 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-527031bd-6558-4e43-8c26-a752befd3ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '386ad11db6eb425b9366f9f18926b618', 'request_id': 'req-527031bd-6558-4e43-8c26-a752befd3ed4'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:49.755688 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-527031bd-6558-4e43-8c26-a752befd3ed4 admin admin] The token cache is being invalidate because project 386ad11db6eb425b9366f9f18926b618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:04:49.755969 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-527031bd-6558-4e43-8c26-a752befd3ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:49.756645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-527031bd-6558-4e43-8c26-a752befd3ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:49.758354 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1346/2692] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:04:49 2022] DELETE /identity/v3/projects/386ad11db6eb425b9366f9f18926b618 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:04:49.763583 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bc4d9-ad16-4ed0-8f33-8a6791ba750e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:49.764099 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bc4d9-ad16-4ed0-8f33-8a6791ba750e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:49.764099 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bc4d9-ad16-4ed0-8f33-8a6791ba750e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:49.784454 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cc5bc4d9-ad16-4ed0-8f33-8a6791ba750e None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:04:49.785658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cc5bc4d9-ad16-4ed0-8f33-8a6791ba750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:49.840593 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:04:49.851172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1347/2693] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:04:49.860570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654de49-833a-4848-aa5e-e641ad19e2d7 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:49.861167 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654de49-833a-4848-aa5e-e641ad19e2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:49.861650 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654de49-833a-4848-aa5e-e641ad19e2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:49.901043 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-3654de49-833a-4848-aa5e-e641ad19e2d7 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:04:49.902515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3654de49-833a-4848-aa5e-e641ad19e2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:49.910710 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1347/2694] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:04:49.915721 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bc4d9-ad16-4ed0-8f33-8a6791ba750e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:49.925793 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bc4d9-ad16-4ed0-8f33-8a6791ba750e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:49.930401 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c33f59-c1a0-4439-b242-d854984eaa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:49.931057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c33f59-c1a0-4439-b242-d854984eaa8c admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:49.931336 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c33f59-c1a0-4439-b242-d854984eaa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:49.931670 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c33f59-c1a0-4439-b242-d854984eaa8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:49.932317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c33f59-c1a0-4439-b242-d854984eaa8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 12:04:49.932617 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c33f59-c1a0-4439-b242-d854984eaa8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:49.934216 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c33f59-c1a0-4439-b242-d854984eaa8c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:49.946133 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1348/2695] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 12:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 12:04:49.950451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654de49-833a-4848-aa5e-e641ad19e2d7 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:49.959878 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654de49-833a-4848-aa5e-e641ad19e2d7 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:49.964815 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453715d-ec8e-4b21-a995-f23fd8e7f9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:49.965428 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453715d-ec8e-4b21-a995-f23fd8e7f9c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:49.965709 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453715d-ec8e-4b21-a995-f23fd8e7f9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:49.965962 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453715d-ec8e-4b21-a995-f23fd8e7f9c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:49.966597 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453715d-ec8e-4b21-a995-f23fd8e7f9c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:49.968527 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453715d-ec8e-4b21-a995-f23fd8e7f9c7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:49.998671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1348/2696] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:04:49 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 12:04:50.003110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c33f59-c1a0-4439-b242-d854984eaa8c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:50.013498 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c33f59-c1a0-4439-b242-d854984eaa8c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:50.076738 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755cb8f-69a1-493d-a91c-f3a7d7fe2d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:50.077554 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755cb8f-69a1-493d-a91c-f3a7d7fe2d54 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:50.077956 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755cb8f-69a1-493d-a91c-f3a7d7fe2d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:50.078347 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755cb8f-69a1-493d-a91c-f3a7d7fe2d54 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:50.079277 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755cb8f-69a1-493d-a91c-f3a7d7fe2d54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:50.081979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755cb8f-69a1-493d-a91c-f3a7d7fe2d54 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:50.115345 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1349/2697] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:04:50 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:04:50.119691 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453715d-ec8e-4b21-a995-f23fd8e7f9c7 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:50.131031 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453715d-ec8e-4b21-a995-f23fd8e7f9c7 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:50.136140 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c8fb5-48da-4f14-ba91-27578fbfb6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:50.136817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c8fb5-48da-4f14-ba91-27578fbfb6eb admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:50.137201 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c8fb5-48da-4f14-ba91-27578fbfb6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:50.137531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c8fb5-48da-4f14-ba91-27578fbfb6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:50.138260 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c8fb5-48da-4f14-ba91-27578fbfb6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:50.139958 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c8fb5-48da-4f14-ba91-27578fbfb6eb admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:50.150592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1349/2698] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:04:50.154682 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755cb8f-69a1-493d-a91c-f3a7d7fe2d54 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:50.166189 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755cb8f-69a1-493d-a91c-f3a7d7fe2d54 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:50.170995 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3efeb0-8afd-4008-b22e-cd5a0cd20ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:50.171629 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3efeb0-8afd-4008-b22e-cd5a0cd20ced admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:50.171906 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3efeb0-8afd-4008-b22e-cd5a0cd20ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:50.172176 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3efeb0-8afd-4008-b22e-cd5a0cd20ced admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:50.172837 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3efeb0-8afd-4008-b22e-cd5a0cd20ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:50.174984 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3efeb0-8afd-4008-b22e-cd5a0cd20ced admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:50.186503 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1350/2699] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:04:50.190641 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c8fb5-48da-4f14-ba91-27578fbfb6eb admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:50.200795 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c8fb5-48da-4f14-ba91-27578fbfb6eb admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:50.205790 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c2d20-16e5-46a0-af13-c52a2994c423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:50.206457 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c2d20-16e5-46a0-af13-c52a2994c423 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:50.206736 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c2d20-16e5-46a0-af13-c52a2994c423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:50.207018 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c2d20-16e5-46a0-af13-c52a2994c423 admin admin] PATH_INFO: `/v3/projects/392456c7de184d8db9ae2fc5f9cc2505/users/f877e89f625443a0b64ab271c75c6720/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:50.215621 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:04:50.223650 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c2d20-16e5-46a0-af13-c52a2994c423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=392456c7de184d8db9ae2fc5f9cc2505, user_id=f877e89f625443a0b64ab271c75c6720, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:50.226544 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c2d20-16e5-46a0-af13-c52a2994c423 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:50.241335 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1350/2700] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:04:50 2022] PUT /identity/v3/projects/392456c7de184d8db9ae2fc5f9cc2505/users/f877e89f625443a0b64ab271c75c6720/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:04:50.251745 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d697ca-a5b6-407d-af1d-5a2be9221291 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:50.252029 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d697ca-a5b6-407d-af1d-5a2be9221291 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:50.252298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d697ca-a5b6-407d-af1d-5a2be9221291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:50.282084 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b0d697ca-a5b6-407d-af1d-5a2be9221291 None None] MFA Rules not processed for user `f877e89f625443a0b64ab271c75c6720`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:04:50.283390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b0d697ca-a5b6-407d-af1d-5a2be9221291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:50.351731 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1351/2701] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:04:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:04:50.356490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c2d20-16e5-46a0-af13-c52a2994c423 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:50.423580 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c2d20-16e5-46a0-af13-c52a2994c423 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:50.428449 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c05f3-84ba-4fa3-ba0b-d9a601dfa39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:50.429059 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c05f3-84ba-4fa3-ba0b-d9a601dfa39e admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:50.429332 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c05f3-84ba-4fa3-ba0b-d9a601dfa39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:50.429606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c05f3-84ba-4fa3-ba0b-d9a601dfa39e admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:50.430234 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c05f3-84ba-4fa3-ba0b-d9a601dfa39e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:50.432152 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c05f3-84ba-4fa3-ba0b-d9a601dfa39e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:50.461269 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1351/2702] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:04:50 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 12:04:50.465457 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d697ca-a5b6-407d-af1d-5a2be9221291 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:50.476486 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d697ca-a5b6-407d-af1d-5a2be9221291 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:50.526272 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:04:50.536252 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319044a7-374f-4d43-9f59-be17136a3e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:50.536967 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319044a7-374f-4d43-9f59-be17136a3e84 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:50.537313 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319044a7-374f-4d43-9f59-be17136a3e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:50.537651 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319044a7-374f-4d43-9f59-be17136a3e84 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:50.538396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319044a7-374f-4d43-9f59-be17136a3e84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:50.540776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319044a7-374f-4d43-9f59-be17136a3e84 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:50.562559 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1352/2703] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:04:50 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:04:50.566801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c05f3-84ba-4fa3-ba0b-d9a601dfa39e admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:50.577639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c05f3-84ba-4fa3-ba0b-d9a601dfa39e admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:50.583408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beed18a-ddda-4380-b2fa-1397ae161b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:50.584149 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beed18a-ddda-4380-b2fa-1397ae161b12 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:50.584429 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beed18a-ddda-4380-b2fa-1397ae161b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:50.584695 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beed18a-ddda-4380-b2fa-1397ae161b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:50.585330 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beed18a-ddda-4380-b2fa-1397ae161b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:50.587093 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beed18a-ddda-4380-b2fa-1397ae161b12 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:50.598054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1352/2704] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 12:04:50.602394 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319044a7-374f-4d43-9f59-be17136a3e84 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:50.617244 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319044a7-374f-4d43-9f59-be17136a3e84 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:50.622059 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ab76e-e032-4f59-9887-2b3159b5b4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:50.622675 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ab76e-e032-4f59-9887-2b3159b5b4a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:50.622947 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ab76e-e032-4f59-9887-2b3159b5b4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:50.623229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ab76e-e032-4f59-9887-2b3159b5b4a7 admin admin] PATH_INFO: `/v3/projects/cf32381a7c554b41a8c300a9133f1de1/users/f8ee84ec0fd84b26ad87bcfecf2cd4b7/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:50.638352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ab76e-e032-4f59-9887-2b3159b5b4a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf32381a7c554b41a8c300a9133f1de1, user_id=f8ee84ec0fd84b26ad87bcfecf2cd4b7, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:50.641045 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ab76e-e032-4f59-9887-2b3159b5b4a7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:50.656002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1353/2705] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:04:50 2022] PUT /identity/v3/projects/cf32381a7c554b41a8c300a9133f1de1/users/f8ee84ec0fd84b26ad87bcfecf2cd4b7/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:04:50.660351 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beed18a-ddda-4380-b2fa-1397ae161b12 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:50.671108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beed18a-ddda-4380-b2fa-1397ae161b12 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:50.729545 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5357cd7-1cb2-437a-8695-1f8754f1e1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:50.730160 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5357cd7-1cb2-437a-8695-1f8754f1e1bd admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:50.730417 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5357cd7-1cb2-437a-8695-1f8754f1e1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:50.730679 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5357cd7-1cb2-437a-8695-1f8754f1e1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:50.731311 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5357cd7-1cb2-437a-8695-1f8754f1e1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:50.732982 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5357cd7-1cb2-437a-8695-1f8754f1e1bd admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:50.742739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1353/2706] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:04:50.747041 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ab76e-e032-4f59-9887-2b3159b5b4a7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:50.757512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ab76e-e032-4f59-9887-2b3159b5b4a7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:50.762445 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220cf22-cb35-40b5-a367-92a5f5752f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:50.763098 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220cf22-cb35-40b5-a367-92a5f5752f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:50.763398 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220cf22-cb35-40b5-a367-92a5f5752f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:50.763680 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220cf22-cb35-40b5-a367-92a5f5752f2c admin admin] PATH_INFO: `/v3/projects/cf32381a7c554b41a8c300a9133f1de1/users/f8ee84ec0fd84b26ad87bcfecf2cd4b7/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:50.765617 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220cf22-cb35-40b5-a367-92a5f5752f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf32381a7c554b41a8c300a9133f1de1, user_id=f8ee84ec0fd84b26ad87bcfecf2cd4b7, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:50.768304 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220cf22-cb35-40b5-a367-92a5f5752f2c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:50.779487 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1354/2707] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:04:50 2022] PUT /identity/v3/projects/cf32381a7c554b41a8c300a9133f1de1/users/f8ee84ec0fd84b26ad87bcfecf2cd4b7/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:04:50.790157 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30d371-93ce-464c-ba9a-b6a9599475f6 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:50.790435 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30d371-93ce-464c-ba9a-b6a9599475f6 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:50.790716 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30d371-93ce-464c-ba9a-b6a9599475f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:50.819768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-bd30d371-93ce-464c-ba9a-b6a9599475f6 None None] MFA Rules not processed for user `f8ee84ec0fd84b26ad87bcfecf2cd4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:04:50.820965 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bd30d371-93ce-464c-ba9a-b6a9599475f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:50.872045 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:04:50.897300 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1354/2708] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:04:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:04:50.910484 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220cf22-cb35-40b5-a367-92a5f5752f2c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:50.912295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2220cf22-cb35-40b5-a367-92a5f5752f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:50.970343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220cf22-cb35-40b5-a367-92a5f5752f2c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:50.974285 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac67ac-a9db-4c20-9da4-a680589e9596 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:50.974900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac67ac-a9db-4c20-9da4-a680589e9596 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:50.975177 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac67ac-a9db-4c20-9da4-a680589e9596 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:50.975485 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac67ac-a9db-4c20-9da4-a680589e9596 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:50.984705 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac67ac-a9db-4c20-9da4-a680589e9596 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:50.986182 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac67ac-a9db-4c20-9da4-a680589e9596 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:50.995874 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1355/2709] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:04:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:04:51.079951 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30d371-93ce-464c-ba9a-b6a9599475f6 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:51.089559 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30d371-93ce-464c-ba9a-b6a9599475f6 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:51.093173 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b5554-6383-4872-b28b-c2dbb14f6ccc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:51.093766 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b5554-6383-4872-b28b-c2dbb14f6ccc service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:51.094035 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b5554-6383-4872-b28b-c2dbb14f6ccc service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:51.094308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b5554-6383-4872-b28b-c2dbb14f6ccc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:51.154614 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b5554-6383-4872-b28b-c2dbb14f6ccc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:51.156079 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b5554-6383-4872-b28b-c2dbb14f6ccc service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:51.166227 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1355/2710] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:04:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:04:58.090053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac67ac-a9db-4c20-9da4-a680589e9596 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:58.157298 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac67ac-a9db-4c20-9da4-a680589e9596 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:58.161854 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae601c-cfd3-450b-b652-79b6c7783c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:58.162507 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae601c-cfd3-450b-b652-79b6c7783c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:58.162784 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae601c-cfd3-450b-b652-79b6c7783c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:58.163053 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae601c-cfd3-450b-b652-79b6c7783c02 admin admin] PATH_INFO: `/v3/users/f877e89f625443a0b64ab271c75c6720` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:58.164618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae601c-cfd3-450b-b652-79b6c7783c02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f877e89f625443a0b64ab271c75c6720)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:58.166598 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae601c-cfd3-450b-b652-79b6c7783c02 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:58.214699 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-64ae601c-cfd3-450b-b652-79b6c7783c02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f877e89f625443a0b64ab271c75c6720'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:58.216638 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:04:58.223241 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-64ae601c-cfd3-450b-b652-79b6c7783c02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f877e89f625443a0b64ab271c75c6720'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:58.231701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-64ae601c-cfd3-450b-b652-79b6c7783c02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f877e89f625443a0b64ab271c75c6720'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:58.243740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-64ae601c-cfd3-450b-b652-79b6c7783c02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f877e89f625443a0b64ab271c75c6720'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:58.244368 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-64ae601c-cfd3-450b-b652-79b6c7783c02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f877e89f625443a0b64ab271c75c6720'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:58.250358 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1356/2711] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:04:58 2022] DELETE /identity/v3/users/f877e89f625443a0b64ab271c75c6720 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:04:58.255287 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f66596-afe3-4a00-936b-d36527cbd813 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:58.255801 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f66596-afe3-4a00-936b-d36527cbd813 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:58.255912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f66596-afe3-4a00-936b-d36527cbd813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:58.275500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-97f66596-afe3-4a00-936b-d36527cbd813 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:04:58.276711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-97f66596-afe3-4a00-936b-d36527cbd813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:58.353873 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1356/2712] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:04:58.363938 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae601c-cfd3-450b-b652-79b6c7783c02 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:58.365379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-64ae601c-cfd3-450b-b652-79b6c7783c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:58.425045 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae601c-cfd3-450b-b652-79b6c7783c02 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:58.429283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f1cd1-5449-4683-bcf9-f6f98ab786c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:58.429895 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f1cd1-5449-4683-bcf9-f6f98ab786c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:58.430169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f1cd1-5449-4683-bcf9-f6f98ab786c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:58.430444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f1cd1-5449-4683-bcf9-f6f98ab786c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:58.440638 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f1cd1-5449-4683-bcf9-f6f98ab786c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:58.442046 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f1cd1-5449-4683-bcf9-f6f98ab786c6 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:58.451931 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1357/2713] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:04:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:04:58.748090 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f66596-afe3-4a00-936b-d36527cbd813 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:58.749635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-97f66596-afe3-4a00-936b-d36527cbd813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:58.763314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f66596-afe3-4a00-936b-d36527cbd813 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:58.769062 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68602e7-952f-4ee6-9935-2313e730d9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:58.769737 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68602e7-952f-4ee6-9935-2313e730d9d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:58.770033 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68602e7-952f-4ee6-9935-2313e730d9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:58.770273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68602e7-952f-4ee6-9935-2313e730d9d2 admin admin] PATH_INFO: `/v3/projects/392456c7de184d8db9ae2fc5f9cc2505` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:58.771718 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68602e7-952f-4ee6-9935-2313e730d9d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=392456c7de184d8db9ae2fc5f9cc2505)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:58.773655 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68602e7-952f-4ee6-9935-2313e730d9d2 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:58.824666 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d68602e7-952f-4ee6-9935-2313e730d9d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '392456c7de184d8db9ae2fc5f9cc2505', 'request_id': 'req-d68602e7-952f-4ee6-9935-2313e730d9d2'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:58.831230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d68602e7-952f-4ee6-9935-2313e730d9d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '392456c7de184d8db9ae2fc5f9cc2505', 'request_id': 'req-d68602e7-952f-4ee6-9935-2313e730d9d2'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:58.837473 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d68602e7-952f-4ee6-9935-2313e730d9d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '392456c7de184d8db9ae2fc5f9cc2505', 'request_id': 'req-d68602e7-952f-4ee6-9935-2313e730d9d2'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:58.851432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d68602e7-952f-4ee6-9935-2313e730d9d2 admin admin] The token cache is being invalidate because project 392456c7de184d8db9ae2fc5f9cc2505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:04:58.851725 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d68602e7-952f-4ee6-9935-2313e730d9d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:58.852367 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d68602e7-952f-4ee6-9935-2313e730d9d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:58.853867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1357/2714] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:04:58 2022] DELETE /identity/v3/projects/392456c7de184d8db9ae2fc5f9cc2505 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:04:58.857994 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f1cd1-5449-4683-bcf9-f6f98ab786c6 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:58.868551 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f1cd1-5449-4683-bcf9-f6f98ab786c6 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:58.930573 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140e9ac-c7f2-4749-ab89-5322061969df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:58.931203 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140e9ac-c7f2-4749-ab89-5322061969df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:58.931506 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140e9ac-c7f2-4749-ab89-5322061969df admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:58.931777 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140e9ac-c7f2-4749-ab89-5322061969df admin admin] PATH_INFO: `/v3/users/f8ee84ec0fd84b26ad87bcfecf2cd4b7` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:58.932928 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140e9ac-c7f2-4749-ab89-5322061969df admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ee84ec0fd84b26ad87bcfecf2cd4b7)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:58.934843 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140e9ac-c7f2-4749-ab89-5322061969df admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:58.991347 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e140e9ac-c7f2-4749-ab89-5322061969df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ee84ec0fd84b26ad87bcfecf2cd4b7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:58.998818 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e140e9ac-c7f2-4749-ab89-5322061969df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ee84ec0fd84b26ad87bcfecf2cd4b7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:59.009772 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e140e9ac-c7f2-4749-ab89-5322061969df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ee84ec0fd84b26ad87bcfecf2cd4b7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:59.021451 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:04:59.028906 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e140e9ac-c7f2-4749-ab89-5322061969df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ee84ec0fd84b26ad87bcfecf2cd4b7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:59.030054 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e140e9ac-c7f2-4749-ab89-5322061969df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ee84ec0fd84b26ad87bcfecf2cd4b7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:59.038982 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1358/2715] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:04:58 2022] DELETE /identity/v3/users/f8ee84ec0fd84b26ad87bcfecf2cd4b7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:04:59.331136 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68602e7-952f-4ee6-9935-2313e730d9d2 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:59.332653 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d68602e7-952f-4ee6-9935-2313e730d9d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:59.342976 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:04:59.356054 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68602e7-952f-4ee6-9935-2313e730d9d2 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:59.418016 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b7ee3-c562-4e2b-9ea8-3b075b83ed8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:59.418651 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b7ee3-c562-4e2b-9ea8-3b075b83ed8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:59.418926 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b7ee3-c562-4e2b-9ea8-3b075b83ed8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:59.419240 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b7ee3-c562-4e2b-9ea8-3b075b83ed8d admin admin] PATH_INFO: `/v3/projects/cf32381a7c554b41a8c300a9133f1de1` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:59.420470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b7ee3-c562-4e2b-9ea8-3b075b83ed8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf32381a7c554b41a8c300a9133f1de1)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:59.422467 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b7ee3-c562-4e2b-9ea8-3b075b83ed8d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:59.472947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c90b7ee3-c562-4e2b-9ea8-3b075b83ed8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf32381a7c554b41a8c300a9133f1de1', 'request_id': 'req-c90b7ee3-c562-4e2b-9ea8-3b075b83ed8d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:59.479154 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c90b7ee3-c562-4e2b-9ea8-3b075b83ed8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf32381a7c554b41a8c300a9133f1de1', 'request_id': 'req-c90b7ee3-c562-4e2b-9ea8-3b075b83ed8d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:59.485874 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c90b7ee3-c562-4e2b-9ea8-3b075b83ed8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf32381a7c554b41a8c300a9133f1de1', 'request_id': 'req-c90b7ee3-c562-4e2b-9ea8-3b075b83ed8d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:59.498867 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c90b7ee3-c562-4e2b-9ea8-3b075b83ed8d admin admin] The token cache is being invalidate because project cf32381a7c554b41a8c300a9133f1de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:04:59.499076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c90b7ee3-c562-4e2b-9ea8-3b075b83ed8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:59.499712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-c90b7ee3-c562-4e2b-9ea8-3b075b83ed8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:04:59.501244 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1358/2716] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:04:59 2022] DELETE /identity/v3/projects/cf32381a7c554b41a8c300a9133f1de1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:04:59.506751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaba3fa-296e-4c34-9775-e1cba7bafbfa None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:59.507250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaba3fa-296e-4c34-9775-e1cba7bafbfa None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:59.507393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaba3fa-296e-4c34-9775-e1cba7bafbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:59.527786 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-beaba3fa-296e-4c34-9775-e1cba7bafbfa None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:04:59.528979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-beaba3fa-296e-4c34-9775-e1cba7bafbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:59.590092 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1359/2717] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 12:04:59.601210 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c2d0e-c011-48b2-a2f3-6f46e7ede947 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:59.601487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c2d0e-c011-48b2-a2f3-6f46e7ede947 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:59.601742 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c2d0e-c011-48b2-a2f3-6f46e7ede947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:59.624153 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-cf4c2d0e-c011-48b2-a2f3-6f46e7ede947 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:04:59.625343 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-cf4c2d0e-c011-48b2-a2f3-6f46e7ede947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:04:59.633850 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1359/2718] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:04:59.638519 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaba3fa-296e-4c34-9775-e1cba7bafbfa None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:59.648486 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaba3fa-296e-4c34-9775-e1cba7bafbfa None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:59.653486 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb7374-d9c6-4bdf-a5e1-a589ecf9615b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:59.654092 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb7374-d9c6-4bdf-a5e1-a589ecf9615b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:59.654355 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb7374-d9c6-4bdf-a5e1-a589ecf9615b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:59.654626 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb7374-d9c6-4bdf-a5e1-a589ecf9615b admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:59.655291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb7374-d9c6-4bdf-a5e1-a589ecf9615b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 12:04:59.655630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb7374-d9c6-4bdf-a5e1-a589ecf9615b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:59.657226 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb7374-d9c6-4bdf-a5e1-a589ecf9615b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:59.669542 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1360/2719] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 12:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 12:04:59.673947 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c2d0e-c011-48b2-a2f3-6f46e7ede947 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:59.683659 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c2d0e-c011-48b2-a2f3-6f46e7ede947 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:59.689277 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becb3a0-793c-41b2-ad98-60d6166cbeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:59.689864 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becb3a0-793c-41b2-ad98-60d6166cbeb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:59.690138 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becb3a0-793c-41b2-ad98-60d6166cbeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:59.690403 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becb3a0-793c-41b2-ad98-60d6166cbeb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:59.691043 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becb3a0-793c-41b2-ad98-60d6166cbeb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:59.693112 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becb3a0-793c-41b2-ad98-60d6166cbeb2 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:59.723377 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1360/2720] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:04:59 2022] POST /identity/v3/projects => generated 357 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:04:59.728164 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb7374-d9c6-4bdf-a5e1-a589ecf9615b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:59.743997 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb7374-d9c6-4bdf-a5e1-a589ecf9615b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:59.805790 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfa8d1-5b4a-4671-ab35-aed0d0e87af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:59.806399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfa8d1-5b4a-4671-ab35-aed0d0e87af8 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:59.806688 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfa8d1-5b4a-4671-ab35-aed0d0e87af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:59.806924 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfa8d1-5b4a-4671-ab35-aed0d0e87af8 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:59.807586 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfa8d1-5b4a-4671-ab35-aed0d0e87af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:59.809512 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfa8d1-5b4a-4671-ab35-aed0d0e87af8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:59.832412 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1361/2721] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:04:59 2022] POST /identity/v3/users => generated 279 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:04:59.839056 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becb3a0-793c-41b2-ad98-60d6166cbeb2 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:59.853471 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becb3a0-793c-41b2-ad98-60d6166cbeb2 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:59.859220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9925a61-7621-42db-860d-4bfbe59b4df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:59.859889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9925a61-7621-42db-860d-4bfbe59b4df6 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:59.860163 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9925a61-7621-42db-860d-4bfbe59b4df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:59.860446 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9925a61-7621-42db-860d-4bfbe59b4df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:59.861086 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9925a61-7621-42db-860d-4bfbe59b4df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:59.864208 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9925a61-7621-42db-860d-4bfbe59b4df6 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:59.878003 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1361/2722] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:04:59.882579 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfa8d1-5b4a-4671-ab35-aed0d0e87af8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:59.892785 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfa8d1-5b4a-4671-ab35-aed0d0e87af8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:59.897632 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e464190-5c3e-4879-aa61-b068fd80436e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:59.898221 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e464190-5c3e-4879-aa61-b068fd80436e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:59.898498 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e464190-5c3e-4879-aa61-b068fd80436e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:59.898757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e464190-5c3e-4879-aa61-b068fd80436e admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:59.899426 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e464190-5c3e-4879-aa61-b068fd80436e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:59.901013 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e464190-5c3e-4879-aa61-b068fd80436e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:59.912336 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1362/2723] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:04:59.916883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9925a61-7621-42db-860d-4bfbe59b4df6 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:04:59.927318 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9925a61-7621-42db-860d-4bfbe59b4df6 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:04:59.932203 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d206ed-10f0-4852-988a-9c97c4d36d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:04:59.932848 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d206ed-10f0-4852-988a-9c97c4d36d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:59.933122 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d206ed-10f0-4852-988a-9c97c4d36d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:59.933389 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d206ed-10f0-4852-988a-9c97c4d36d67 admin admin] PATH_INFO: `/v3/projects/d9060e239c784b149c53c9a7ee936454/users/26bcf46605d140dfa0109fa0248f0c68/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:04:59.948451 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d206ed-10f0-4852-988a-9c97c4d36d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9060e239c784b149c53c9a7ee936454, user_id=26bcf46605d140dfa0109fa0248f0c68, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:04:59.951101 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d206ed-10f0-4852-988a-9c97c4d36d67 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:04:59.967346 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1362/2724] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:04:59 2022] PUT /identity/v3/projects/d9060e239c784b149c53c9a7ee936454/users/26bcf46605d140dfa0109fa0248f0c68/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:04:59.978083 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76155a67-3f7b-4e5c-92b0-a04ebd2e0fea None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:04:59.978365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76155a67-3f7b-4e5c-92b0-a04ebd2e0fea None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:04:59.978666 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76155a67-3f7b-4e5c-92b0-a04ebd2e0fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:00.008345 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-76155a67-3f7b-4e5c-92b0-a04ebd2e0fea None None] MFA Rules not processed for user `26bcf46605d140dfa0109fa0248f0c68`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:00.009581 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-76155a67-3f7b-4e5c-92b0-a04ebd2e0fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:00.059087 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:00.083836 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1363/2725] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:04:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 12:05:00.088531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d206ed-10f0-4852-988a-9c97c4d36d67 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:00.125432 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:00.155289 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d206ed-10f0-4852-988a-9c97c4d36d67 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:00.160194 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06e5a4-71f3-47eb-b992-62d2633940cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:00.160800 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06e5a4-71f3-47eb-b992-62d2633940cd admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:00.161075 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06e5a4-71f3-47eb-b992-62d2633940cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:00.161342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06e5a4-71f3-47eb-b992-62d2633940cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:00.161994 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06e5a4-71f3-47eb-b992-62d2633940cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:00.164417 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06e5a4-71f3-47eb-b992-62d2633940cd admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:00.192219 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1363/2726] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:05:00 2022] POST /identity/v3/projects => generated 355 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:05:00.196617 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76155a67-3f7b-4e5c-92b0-a04ebd2e0fea None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:00.207498 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76155a67-3f7b-4e5c-92b0-a04ebd2e0fea None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:00.269450 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158aed8f-739e-480f-9b80-2582a520221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:00.270052 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aed8f-739e-480f-9b80-2582a520221d admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:00.270370 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aed8f-739e-480f-9b80-2582a520221d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:00.270661 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aed8f-739e-480f-9b80-2582a520221d admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:00.271270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158aed8f-739e-480f-9b80-2582a520221d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:00.273261 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158aed8f-739e-480f-9b80-2582a520221d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:00.298813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1364/2727] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:05:00 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 12:05:00.300051 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06e5a4-71f3-47eb-b992-62d2633940cd admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:00.310873 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06e5a4-71f3-47eb-b992-62d2633940cd admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:00.315605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06aaaf9-7e51-44f8-8342-82aeac43466b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:00.316385 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06aaaf9-7e51-44f8-8342-82aeac43466b admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:00.316665 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06aaaf9-7e51-44f8-8342-82aeac43466b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:00.317104 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06aaaf9-7e51-44f8-8342-82aeac43466b admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:00.317749 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06aaaf9-7e51-44f8-8342-82aeac43466b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:00.319394 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06aaaf9-7e51-44f8-8342-82aeac43466b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:00.329967 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1364/2728] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 12:05:00.334159 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158aed8f-739e-480f-9b80-2582a520221d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:00.344559 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158aed8f-739e-480f-9b80-2582a520221d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:00.349868 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060951a5-243c-465a-9c22-6e28a89586ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:00.350504 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060951a5-243c-465a-9c22-6e28a89586ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:00.350778 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060951a5-243c-465a-9c22-6e28a89586ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:00.351047 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060951a5-243c-465a-9c22-6e28a89586ce admin admin] PATH_INFO: `/v3/projects/ae595cab85b94555af9f83a05ca5b54f/users/61cb77463272406e8142fbce284e9e79/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:00.366188 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060951a5-243c-465a-9c22-6e28a89586ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae595cab85b94555af9f83a05ca5b54f, user_id=61cb77463272406e8142fbce284e9e79, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:00.368866 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060951a5-243c-465a-9c22-6e28a89586ce admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:00.383910 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1365/2729] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:05:00 2022] PUT /identity/v3/projects/ae595cab85b94555af9f83a05ca5b54f/users/61cb77463272406e8142fbce284e9e79/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:00.388031 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06aaaf9-7e51-44f8-8342-82aeac43466b admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:00.398997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06aaaf9-7e51-44f8-8342-82aeac43466b admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:00.462012 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924581af-2c54-4d91-b4b3-019daa86488e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:00.462615 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924581af-2c54-4d91-b4b3-019daa86488e admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:00.462891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924581af-2c54-4d91-b4b3-019daa86488e admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:00.463158 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924581af-2c54-4d91-b4b3-019daa86488e admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:00.463898 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924581af-2c54-4d91-b4b3-019daa86488e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:00.465520 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924581af-2c54-4d91-b4b3-019daa86488e admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:00.475758 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1365/2730] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:05:00.480229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060951a5-243c-465a-9c22-6e28a89586ce admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:00.490983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060951a5-243c-465a-9c22-6e28a89586ce admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:00.496334 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd5947-d064-4556-8796-dde9cdea7433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:00.497064 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd5947-d064-4556-8796-dde9cdea7433 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:00.497336 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd5947-d064-4556-8796-dde9cdea7433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:00.497610 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd5947-d064-4556-8796-dde9cdea7433 admin admin] PATH_INFO: `/v3/projects/ae595cab85b94555af9f83a05ca5b54f/users/61cb77463272406e8142fbce284e9e79/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:00.499748 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd5947-d064-4556-8796-dde9cdea7433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae595cab85b94555af9f83a05ca5b54f, user_id=61cb77463272406e8142fbce284e9e79, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:00.502397 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd5947-d064-4556-8796-dde9cdea7433 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:00.518353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1366/2731] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:05:00 2022] PUT /identity/v3/projects/ae595cab85b94555af9f83a05ca5b54f/users/61cb77463272406e8142fbce284e9e79/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:00.530053 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c03a6d-3d2c-4c06-b7b8-27e2bc9b8adb None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:00.530335 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c03a6d-3d2c-4c06-b7b8-27e2bc9b8adb None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:00.530607 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c03a6d-3d2c-4c06-b7b8-27e2bc9b8adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:00.560660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a1c03a6d-3d2c-4c06-b7b8-27e2bc9b8adb None None] MFA Rules not processed for user `61cb77463272406e8142fbce284e9e79`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:00.561968 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a1c03a6d-3d2c-4c06-b7b8-27e2bc9b8adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:00.638649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1366/2732] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:05:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:05:00.654838 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd5947-d064-4556-8796-dde9cdea7433 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:00.656842 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-70cd5947-d064-4556-8796-dde9cdea7433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:00.722855 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd5947-d064-4556-8796-dde9cdea7433 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:00.726740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03c7cb-c141-45f5-ace9-0bd8670e706a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:00.727350 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03c7cb-c141-45f5-ace9-0bd8670e706a service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:00.727655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03c7cb-c141-45f5-ace9-0bd8670e706a service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:00.727925 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03c7cb-c141-45f5-ace9-0bd8670e706a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:00.737875 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03c7cb-c141-45f5-ace9-0bd8670e706a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:00.739396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03c7cb-c141-45f5-ace9-0bd8670e706a service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:00.748816 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1367/2733] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:05:00 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:05:00.843633 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c03a6d-3d2c-4c06-b7b8-27e2bc9b8adb None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:00.858531 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c03a6d-3d2c-4c06-b7b8-27e2bc9b8adb None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:00.863911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee83340-41e0-4345-a09b-c1884d48750b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:00.864511 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee83340-41e0-4345-a09b-c1884d48750b service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:00.864786 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee83340-41e0-4345-a09b-c1884d48750b service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:00.865056 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee83340-41e0-4345-a09b-c1884d48750b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:00.896186 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:00.934358 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee83340-41e0-4345-a09b-c1884d48750b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:00.935861 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee83340-41e0-4345-a09b-c1884d48750b service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:00.945706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1367/2734] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:05:00 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:05:10.744532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=77,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:10.941161 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=16 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:16.038201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03c7cb-c141-45f5-ace9-0bd8670e706a service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:16.099887 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03c7cb-c141-45f5-ace9-0bd8670e706a service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:16.104647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250eef1b-18bc-4ecc-9f5a-8d76c9e4deec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:16.105278 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250eef1b-18bc-4ecc-9f5a-8d76c9e4deec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:16.105551 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250eef1b-18bc-4ecc-9f5a-8d76c9e4deec admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:16.105823 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250eef1b-18bc-4ecc-9f5a-8d76c9e4deec admin admin] PATH_INFO: `/v3/users/26bcf46605d140dfa0109fa0248f0c68` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:16.106979 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250eef1b-18bc-4ecc-9f5a-8d76c9e4deec admin admin] RBAC: Authorizing `identity:delete_user(user_id=26bcf46605d140dfa0109fa0248f0c68)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:16.108921 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250eef1b-18bc-4ecc-9f5a-8d76c9e4deec admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:16.158238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-250eef1b-18bc-4ecc-9f5a-8d76c9e4deec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26bcf46605d140dfa0109fa0248f0c68'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:16.165925 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-250eef1b-18bc-4ecc-9f5a-8d76c9e4deec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26bcf46605d140dfa0109fa0248f0c68'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:16.174888 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-250eef1b-18bc-4ecc-9f5a-8d76c9e4deec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26bcf46605d140dfa0109fa0248f0c68'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:16.187917 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-250eef1b-18bc-4ecc-9f5a-8d76c9e4deec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26bcf46605d140dfa0109fa0248f0c68'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:16.188734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-250eef1b-18bc-4ecc-9f5a-8d76c9e4deec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26bcf46605d140dfa0109fa0248f0c68'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:16.195422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1368/2735] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:05:16 2022] DELETE /identity/v3/users/26bcf46605d140dfa0109fa0248f0c68 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:16.200077 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e055ad-f362-4f1f-a150-fe0f469cadaf None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:16.200594 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e055ad-f362-4f1f-a150-fe0f469cadaf None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:16.200740 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e055ad-f362-4f1f-a150-fe0f469cadaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:16.220072 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-13e055ad-f362-4f1f-a150-fe0f469cadaf None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:16.221270 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-13e055ad-f362-4f1f-a150-fe0f469cadaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:16.280652 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1368/2736] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:05:16.291452 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250eef1b-18bc-4ecc-9f5a-8d76c9e4deec admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:16.294178 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-250eef1b-18bc-4ecc-9f5a-8d76c9e4deec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:16.369082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250eef1b-18bc-4ecc-9f5a-8d76c9e4deec admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:16.373318 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37318139-8e9d-4728-af65-f57ad03c2281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:16.373972 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37318139-8e9d-4728-af65-f57ad03c2281 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:16.374228 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37318139-8e9d-4728-af65-f57ad03c2281 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:16.374528 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37318139-8e9d-4728-af65-f57ad03c2281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:16.385740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37318139-8e9d-4728-af65-f57ad03c2281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:16.386799 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37318139-8e9d-4728-af65-f57ad03c2281 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:16.399200 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1369/2737] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:05:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:05:16.754859 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e055ad-f362-4f1f-a150-fe0f469cadaf None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:16.756503 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-13e055ad-f362-4f1f-a150-fe0f469cadaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:16.769214 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e055ad-f362-4f1f-a150-fe0f469cadaf None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:16.774290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f167b40-9e71-497f-9924-a64daed212ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:16.774970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f167b40-9e71-497f-9924-a64daed212ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:16.775234 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f167b40-9e71-497f-9924-a64daed212ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:16.775554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f167b40-9e71-497f-9924-a64daed212ee admin admin] PATH_INFO: `/v3/projects/d9060e239c784b149c53c9a7ee936454` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:16.776741 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f167b40-9e71-497f-9924-a64daed212ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9060e239c784b149c53c9a7ee936454)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:16.778661 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f167b40-9e71-497f-9924-a64daed212ee admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:16.830591 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9f167b40-9e71-497f-9924-a64daed212ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9060e239c784b149c53c9a7ee936454', 'request_id': 'req-9f167b40-9e71-497f-9924-a64daed212ee'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:16.836957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9f167b40-9e71-497f-9924-a64daed212ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9060e239c784b149c53c9a7ee936454', 'request_id': 'req-9f167b40-9e71-497f-9924-a64daed212ee'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:16.842772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9f167b40-9e71-497f-9924-a64daed212ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9060e239c784b149c53c9a7ee936454', 'request_id': 'req-9f167b40-9e71-497f-9924-a64daed212ee'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:16.857787 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9f167b40-9e71-497f-9924-a64daed212ee admin admin] The token cache is being invalidate because project d9060e239c784b149c53c9a7ee936454 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:05:16.858085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9f167b40-9e71-497f-9924-a64daed212ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:16.858706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-9f167b40-9e71-497f-9924-a64daed212ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:16.863333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1369/2738] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:05:16 2022] DELETE /identity/v3/projects/d9060e239c784b149c53c9a7ee936454 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:16.864699 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37318139-8e9d-4728-af65-f57ad03c2281 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:16.874544 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37318139-8e9d-4728-af65-f57ad03c2281 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:16.892594 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:16.935800 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008e2bc-f59f-4570-baa9-1bf840d8c040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:16.936444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008e2bc-f59f-4570-baa9-1bf840d8c040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:16.936725 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008e2bc-f59f-4570-baa9-1bf840d8c040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:16.936997 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008e2bc-f59f-4570-baa9-1bf840d8c040 admin admin] PATH_INFO: `/v3/users/61cb77463272406e8142fbce284e9e79` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:16.938108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008e2bc-f59f-4570-baa9-1bf840d8c040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61cb77463272406e8142fbce284e9e79)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:16.940116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008e2bc-f59f-4570-baa9-1bf840d8c040 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:16.997367 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b008e2bc-f59f-4570-baa9-1bf840d8c040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61cb77463272406e8142fbce284e9e79'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:17.005707 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b008e2bc-f59f-4570-baa9-1bf840d8c040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61cb77463272406e8142fbce284e9e79'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:17.015423 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b008e2bc-f59f-4570-baa9-1bf840d8c040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61cb77463272406e8142fbce284e9e79'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:17.029564 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b008e2bc-f59f-4570-baa9-1bf840d8c040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61cb77463272406e8142fbce284e9e79'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:17.030381 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b008e2bc-f59f-4570-baa9-1bf840d8c040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61cb77463272406e8142fbce284e9e79'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:17.036877 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1370/2739] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:05:16 2022] DELETE /identity/v3/users/61cb77463272406e8142fbce284e9e79 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:17.341319 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f167b40-9e71-497f-9924-a64daed212ee admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:17.352153 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9f167b40-9e71-497f-9924-a64daed212ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:17.369780 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f167b40-9e71-497f-9924-a64daed212ee admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:17.453610 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214378cb-c588-432f-b9bf-e3a97ce114fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:17.454255 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214378cb-c588-432f-b9bf-e3a97ce114fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:17.455065 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214378cb-c588-432f-b9bf-e3a97ce114fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:17.455065 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214378cb-c588-432f-b9bf-e3a97ce114fa admin admin] PATH_INFO: `/v3/projects/ae595cab85b94555af9f83a05ca5b54f` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:17.456177 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214378cb-c588-432f-b9bf-e3a97ce114fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae595cab85b94555af9f83a05ca5b54f)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:17.458522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214378cb-c588-432f-b9bf-e3a97ce114fa admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:17.494502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:17.512985 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-214378cb-c588-432f-b9bf-e3a97ce114fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae595cab85b94555af9f83a05ca5b54f', 'request_id': 'req-214378cb-c588-432f-b9bf-e3a97ce114fa'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:17.519242 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-214378cb-c588-432f-b9bf-e3a97ce114fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae595cab85b94555af9f83a05ca5b54f', 'request_id': 'req-214378cb-c588-432f-b9bf-e3a97ce114fa'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:17.525449 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-214378cb-c588-432f-b9bf-e3a97ce114fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae595cab85b94555af9f83a05ca5b54f', 'request_id': 'req-214378cb-c588-432f-b9bf-e3a97ce114fa'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:17.539714 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-214378cb-c588-432f-b9bf-e3a97ce114fa admin admin] The token cache is being invalidate because project ae595cab85b94555af9f83a05ca5b54f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:05:17.540025 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-214378cb-c588-432f-b9bf-e3a97ce114fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:17.540656 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-214378cb-c588-432f-b9bf-e3a97ce114fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:17.542206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1370/2740] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:05:17 2022] DELETE /identity/v3/projects/ae595cab85b94555af9f83a05ca5b54f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:17.547132 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560305e6-b650-4915-9777-72898c7726e0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:17.547614 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560305e6-b650-4915-9777-72898c7726e0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:17.547778 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560305e6-b650-4915-9777-72898c7726e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:17.568400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-560305e6-b650-4915-9777-72898c7726e0 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:17.569632 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-560305e6-b650-4915-9777-72898c7726e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:17.635490 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1371/2741] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 12:05:17.643412 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba668c-74d7-4088-b82b-04c43cad9663 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:17.643714 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba668c-74d7-4088-b82b-04c43cad9663 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:17.643987 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba668c-74d7-4088-b82b-04c43cad9663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:17.665366 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-55ba668c-74d7-4088-b82b-04c43cad9663 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:17.666494 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-55ba668c-74d7-4088-b82b-04c43cad9663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:17.676002 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1371/2742] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:05:17.680484 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560305e6-b650-4915-9777-72898c7726e0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:17.690889 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560305e6-b650-4915-9777-72898c7726e0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:17.696227 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57339f36-68fc-4c94-a0d6-ba620e21d847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:17.696918 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57339f36-68fc-4c94-a0d6-ba620e21d847 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:17.697189 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57339f36-68fc-4c94-a0d6-ba620e21d847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:17.697561 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57339f36-68fc-4c94-a0d6-ba620e21d847 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:17.698105 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57339f36-68fc-4c94-a0d6-ba620e21d847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 12:05:17.698409 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57339f36-68fc-4c94-a0d6-ba620e21d847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:17.700088 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57339f36-68fc-4c94-a0d6-ba620e21d847 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:17.714275 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1372/2743] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 12:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 12:05:17.718793 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba668c-74d7-4088-b82b-04c43cad9663 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:17.728533 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba668c-74d7-4088-b82b-04c43cad9663 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:17.733686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fdb2d-0320-48a8-8a96-0aaad8d60009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:17.734278 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fdb2d-0320-48a8-8a96-0aaad8d60009 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:17.734554 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fdb2d-0320-48a8-8a96-0aaad8d60009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:17.734821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fdb2d-0320-48a8-8a96-0aaad8d60009 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:17.735487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fdb2d-0320-48a8-8a96-0aaad8d60009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:17.737411 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fdb2d-0320-48a8-8a96-0aaad8d60009 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:17.769113 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1372/2744] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:05:17 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:05:17.773460 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57339f36-68fc-4c94-a0d6-ba620e21d847 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:17.784610 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57339f36-68fc-4c94-a0d6-ba620e21d847 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:17.812921 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:17.846318 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84191bef-9658-44bb-a39d-b18605bfbf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:17.847009 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84191bef-9658-44bb-a39d-b18605bfbf64 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:17.847282 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84191bef-9658-44bb-a39d-b18605bfbf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:17.847583 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84191bef-9658-44bb-a39d-b18605bfbf64 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:17.848206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84191bef-9658-44bb-a39d-b18605bfbf64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:17.850220 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84191bef-9658-44bb-a39d-b18605bfbf64 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:17.872537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1373/2745] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:05:17 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 12:05:17.876940 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fdb2d-0320-48a8-8a96-0aaad8d60009 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:17.887516 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fdb2d-0320-48a8-8a96-0aaad8d60009 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:17.892123 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e5fc0-e873-4da0-a6d0-ff6488231a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:17.892711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e5fc0-e873-4da0-a6d0-ff6488231a69 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:17.892989 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e5fc0-e873-4da0-a6d0-ff6488231a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:17.893258 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e5fc0-e873-4da0-a6d0-ff6488231a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:17.893895 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e5fc0-e873-4da0-a6d0-ff6488231a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:17.895653 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e5fc0-e873-4da0-a6d0-ff6488231a69 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:17.905845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1373/2746] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:05:17.909927 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84191bef-9658-44bb-a39d-b18605bfbf64 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:17.920877 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84191bef-9658-44bb-a39d-b18605bfbf64 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:17.926082 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149403a1-a8c7-486d-a9f2-28f3d684eeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:17.926677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149403a1-a8c7-486d-a9f2-28f3d684eeda admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:17.927038 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149403a1-a8c7-486d-a9f2-28f3d684eeda admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:17.927511 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149403a1-a8c7-486d-a9f2-28f3d684eeda admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:17.928152 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149403a1-a8c7-486d-a9f2-28f3d684eeda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:17.929745 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149403a1-a8c7-486d-a9f2-28f3d684eeda admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:17.940583 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1374/2747] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:05:17.944888 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e5fc0-e873-4da0-a6d0-ff6488231a69 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:17.954806 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e5fc0-e873-4da0-a6d0-ff6488231a69 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:17.959474 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb3b84-3cdd-452e-8e2e-acd21fdf26a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:17.960122 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb3b84-3cdd-452e-8e2e-acd21fdf26a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:17.960364 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb3b84-3cdd-452e-8e2e-acd21fdf26a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:17.960658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb3b84-3cdd-452e-8e2e-acd21fdf26a5 admin admin] PATH_INFO: `/v3/projects/edaf73787b494af48c93e1d182cb5937/users/da1bc991421d47e4a9709f34a5f8da16/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:17.975896 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb3b84-3cdd-452e-8e2e-acd21fdf26a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edaf73787b494af48c93e1d182cb5937, user_id=da1bc991421d47e4a9709f34a5f8da16, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:17.978526 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb3b84-3cdd-452e-8e2e-acd21fdf26a5 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:17.993462 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1374/2748] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:05:17 2022] PUT /identity/v3/projects/edaf73787b494af48c93e1d182cb5937/users/da1bc991421d47e4a9709f34a5f8da16/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:18.005925 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e573b-e6fa-4aa1-9186-7d0f784eba0d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:18.006211 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e573b-e6fa-4aa1-9186-7d0f784eba0d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:18.006486 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e573b-e6fa-4aa1-9186-7d0f784eba0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:18.039580 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a32e573b-e6fa-4aa1-9186-7d0f784eba0d None None] MFA Rules not processed for user `da1bc991421d47e4a9709f34a5f8da16`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:18.041915 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a32e573b-e6fa-4aa1-9186-7d0f784eba0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:18.119897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1375/2749] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:05:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:05:18.124772 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb3b84-3cdd-452e-8e2e-acd21fdf26a5 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:18.190785 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb3b84-3cdd-452e-8e2e-acd21fdf26a5 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:18.195945 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f747755-01a7-49e6-880a-4808f8e123c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:18.196546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f747755-01a7-49e6-880a-4808f8e123c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:18.196821 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f747755-01a7-49e6-880a-4808f8e123c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:18.197093 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f747755-01a7-49e6-880a-4808f8e123c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:18.197743 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f747755-01a7-49e6-880a-4808f8e123c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:18.199682 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f747755-01a7-49e6-880a-4808f8e123c2 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:18.229647 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1375/2750] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:05:18 2022] POST /identity/v3/projects => generated 363 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:05:18.234216 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e573b-e6fa-4aa1-9186-7d0f784eba0d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:18.245128 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e573b-e6fa-4aa1-9186-7d0f784eba0d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:18.313157 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6a3fa-080a-4b6f-9332-e2dc686bb3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:18.314015 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6a3fa-080a-4b6f-9332-e2dc686bb3c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:18.314448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6a3fa-080a-4b6f-9332-e2dc686bb3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:18.314791 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6a3fa-080a-4b6f-9332-e2dc686bb3c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:18.315830 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6a3fa-080a-4b6f-9332-e2dc686bb3c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:18.318776 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6a3fa-080a-4b6f-9332-e2dc686bb3c3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:18.350693 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1376/2751] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:05:18 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:05:18.354544 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f747755-01a7-49e6-880a-4808f8e123c2 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:18.365380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f747755-01a7-49e6-880a-4808f8e123c2 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:18.370242 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a6995-ba46-448a-b858-6eca5463dff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:18.370846 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a6995-ba46-448a-b858-6eca5463dff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:18.371132 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a6995-ba46-448a-b858-6eca5463dff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:18.371389 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a6995-ba46-448a-b858-6eca5463dff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:18.372063 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a6995-ba46-448a-b858-6eca5463dff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:18.373678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a6995-ba46-448a-b858-6eca5463dff1 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:18.384497 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1376/2752] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:05:18.388617 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6a3fa-080a-4b6f-9332-e2dc686bb3c3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:18.398815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6a3fa-080a-4b6f-9332-e2dc686bb3c3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:18.405301 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2301c-80f0-4373-bc22-d9ac5c1a2ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:18.406051 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2301c-80f0-4373-bc22-d9ac5c1a2ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:18.406317 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2301c-80f0-4373-bc22-d9ac5c1a2ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:18.406593 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2301c-80f0-4373-bc22-d9ac5c1a2ca3 admin admin] PATH_INFO: `/v3/projects/5849a4ff95704dde8172c914c2c502fb/users/8092d4b1a86c462b9864ddb624e238b2/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:18.422483 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2301c-80f0-4373-bc22-d9ac5c1a2ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5849a4ff95704dde8172c914c2c502fb, user_id=8092d4b1a86c462b9864ddb624e238b2, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:18.425181 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2301c-80f0-4373-bc22-d9ac5c1a2ca3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:18.440337 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1377/2753] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:05:18 2022] PUT /identity/v3/projects/5849a4ff95704dde8172c914c2c502fb/users/8092d4b1a86c462b9864ddb624e238b2/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:18.444535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a6995-ba46-448a-b858-6eca5463dff1 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:18.454738 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a6995-ba46-448a-b858-6eca5463dff1 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:18.477527 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:18.516544 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be33f97-3cc9-4803-87d1-b7db6404b25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:18.517127 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be33f97-3cc9-4803-87d1-b7db6404b25f admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:18.517406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be33f97-3cc9-4803-87d1-b7db6404b25f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:18.517680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be33f97-3cc9-4803-87d1-b7db6404b25f admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:18.518317 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be33f97-3cc9-4803-87d1-b7db6404b25f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:18.519960 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be33f97-3cc9-4803-87d1-b7db6404b25f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:18.530537 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1377/2754] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:05:18.535001 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2301c-80f0-4373-bc22-d9ac5c1a2ca3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:18.541255 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:18.547860 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2301c-80f0-4373-bc22-d9ac5c1a2ca3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:18.554492 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace0601-82f8-49e5-bdbb-afcb0c6462ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:18.555163 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace0601-82f8-49e5-bdbb-afcb0c6462ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:18.555480 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace0601-82f8-49e5-bdbb-afcb0c6462ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:18.555759 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace0601-82f8-49e5-bdbb-afcb0c6462ca admin admin] PATH_INFO: `/v3/projects/5849a4ff95704dde8172c914c2c502fb/users/8092d4b1a86c462b9864ddb624e238b2/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:18.557742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace0601-82f8-49e5-bdbb-afcb0c6462ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=5849a4ff95704dde8172c914c2c502fb, user_id=8092d4b1a86c462b9864ddb624e238b2, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:18.560442 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace0601-82f8-49e5-bdbb-afcb0c6462ca admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:18.571276 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1378/2755] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:05:18 2022] PUT /identity/v3/projects/5849a4ff95704dde8172c914c2c502fb/users/8092d4b1a86c462b9864ddb624e238b2/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:18.581499 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ddfc3-aa80-40bd-b27b-916100e04b80 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:18.581783 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ddfc3-aa80-40bd-b27b-916100e04b80 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:18.582060 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ddfc3-aa80-40bd-b27b-916100e04b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:18.617894 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-a73ddfc3-aa80-40bd-b27b-916100e04b80 None None] MFA Rules not processed for user `8092d4b1a86c462b9864ddb624e238b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:18.619132 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a73ddfc3-aa80-40bd-b27b-916100e04b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:18.688068 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1378/2756] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:05:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:05:18.699718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace0601-82f8-49e5-bdbb-afcb0c6462ca admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:18.701795 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8ace0601-82f8-49e5-bdbb-afcb0c6462ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:18.768375 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace0601-82f8-49e5-bdbb-afcb0c6462ca admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:18.773444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9da46-1120-4021-b10e-65e1d9d21e10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:18.774073 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9da46-1120-4021-b10e-65e1d9d21e10 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:18.774349 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9da46-1120-4021-b10e-65e1d9d21e10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:18.774613 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9da46-1120-4021-b10e-65e1d9d21e10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:18.785756 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9da46-1120-4021-b10e-65e1d9d21e10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:18.787628 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9da46-1120-4021-b10e-65e1d9d21e10 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:18.800128 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1379/2757] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:05:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:05:18.825909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ddfc3-aa80-40bd-b27b-916100e04b80 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:18.827584 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-a73ddfc3-aa80-40bd-b27b-916100e04b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:18.879657 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9da46-1120-4021-b10e-65e1d9d21e10 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:18.888850 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9da46-1120-4021-b10e-65e1d9d21e10 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:18.889372 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ddfc3-aa80-40bd-b27b-916100e04b80 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:18.892514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29653504-858b-4f98-9039-8e35de936759 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:18.892901 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ea539-dc54-45fe-b41f-660a5972477e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:18.893118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29653504-858b-4f98-9039-8e35de936759 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:18.893426 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29653504-858b-4f98-9039-8e35de936759 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:18.893539 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ea539-dc54-45fe-b41f-660a5972477e service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:18.893698 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29653504-858b-4f98-9039-8e35de936759 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:18.893797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ea539-dc54-45fe-b41f-660a5972477e service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:18.894014 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ea539-dc54-45fe-b41f-660a5972477e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:18.896050 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0a4ea539-dc54-45fe-b41f-660a5972477e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:18.950767 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29653504-858b-4f98-9039-8e35de936759 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:18.952157 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29653504-858b-4f98-9039-8e35de936759 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:18.958175 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:18.960689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ea539-dc54-45fe-b41f-660a5972477e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:18.961976 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1380/2758] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:05:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:05:18.963220 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ea539-dc54-45fe-b41f-660a5972477e service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:18.973335 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1379/2759] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:05:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:05:25.226128 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29653504-858b-4f98-9039-8e35de936759 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:25.244529 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29653504-858b-4f98-9039-8e35de936759 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:25.259415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6f924-2d21-41fa-bbc9-83a60bbcfc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:25.259415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6f924-2d21-41fa-bbc9-83a60bbcfc89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:25.259415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6f924-2d21-41fa-bbc9-83a60bbcfc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:25.261061 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6f924-2d21-41fa-bbc9-83a60bbcfc89 admin admin] PATH_INFO: `/v3/users/da1bc991421d47e4a9709f34a5f8da16` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:25.261758 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ea539-dc54-45fe-b41f-660a5972477e service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:25.262541 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6f924-2d21-41fa-bbc9-83a60bbcfc89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da1bc991421d47e4a9709f34a5f8da16)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:25.264899 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0a4ea539-dc54-45fe-b41f-660a5972477e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:25.265495 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6f924-2d21-41fa-bbc9-83a60bbcfc89 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:25.285063 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ea539-dc54-45fe-b41f-660a5972477e service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:25.291835 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023a832-9f81-49bc-80de-82cda9c7b896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:25.292555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023a832-9f81-49bc-80de-82cda9c7b896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:25.292897 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023a832-9f81-49bc-80de-82cda9c7b896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:25.293232 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023a832-9f81-49bc-80de-82cda9c7b896 admin admin] PATH_INFO: `/v3/users/d6ae09155ef14b7992a0831e852d89e0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:25.294431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023a832-9f81-49bc-80de-82cda9c7b896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6ae09155ef14b7992a0831e852d89e0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:25.307040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023a832-9f81-49bc-80de-82cda9c7b896 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:25.332376 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-68a6f924-2d21-41fa-bbc9-83a60bbcfc89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da1bc991421d47e4a9709f34a5f8da16'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:25.341461 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-68a6f924-2d21-41fa-bbc9-83a60bbcfc89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da1bc991421d47e4a9709f34a5f8da16'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:25.350319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-68a6f924-2d21-41fa-bbc9-83a60bbcfc89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da1bc991421d47e4a9709f34a5f8da16'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:25.362255 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f023a832-9f81-49bc-80de-82cda9c7b896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6ae09155ef14b7992a0831e852d89e0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:25.366313 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-68a6f924-2d21-41fa-bbc9-83a60bbcfc89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da1bc991421d47e4a9709f34a5f8da16'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:25.367060 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-68a6f924-2d21-41fa-bbc9-83a60bbcfc89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da1bc991421d47e4a9709f34a5f8da16'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:25.370224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f023a832-9f81-49bc-80de-82cda9c7b896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6ae09155ef14b7992a0831e852d89e0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:25.378231 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1381/2760] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:05:25 2022] DELETE /identity/v3/users/da1bc991421d47e4a9709f34a5f8da16 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:25.381226 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fcb23-761e-423f-a8ee-190ec5ef4130 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:25.382693 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f023a832-9f81-49bc-80de-82cda9c7b896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6ae09155ef14b7992a0831e852d89e0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:25.382833 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fcb23-761e-423f-a8ee-190ec5ef4130 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:25.382833 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fcb23-761e-423f-a8ee-190ec5ef4130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:25.383209 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f023a832-9f81-49bc-80de-82cda9c7b896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6ae09155ef14b7992a0831e852d89e0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:25.390135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:25.397961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f023a832-9f81-49bc-80de-82cda9c7b896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6ae09155ef14b7992a0831e852d89e0'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:25.405676 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1380/2761] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:05:25 2022] DELETE /identity/v3/users/d6ae09155ef14b7992a0831e852d89e0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:25.410250 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a87fcb23-761e-423f-a8ee-190ec5ef4130 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:25.412880 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a87fcb23-761e-423f-a8ee-190ec5ef4130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:25.479392 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1382/2762] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 12:05:25.489321 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023a832-9f81-49bc-80de-82cda9c7b896 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:25.490831 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f023a832-9f81-49bc-80de-82cda9c7b896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:25.549192 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023a832-9f81-49bc-80de-82cda9c7b896 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:25.553457 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfa53c-4b68-49d9-b004-81837e68e054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:25.554109 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfa53c-4b68-49d9-b004-81837e68e054 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:25.554382 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfa53c-4b68-49d9-b004-81837e68e054 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:25.554654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfa53c-4b68-49d9-b004-81837e68e054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:25.564351 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfa53c-4b68-49d9-b004-81837e68e054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:25.566210 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfa53c-4b68-49d9-b004-81837e68e054 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:25.577927 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1381/2763] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:05:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:05:25.589936 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fcb23-761e-423f-a8ee-190ec5ef4130 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:25.591822 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a87fcb23-761e-423f-a8ee-190ec5ef4130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:25.609807 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fcb23-761e-423f-a8ee-190ec5ef4130 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:25.616985 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ecc97-5231-4faf-8164-2e5f6a364bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:25.617869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ecc97-5231-4faf-8164-2e5f6a364bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:25.618281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ecc97-5231-4faf-8164-2e5f6a364bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:25.618651 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ecc97-5231-4faf-8164-2e5f6a364bfb admin admin] PATH_INFO: `/v3/projects/b35a4c4abaf74b4c8677924c87633383` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:25.619899 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ecc97-5231-4faf-8164-2e5f6a364bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b35a4c4abaf74b4c8677924c87633383)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:25.621914 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ecc97-5231-4faf-8164-2e5f6a364bfb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:25.673639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d37ecc97-5231-4faf-8164-2e5f6a364bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b35a4c4abaf74b4c8677924c87633383', 'request_id': 'req-d37ecc97-5231-4faf-8164-2e5f6a364bfb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:25.682640 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d37ecc97-5231-4faf-8164-2e5f6a364bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b35a4c4abaf74b4c8677924c87633383', 'request_id': 'req-d37ecc97-5231-4faf-8164-2e5f6a364bfb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:25.689085 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d37ecc97-5231-4faf-8164-2e5f6a364bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b35a4c4abaf74b4c8677924c87633383', 'request_id': 'req-d37ecc97-5231-4faf-8164-2e5f6a364bfb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:25.701036 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d37ecc97-5231-4faf-8164-2e5f6a364bfb admin admin] The token cache is being invalidate because project b35a4c4abaf74b4c8677924c87633383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:05:25.701339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d37ecc97-5231-4faf-8164-2e5f6a364bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:25.702011 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d37ecc97-5231-4faf-8164-2e5f6a364bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:25.708674 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1383/2764] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:05:25 2022] DELETE /identity/v3/projects/b35a4c4abaf74b4c8677924c87633383 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:05:25.709835 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfa53c-4b68-49d9-b004-81837e68e054 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:25.719743 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfa53c-4b68-49d9-b004-81837e68e054 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:25.788585 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894814a-51b3-4105-a57a-28c27dfc6ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:25.789311 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894814a-51b3-4105-a57a-28c27dfc6ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:25.789647 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894814a-51b3-4105-a57a-28c27dfc6ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:25.789977 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894814a-51b3-4105-a57a-28c27dfc6ff9 admin admin] PATH_INFO: `/v3/users/3eccef06342340e6bcfe734eac510edf` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:25.791446 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894814a-51b3-4105-a57a-28c27dfc6ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eccef06342340e6bcfe734eac510edf)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:25.793234 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894814a-51b3-4105-a57a-28c27dfc6ff9 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:25.809013 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:25.846026 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4894814a-51b3-4105-a57a-28c27dfc6ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eccef06342340e6bcfe734eac510edf'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:25.855336 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4894814a-51b3-4105-a57a-28c27dfc6ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eccef06342340e6bcfe734eac510edf'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:25.865124 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4894814a-51b3-4105-a57a-28c27dfc6ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eccef06342340e6bcfe734eac510edf'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:25.865800 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4894814a-51b3-4105-a57a-28c27dfc6ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eccef06342340e6bcfe734eac510edf'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:25.875664 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ecc97-5231-4faf-8164-2e5f6a364bfb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:25.877154 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d37ecc97-5231-4faf-8164-2e5f6a364bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:25.882974 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4894814a-51b3-4105-a57a-28c27dfc6ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eccef06342340e6bcfe734eac510edf'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:25.889118 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1382/2765] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:05:25 2022] DELETE /identity/v3/users/3eccef06342340e6bcfe734eac510edf => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:05:25.898481 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ecc97-5231-4faf-8164-2e5f6a364bfb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:25.959328 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903c5ec-985a-43ab-ac44-c9d6d8f99d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:25.960016 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903c5ec-985a-43ab-ac44-c9d6d8f99d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:25.960288 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903c5ec-985a-43ab-ac44-c9d6d8f99d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:25.960553 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903c5ec-985a-43ab-ac44-c9d6d8f99d03 admin admin] PATH_INFO: `/v3/projects/edaf73787b494af48c93e1d182cb5937` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:25.961642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903c5ec-985a-43ab-ac44-c9d6d8f99d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edaf73787b494af48c93e1d182cb5937)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:25.963643 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903c5ec-985a-43ab-ac44-c9d6d8f99d03 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:25.995947 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:26.012888 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2903c5ec-985a-43ab-ac44-c9d6d8f99d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edaf73787b494af48c93e1d182cb5937', 'request_id': 'req-2903c5ec-985a-43ab-ac44-c9d6d8f99d03'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:26.021800 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2903c5ec-985a-43ab-ac44-c9d6d8f99d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edaf73787b494af48c93e1d182cb5937', 'request_id': 'req-2903c5ec-985a-43ab-ac44-c9d6d8f99d03'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:26.028104 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2903c5ec-985a-43ab-ac44-c9d6d8f99d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edaf73787b494af48c93e1d182cb5937', 'request_id': 'req-2903c5ec-985a-43ab-ac44-c9d6d8f99d03'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:26.039696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2903c5ec-985a-43ab-ac44-c9d6d8f99d03 admin admin] The token cache is being invalidate because project edaf73787b494af48c93e1d182cb5937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:05:26.039951 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2903c5ec-985a-43ab-ac44-c9d6d8f99d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:26.040609 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2903c5ec-985a-43ab-ac44-c9d6d8f99d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:26.042115 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1384/2766] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:05:25 2022] DELETE /identity/v3/projects/edaf73787b494af48c93e1d182cb5937 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:26.046227 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894814a-51b3-4105-a57a-28c27dfc6ff9 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:26.047630 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-4894814a-51b3-4105-a57a-28c27dfc6ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:26.061047 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894814a-51b3-4105-a57a-28c27dfc6ff9 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:26.078318 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903c5ec-985a-43ab-ac44-c9d6d8f99d03 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:26.080113 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2903c5ec-985a-43ab-ac44-c9d6d8f99d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:26.128269 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cfcd7-6854-4061-95c9-779f10c77b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:26.129186 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cfcd7-6854-4061-95c9-779f10c77b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:26.129529 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cfcd7-6854-4061-95c9-779f10c77b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:26.129806 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cfcd7-6854-4061-95c9-779f10c77b75 admin admin] PATH_INFO: `/v3/users/8092d4b1a86c462b9864ddb624e238b2` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:26.131082 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cfcd7-6854-4061-95c9-779f10c77b75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8092d4b1a86c462b9864ddb624e238b2)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:26.133016 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cfcd7-6854-4061-95c9-779f10c77b75 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:26.162513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903c5ec-985a-43ab-ac44-c9d6d8f99d03 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:26.167811 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2195b-26c0-4777-b035-2b36b630ce2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:26.168529 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2195b-26c0-4777-b035-2b36b630ce2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:26.168805 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2195b-26c0-4777-b035-2b36b630ce2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:26.169120 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2195b-26c0-4777-b035-2b36b630ce2c admin admin] PATH_INFO: `/v3/projects/f23637a2acbf4afe8bfaf6da7f203bee` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:26.170360 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2195b-26c0-4777-b035-2b36b630ce2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f23637a2acbf4afe8bfaf6da7f203bee)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:26.172622 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2195b-26c0-4777-b035-2b36b630ce2c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:26.186533 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-164cfcd7-6854-4061-95c9-779f10c77b75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8092d4b1a86c462b9864ddb624e238b2'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:26.195186 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-164cfcd7-6854-4061-95c9-779f10c77b75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8092d4b1a86c462b9864ddb624e238b2'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:26.205987 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-164cfcd7-6854-4061-95c9-779f10c77b75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8092d4b1a86c462b9864ddb624e238b2'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:26.206944 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-164cfcd7-6854-4061-95c9-779f10c77b75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8092d4b1a86c462b9864ddb624e238b2'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:26.220290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-164cfcd7-6854-4061-95c9-779f10c77b75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8092d4b1a86c462b9864ddb624e238b2'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:26.227542 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4de2195b-26c0-4777-b035-2b36b630ce2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f23637a2acbf4afe8bfaf6da7f203bee', 'request_id': 'req-4de2195b-26c0-4777-b035-2b36b630ce2c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:26.228076 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1383/2767] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:05:26 2022] DELETE /identity/v3/users/8092d4b1a86c462b9864ddb624e238b2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:26.236502 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4de2195b-26c0-4777-b035-2b36b630ce2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f23637a2acbf4afe8bfaf6da7f203bee', 'request_id': 'req-4de2195b-26c0-4777-b035-2b36b630ce2c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:26.242248 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4de2195b-26c0-4777-b035-2b36b630ce2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f23637a2acbf4afe8bfaf6da7f203bee', 'request_id': 'req-4de2195b-26c0-4777-b035-2b36b630ce2c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:26.253916 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4de2195b-26c0-4777-b035-2b36b630ce2c admin admin] The token cache is being invalidate because project f23637a2acbf4afe8bfaf6da7f203bee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:05:26.254308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4de2195b-26c0-4777-b035-2b36b630ce2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:26.254861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4de2195b-26c0-4777-b035-2b36b630ce2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:26.256600 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1385/2768] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:05:26 2022] DELETE /identity/v3/projects/f23637a2acbf4afe8bfaf6da7f203bee => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:26.767549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cfcd7-6854-4061-95c9-779f10c77b75 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:26.769069 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-164cfcd7-6854-4061-95c9-779f10c77b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:26.780417 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:26.839668 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cfcd7-6854-4061-95c9-779f10c77b75 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:26.844763 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753213dd-d7e9-42a8-80f6-e98e949d6545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:26.845399 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753213dd-d7e9-42a8-80f6-e98e949d6545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:26.845680 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753213dd-d7e9-42a8-80f6-e98e949d6545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:26.845951 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753213dd-d7e9-42a8-80f6-e98e949d6545 admin admin] PATH_INFO: `/v3/projects/5849a4ff95704dde8172c914c2c502fb` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:26.847085 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753213dd-d7e9-42a8-80f6-e98e949d6545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5849a4ff95704dde8172c914c2c502fb)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:26.849141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753213dd-d7e9-42a8-80f6-e98e949d6545 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:26.898213 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-753213dd-d7e9-42a8-80f6-e98e949d6545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5849a4ff95704dde8172c914c2c502fb', 'request_id': 'req-753213dd-d7e9-42a8-80f6-e98e949d6545'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:26.904679 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-753213dd-d7e9-42a8-80f6-e98e949d6545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5849a4ff95704dde8172c914c2c502fb', 'request_id': 'req-753213dd-d7e9-42a8-80f6-e98e949d6545'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:26.912142 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-753213dd-d7e9-42a8-80f6-e98e949d6545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5849a4ff95704dde8172c914c2c502fb', 'request_id': 'req-753213dd-d7e9-42a8-80f6-e98e949d6545'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:26.929673 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-753213dd-d7e9-42a8-80f6-e98e949d6545 admin admin] The token cache is being invalidate because project 5849a4ff95704dde8172c914c2c502fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:05:26.930089 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-753213dd-d7e9-42a8-80f6-e98e949d6545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:26.930945 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-753213dd-d7e9-42a8-80f6-e98e949d6545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:26.933424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1384/2769] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:05:26 2022] DELETE /identity/v3/projects/5849a4ff95704dde8172c914c2c502fb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:26.938552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd843e-042f-41ef-91ea-74f18ea09422 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:26.938841 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd843e-042f-41ef-91ea-74f18ea09422 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:26.939123 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd843e-042f-41ef-91ea-74f18ea09422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:26.960450 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-30bd843e-042f-41ef-91ea-74f18ea09422 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:26.961613 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-30bd843e-042f-41ef-91ea-74f18ea09422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:27.005128 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:27.025369 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1386/2770] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:05:27.033344 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fbde2-c654-44f3-b6b6-21e166f99671 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:27.033725 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fbde2-c654-44f3-b6b6-21e166f99671 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:27.034061 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fbde2-c654-44f3-b6b6-21e166f99671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:27.054053 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-821fbde2-c654-44f3-b6b6-21e166f99671 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:27.055262 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-821fbde2-c654-44f3-b6b6-21e166f99671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:27.063984 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1385/2771] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:05:27.068456 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd843e-042f-41ef-91ea-74f18ea09422 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:27.078517 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd843e-042f-41ef-91ea-74f18ea09422 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:27.083750 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fcc8e-32c1-45cf-9bc8-9ca5d65b32c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:27.084357 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fcc8e-32c1-45cf-9bc8-9ca5d65b32c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:27.084634 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fcc8e-32c1-45cf-9bc8-9ca5d65b32c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:27.084901 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fcc8e-32c1-45cf-9bc8-9ca5d65b32c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:27.085549 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04fcc8e-32c1-45cf-9bc8-9ca5d65b32c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 12:05:27.085853 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04fcc8e-32c1-45cf-9bc8-9ca5d65b32c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:27.087485 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04fcc8e-32c1-45cf-9bc8-9ca5d65b32c5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:27.099658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1387/2772] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 12:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 12:05:27.104212 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fbde2-c654-44f3-b6b6-21e166f99671 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:27.113674 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fbde2-c654-44f3-b6b6-21e166f99671 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:27.119747 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478e77e-0af4-46ff-83a0-98e5ed775edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:27.120441 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478e77e-0af4-46ff-83a0-98e5ed775edc admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:27.120696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478e77e-0af4-46ff-83a0-98e5ed775edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:27.120976 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478e77e-0af4-46ff-83a0-98e5ed775edc admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:27.121613 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478e77e-0af4-46ff-83a0-98e5ed775edc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:27.123585 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478e77e-0af4-46ff-83a0-98e5ed775edc admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:27.153887 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1386/2773] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:05:27 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:05:27.158323 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fcc8e-32c1-45cf-9bc8-9ca5d65b32c5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:27.170332 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fcc8e-32c1-45cf-9bc8-9ca5d65b32c5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:27.230533 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776b3a1-0356-43e8-b541-9ed259b4c1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:27.231178 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776b3a1-0356-43e8-b541-9ed259b4c1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:27.231310 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776b3a1-0356-43e8-b541-9ed259b4c1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:27.231618 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776b3a1-0356-43e8-b541-9ed259b4c1c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:27.232239 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776b3a1-0356-43e8-b541-9ed259b4c1c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:27.234152 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776b3a1-0356-43e8-b541-9ed259b4c1c7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:27.257932 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1388/2774] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:05:27 2022] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 12:05:27.262416 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478e77e-0af4-46ff-83a0-98e5ed775edc admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:27.273522 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478e77e-0af4-46ff-83a0-98e5ed775edc admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:27.278689 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84032f8-dc04-42c2-b286-09d0b2ea120f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:27.279300 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84032f8-dc04-42c2-b286-09d0b2ea120f admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:27.279709 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84032f8-dc04-42c2-b286-09d0b2ea120f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:27.279975 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84032f8-dc04-42c2-b286-09d0b2ea120f admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:27.280627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84032f8-dc04-42c2-b286-09d0b2ea120f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:27.282221 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84032f8-dc04-42c2-b286-09d0b2ea120f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:27.293035 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1387/2775] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:05:27.297172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776b3a1-0356-43e8-b541-9ed259b4c1c7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:27.307680 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776b3a1-0356-43e8-b541-9ed259b4c1c7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:27.312937 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eda611-51b6-456c-817f-061f3ebd7941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:27.313526 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eda611-51b6-456c-817f-061f3ebd7941 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:27.313815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eda611-51b6-456c-817f-061f3ebd7941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:27.314057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eda611-51b6-456c-817f-061f3ebd7941 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:27.314723 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eda611-51b6-456c-817f-061f3ebd7941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:27.316382 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eda611-51b6-456c-817f-061f3ebd7941 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:27.327430 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1389/2776] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:05:27.337055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84032f8-dc04-42c2-b286-09d0b2ea120f admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:27.347456 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84032f8-dc04-42c2-b286-09d0b2ea120f admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:27.352377 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7530f0c-9b21-44af-a1c8-56bc1ee86491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:27.353025 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7530f0c-9b21-44af-a1c8-56bc1ee86491 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:27.353302 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7530f0c-9b21-44af-a1c8-56bc1ee86491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:27.353572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7530f0c-9b21-44af-a1c8-56bc1ee86491 admin admin] PATH_INFO: `/v3/projects/cb14cc5d9ab14129a73350d57804461a/users/a1e748f0e84641ad89c3771507953880/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:27.368646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7530f0c-9b21-44af-a1c8-56bc1ee86491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb14cc5d9ab14129a73350d57804461a, user_id=a1e748f0e84641ad89c3771507953880, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:27.371300 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7530f0c-9b21-44af-a1c8-56bc1ee86491 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:27.386120 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1388/2777] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:05:27 2022] PUT /identity/v3/projects/cb14cc5d9ab14129a73350d57804461a/users/a1e748f0e84641ad89c3771507953880/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:27.397659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbe71a-d478-4d5e-9c95-53d06786ca9a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:27.397944 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbe71a-d478-4d5e-9c95-53d06786ca9a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:27.398223 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbe71a-d478-4d5e-9c95-53d06786ca9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:27.429779 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-64cbe71a-d478-4d5e-9c95-53d06786ca9a None None] MFA Rules not processed for user `a1e748f0e84641ad89c3771507953880`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:27.431024 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-64cbe71a-d478-4d5e-9c95-53d06786ca9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:27.631286 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1390/2778] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:05:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:05:27.636129 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7530f0c-9b21-44af-a1c8-56bc1ee86491 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:27.677597 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:27.702353 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7530f0c-9b21-44af-a1c8-56bc1ee86491 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:27.708279 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd3be1-a813-496f-8f1f-1660ebbdafe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:27.708886 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd3be1-a813-496f-8f1f-1660ebbdafe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:27.709163 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd3be1-a813-496f-8f1f-1660ebbdafe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:27.709435 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd3be1-a813-496f-8f1f-1660ebbdafe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:27.710063 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd3be1-a813-496f-8f1f-1660ebbdafe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:27.712017 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd3be1-a813-496f-8f1f-1660ebbdafe1 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:27.741365 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1389/2779] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:05:27 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:05:27.746281 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbe71a-d478-4d5e-9c95-53d06786ca9a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:27.763987 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbe71a-d478-4d5e-9c95-53d06786ca9a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:27.812357 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:27.835653 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e532bb-fff1-40d8-b0c9-155a2030f3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:27.836270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e532bb-fff1-40d8-b0c9-155a2030f3ed admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:27.836543 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e532bb-fff1-40d8-b0c9-155a2030f3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:27.836807 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e532bb-fff1-40d8-b0c9-155a2030f3ed admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:27.837434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e532bb-fff1-40d8-b0c9-155a2030f3ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:27.839384 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e532bb-fff1-40d8-b0c9-155a2030f3ed admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:27.861996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1391/2780] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:05:27 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:05:27.866197 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd3be1-a813-496f-8f1f-1660ebbdafe1 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:27.876899 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd3be1-a813-496f-8f1f-1660ebbdafe1 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:27.882237 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfef0e1-9379-49c0-87c4-1d826d380166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:27.882765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfef0e1-9379-49c0-87c4-1d826d380166 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:27.883040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfef0e1-9379-49c0-87c4-1d826d380166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:27.883306 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfef0e1-9379-49c0-87c4-1d826d380166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:27.883970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfef0e1-9379-49c0-87c4-1d826d380166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:27.885572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfef0e1-9379-49c0-87c4-1d826d380166 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:27.896841 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1390/2781] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:05:27.901116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e532bb-fff1-40d8-b0c9-155a2030f3ed admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:27.912473 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e532bb-fff1-40d8-b0c9-155a2030f3ed admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:27.917561 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cf4cd-3c88-4ab7-bd42-ef055770d0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:27.918211 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cf4cd-3c88-4ab7-bd42-ef055770d0b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:27.918513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cf4cd-3c88-4ab7-bd42-ef055770d0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:27.918785 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cf4cd-3c88-4ab7-bd42-ef055770d0b9 admin admin] PATH_INFO: `/v3/projects/6ebb39e271f04c3b843df361d2e881d0/users/5af08ee75c8a4be591036d09b9b086f2/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:27.935466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62cf4cd-3c88-4ab7-bd42-ef055770d0b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ebb39e271f04c3b843df361d2e881d0, user_id=5af08ee75c8a4be591036d09b9b086f2, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:27.938135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62cf4cd-3c88-4ab7-bd42-ef055770d0b9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:27.954078 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1392/2782] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:05:27 2022] PUT /identity/v3/projects/6ebb39e271f04c3b843df361d2e881d0/users/5af08ee75c8a4be591036d09b9b086f2/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:27.958273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfef0e1-9379-49c0-87c4-1d826d380166 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:27.968268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfef0e1-9379-49c0-87c4-1d826d380166 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:28.028242 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc73fb7-160d-42cd-a8de-aa47f55145f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:28.028845 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc73fb7-160d-42cd-a8de-aa47f55145f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:28.029106 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc73fb7-160d-42cd-a8de-aa47f55145f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:28.029369 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc73fb7-160d-42cd-a8de-aa47f55145f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:28.030001 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc73fb7-160d-42cd-a8de-aa47f55145f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:28.031655 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc73fb7-160d-42cd-a8de-aa47f55145f8 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:28.041774 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1391/2783] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:05:28.046899 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cf4cd-3c88-4ab7-bd42-ef055770d0b9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:28.059521 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cf4cd-3c88-4ab7-bd42-ef055770d0b9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:28.065177 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dda007-72be-4ea5-add2-b029a248c2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:28.065824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dda007-72be-4ea5-add2-b029a248c2b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:28.066102 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dda007-72be-4ea5-add2-b029a248c2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:28.066368 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dda007-72be-4ea5-add2-b029a248c2b4 admin admin] PATH_INFO: `/v3/projects/6ebb39e271f04c3b843df361d2e881d0/users/5af08ee75c8a4be591036d09b9b086f2/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:28.068479 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dda007-72be-4ea5-add2-b029a248c2b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ebb39e271f04c3b843df361d2e881d0, user_id=5af08ee75c8a4be591036d09b9b086f2, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:28.071110 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dda007-72be-4ea5-add2-b029a248c2b4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:28.081446 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1393/2784] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:05:28 2022] PUT /identity/v3/projects/6ebb39e271f04c3b843df361d2e881d0/users/5af08ee75c8a4be591036d09b9b086f2/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:28.092457 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657d94c-eac3-4639-893a-d3edb73d0ca6 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:28.092743 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657d94c-eac3-4639-893a-d3edb73d0ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:28.093008 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657d94c-eac3-4639-893a-d3edb73d0ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:28.128438 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-9657d94c-eac3-4639-893a-d3edb73d0ca6 None None] MFA Rules not processed for user `5af08ee75c8a4be591036d09b9b086f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:28.129660 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9657d94c-eac3-4639-893a-d3edb73d0ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:28.204914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1392/2785] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:05:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:05:28.220701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dda007-72be-4ea5-add2-b029a248c2b4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:28.222544 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-28dda007-72be-4ea5-add2-b029a248c2b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:28.281344 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dda007-72be-4ea5-add2-b029a248c2b4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:28.285299 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa820a7b-f326-459b-b1ce-ed608d38c06f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:28.285902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa820a7b-f326-459b-b1ce-ed608d38c06f service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:28.286562 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa820a7b-f326-459b-b1ce-ed608d38c06f service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:28.286863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa820a7b-f326-459b-b1ce-ed608d38c06f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:28.296289 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa820a7b-f326-459b-b1ce-ed608d38c06f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:28.297741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa820a7b-f326-459b-b1ce-ed608d38c06f service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:28.307160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1394/2786] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:05:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:05:29.770970 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657d94c-eac3-4639-893a-d3edb73d0ca6 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:29.804827 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:29.835269 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657d94c-eac3-4639-893a-d3edb73d0ca6 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:29.840020 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599946b-6a43-465c-9e5b-30085a61d9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:29.840648 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599946b-6a43-465c-9e5b-30085a61d9e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:29.840928 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599946b-6a43-465c-9e5b-30085a61d9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:29.841195 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599946b-6a43-465c-9e5b-30085a61d9e0 admin admin] PATH_INFO: `/v3/users/a1e748f0e84641ad89c3771507953880` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:29.842342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599946b-6a43-465c-9e5b-30085a61d9e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1e748f0e84641ad89c3771507953880)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:29.844303 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599946b-6a43-465c-9e5b-30085a61d9e0 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:29.902003 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0599946b-6a43-465c-9e5b-30085a61d9e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1e748f0e84641ad89c3771507953880'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:29.909875 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0599946b-6a43-465c-9e5b-30085a61d9e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1e748f0e84641ad89c3771507953880'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:29.919879 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0599946b-6a43-465c-9e5b-30085a61d9e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1e748f0e84641ad89c3771507953880'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:29.920483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0599946b-6a43-465c-9e5b-30085a61d9e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1e748f0e84641ad89c3771507953880'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:29.933642 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-0599946b-6a43-465c-9e5b-30085a61d9e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1e748f0e84641ad89c3771507953880'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:29.940056 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1393/2787] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:05:29 2022] DELETE /identity/v3/users/a1e748f0e84641ad89c3771507953880 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:29.945065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6ef51-30a9-475b-86f3-afe64a1658e1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:29.945565 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6ef51-30a9-475b-86f3-afe64a1658e1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:29.945565 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6ef51-30a9-475b-86f3-afe64a1658e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:29.971152 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a8c6ef51-30a9-475b-86f3-afe64a1658e1 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:29.973159 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a8c6ef51-30a9-475b-86f3-afe64a1658e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:30.039607 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1395/2788] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:05:30.049540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599946b-6a43-465c-9e5b-30085a61d9e0 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:30.051077 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-0599946b-6a43-465c-9e5b-30085a61d9e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:30.117490 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599946b-6a43-465c-9e5b-30085a61d9e0 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:30.121563 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5751e5-9df1-499a-ba32-f0111614f6c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:30.122181 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5751e5-9df1-499a-ba32-f0111614f6c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:30.122458 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5751e5-9df1-499a-ba32-f0111614f6c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:30.122802 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5751e5-9df1-499a-ba32-f0111614f6c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:30.131840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5751e5-9df1-499a-ba32-f0111614f6c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:30.133287 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5751e5-9df1-499a-ba32-f0111614f6c0 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:30.142609 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1394/2789] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:05:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:05:30.437978 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6ef51-30a9-475b-86f3-afe64a1658e1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:30.440558 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a8c6ef51-30a9-475b-86f3-afe64a1658e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:30.453757 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6ef51-30a9-475b-86f3-afe64a1658e1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:30.459668 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21097ab5-fd84-4492-b1a4-2f24d020fe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:30.460353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21097ab5-fd84-4492-b1a4-2f24d020fe2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:30.460720 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21097ab5-fd84-4492-b1a4-2f24d020fe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:30.461149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21097ab5-fd84-4492-b1a4-2f24d020fe2a admin admin] PATH_INFO: `/v3/projects/cb14cc5d9ab14129a73350d57804461a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:30.462475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21097ab5-fd84-4492-b1a4-2f24d020fe2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb14cc5d9ab14129a73350d57804461a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:30.464373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21097ab5-fd84-4492-b1a4-2f24d020fe2a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:30.514078 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:30.529499 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-21097ab5-fd84-4492-b1a4-2f24d020fe2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb14cc5d9ab14129a73350d57804461a', 'request_id': 'req-21097ab5-fd84-4492-b1a4-2f24d020fe2a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:30.538533 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-21097ab5-fd84-4492-b1a4-2f24d020fe2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb14cc5d9ab14129a73350d57804461a', 'request_id': 'req-21097ab5-fd84-4492-b1a4-2f24d020fe2a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:30.543975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-21097ab5-fd84-4492-b1a4-2f24d020fe2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb14cc5d9ab14129a73350d57804461a', 'request_id': 'req-21097ab5-fd84-4492-b1a4-2f24d020fe2a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:30.556107 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-21097ab5-fd84-4492-b1a4-2f24d020fe2a admin admin] The token cache is being invalidate because project cb14cc5d9ab14129a73350d57804461a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:05:30.556388 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-21097ab5-fd84-4492-b1a4-2f24d020fe2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:30.557099 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-21097ab5-fd84-4492-b1a4-2f24d020fe2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:30.558654 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1396/2790] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:05:30 2022] DELETE /identity/v3/projects/cb14cc5d9ab14129a73350d57804461a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:30.562924 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5751e5-9df1-499a-ba32-f0111614f6c0 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:30.575164 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5751e5-9df1-499a-ba32-f0111614f6c0 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:30.642869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:30.654892 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b048679-0de0-4a3c-8ead-c889326e04c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:30.655563 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b048679-0de0-4a3c-8ead-c889326e04c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:30.655858 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b048679-0de0-4a3c-8ead-c889326e04c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:30.656120 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b048679-0de0-4a3c-8ead-c889326e04c9 admin admin] PATH_INFO: `/v3/users/5af08ee75c8a4be591036d09b9b086f2` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:30.657284 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b048679-0de0-4a3c-8ead-c889326e04c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5af08ee75c8a4be591036d09b9b086f2)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:30.659228 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b048679-0de0-4a3c-8ead-c889326e04c9 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:30.715597 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4b048679-0de0-4a3c-8ead-c889326e04c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5af08ee75c8a4be591036d09b9b086f2'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:30.722463 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4b048679-0de0-4a3c-8ead-c889326e04c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5af08ee75c8a4be591036d09b9b086f2'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:30.731068 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4b048679-0de0-4a3c-8ead-c889326e04c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5af08ee75c8a4be591036d09b9b086f2'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:30.731789 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4b048679-0de0-4a3c-8ead-c889326e04c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5af08ee75c8a4be591036d09b9b086f2'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:30.744061 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-4b048679-0de0-4a3c-8ead-c889326e04c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5af08ee75c8a4be591036d09b9b086f2'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:30.749876 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1395/2791] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:05:30 2022] DELETE /identity/v3/users/5af08ee75c8a4be591036d09b9b086f2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:05:31.046814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21097ab5-fd84-4492-b1a4-2f24d020fe2a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:31.048301 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-21097ab5-fd84-4492-b1a4-2f24d020fe2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:31.063427 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21097ab5-fd84-4492-b1a4-2f24d020fe2a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:31.124806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182ff94-b351-43a1-ab04-c82c845c7d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:31.125449 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182ff94-b351-43a1-ab04-c82c845c7d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:31.125720 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182ff94-b351-43a1-ab04-c82c845c7d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:31.125988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182ff94-b351-43a1-ab04-c82c845c7d48 admin admin] PATH_INFO: `/v3/projects/6ebb39e271f04c3b843df361d2e881d0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:31.127135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182ff94-b351-43a1-ab04-c82c845c7d48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ebb39e271f04c3b843df361d2e881d0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:31.129078 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182ff94-b351-43a1-ab04-c82c845c7d48 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:31.179057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0182ff94-b351-43a1-ab04-c82c845c7d48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ebb39e271f04c3b843df361d2e881d0', 'request_id': 'req-0182ff94-b351-43a1-ab04-c82c845c7d48'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:31.187304 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0182ff94-b351-43a1-ab04-c82c845c7d48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ebb39e271f04c3b843df361d2e881d0', 'request_id': 'req-0182ff94-b351-43a1-ab04-c82c845c7d48'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:31.193179 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0182ff94-b351-43a1-ab04-c82c845c7d48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ebb39e271f04c3b843df361d2e881d0', 'request_id': 'req-0182ff94-b351-43a1-ab04-c82c845c7d48'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:31.204642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0182ff94-b351-43a1-ab04-c82c845c7d48 admin admin] The token cache is being invalidate because project 6ebb39e271f04c3b843df361d2e881d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:05:31.204925 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0182ff94-b351-43a1-ab04-c82c845c7d48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:31.205577 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0182ff94-b351-43a1-ab04-c82c845c7d48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:31.207080 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1397/2792] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:05:31 2022] DELETE /identity/v3/projects/6ebb39e271f04c3b843df361d2e881d0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:05:31.212455 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d040fb-b935-4826-89e1-cc71b68a3462 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:31.212939 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d040fb-b935-4826-89e1-cc71b68a3462 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:31.213034 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d040fb-b935-4826-89e1-cc71b68a3462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:31.233385 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-c9d040fb-b935-4826-89e1-cc71b68a3462 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:31.234582 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-c9d040fb-b935-4826-89e1-cc71b68a3462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:31.297303 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1396/2793] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:05:31.366468 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12123cb8-a081-4d35-9c07-c0d1d7e53a8c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:31.366810 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12123cb8-a081-4d35-9c07-c0d1d7e53a8c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:31.367059 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12123cb8-a081-4d35-9c07-c0d1d7e53a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:31.399991 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-12123cb8-a081-4d35-9c07-c0d1d7e53a8c None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:31.401630 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-12123cb8-a081-4d35-9c07-c0d1d7e53a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:31.415343 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1398/2794] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:05:31.419938 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d040fb-b935-4826-89e1-cc71b68a3462 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:31.430597 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d040fb-b935-4826-89e1-cc71b68a3462 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:31.436479 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370cd24-c0e0-424b-8449-40ebb10c7b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:31.437082 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370cd24-c0e0-424b-8449-40ebb10c7b66 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:31.437356 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370cd24-c0e0-424b-8449-40ebb10c7b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:31.437620 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370cd24-c0e0-424b-8449-40ebb10c7b66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:31.438260 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370cd24-c0e0-424b-8449-40ebb10c7b66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 12:05:31.438563 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370cd24-c0e0-424b-8449-40ebb10c7b66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:31.440224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370cd24-c0e0-424b-8449-40ebb10c7b66 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:31.452737 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1397/2795] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 12:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 12:05:31.457109 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12123cb8-a081-4d35-9c07-c0d1d7e53a8c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:31.467333 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12123cb8-a081-4d35-9c07-c0d1d7e53a8c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:31.473033 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae65b2-13dd-44d9-b543-7ea2dfb78283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:31.473664 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae65b2-13dd-44d9-b543-7ea2dfb78283 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:31.473944 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae65b2-13dd-44d9-b543-7ea2dfb78283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:31.474208 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae65b2-13dd-44d9-b543-7ea2dfb78283 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:31.474832 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae65b2-13dd-44d9-b543-7ea2dfb78283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:31.477264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae65b2-13dd-44d9-b543-7ea2dfb78283 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:31.508756 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1399/2796] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:05:31 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:05:31.513209 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370cd24-c0e0-424b-8449-40ebb10c7b66 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:31.523718 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370cd24-c0e0-424b-8449-40ebb10c7b66 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:31.581797 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f083c1-5887-47b1-add2-3dc279443171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:31.582415 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f083c1-5887-47b1-add2-3dc279443171 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:31.582687 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f083c1-5887-47b1-add2-3dc279443171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:31.582954 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f083c1-5887-47b1-add2-3dc279443171 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:31.583605 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f083c1-5887-47b1-add2-3dc279443171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:31.585608 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f083c1-5887-47b1-add2-3dc279443171 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:31.593773 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:31.610247 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1398/2797] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:05:31 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:05:31.614488 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae65b2-13dd-44d9-b543-7ea2dfb78283 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:31.626178 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae65b2-13dd-44d9-b543-7ea2dfb78283 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:31.632125 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac09e6-a537-47e2-bf7d-6ca841f958fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:31.632709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac09e6-a537-47e2-bf7d-6ca841f958fd admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:31.632988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac09e6-a537-47e2-bf7d-6ca841f958fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:31.633258 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac09e6-a537-47e2-bf7d-6ca841f958fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:31.633902 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac09e6-a537-47e2-bf7d-6ca841f958fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:31.635547 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac09e6-a537-47e2-bf7d-6ca841f958fd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:31.646556 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1400/2798] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:05:31.651237 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f083c1-5887-47b1-add2-3dc279443171 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:31.661860 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f083c1-5887-47b1-add2-3dc279443171 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:31.667646 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a913e7-e237-4386-8c2b-464c411dae65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:31.668340 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a913e7-e237-4386-8c2b-464c411dae65 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:31.668628 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a913e7-e237-4386-8c2b-464c411dae65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:31.668897 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a913e7-e237-4386-8c2b-464c411dae65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:31.669534 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a913e7-e237-4386-8c2b-464c411dae65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:31.671151 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a913e7-e237-4386-8c2b-464c411dae65 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:31.682552 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1399/2799] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:05:31.686781 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac09e6-a537-47e2-bf7d-6ca841f958fd admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:31.697235 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac09e6-a537-47e2-bf7d-6ca841f958fd admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:31.703160 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ad388-a717-42f4-9527-fa88e5ce673a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:31.703837 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ad388-a717-42f4-9527-fa88e5ce673a admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:31.704116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ad388-a717-42f4-9527-fa88e5ce673a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:31.704383 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ad388-a717-42f4-9527-fa88e5ce673a admin admin] PATH_INFO: `/v3/projects/dfb639ba1e654341a2a9e70f5b3cf112/users/67aa84451a4549a9962190d3617df157/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:31.712742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:31.720553 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ad388-a717-42f4-9527-fa88e5ce673a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfb639ba1e654341a2a9e70f5b3cf112, user_id=67aa84451a4549a9962190d3617df157, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:31.723880 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ad388-a717-42f4-9527-fa88e5ce673a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:31.737649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1401/2800] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:05:31 2022] PUT /identity/v3/projects/dfb639ba1e654341a2a9e70f5b3cf112/users/67aa84451a4549a9962190d3617df157/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:05:31.747875 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00361493-ed81-4cdd-91ed-250a91a22d39 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:31.748164 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00361493-ed81-4cdd-91ed-250a91a22d39 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:31.748437 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00361493-ed81-4cdd-91ed-250a91a22d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:31.776447 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-00361493-ed81-4cdd-91ed-250a91a22d39 None None] MFA Rules not processed for user `67aa84451a4549a9962190d3617df157`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:31.777649 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-00361493-ed81-4cdd-91ed-250a91a22d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:31.847519 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1400/2801] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:05:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:05:31.852922 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ad388-a717-42f4-9527-fa88e5ce673a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:31.926868 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ad388-a717-42f4-9527-fa88e5ce673a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:31.932393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e55cd0-3277-4ace-9f11-0b14a1e43023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:31.933067 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e55cd0-3277-4ace-9f11-0b14a1e43023 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:31.933252 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e55cd0-3277-4ace-9f11-0b14a1e43023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:31.933529 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e55cd0-3277-4ace-9f11-0b14a1e43023 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:31.934149 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e55cd0-3277-4ace-9f11-0b14a1e43023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:31.936096 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e55cd0-3277-4ace-9f11-0b14a1e43023 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:31.965390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1402/2802] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:05:31 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:05:31.970509 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00361493-ed81-4cdd-91ed-250a91a22d39 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:31.983928 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00361493-ed81-4cdd-91ed-250a91a22d39 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:32.058048 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c17546-938f-4557-990c-47e0f1bf96fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:32.058648 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c17546-938f-4557-990c-47e0f1bf96fc admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:32.058915 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c17546-938f-4557-990c-47e0f1bf96fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:32.059155 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c17546-938f-4557-990c-47e0f1bf96fc admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:32.059816 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c17546-938f-4557-990c-47e0f1bf96fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:32.061768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c17546-938f-4557-990c-47e0f1bf96fc admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:32.085504 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1401/2803] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:05:31 2022] POST /identity/v3/users => generated 300 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:05:32.090361 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e55cd0-3277-4ace-9f11-0b14a1e43023 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:32.103886 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e55cd0-3277-4ace-9f11-0b14a1e43023 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:32.109323 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce3e64-12c8-4db4-969f-c3873e3d0b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:32.110088 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce3e64-12c8-4db4-969f-c3873e3d0b97 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:32.110259 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce3e64-12c8-4db4-969f-c3873e3d0b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:32.110557 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce3e64-12c8-4db4-969f-c3873e3d0b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:32.111205 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce3e64-12c8-4db4-969f-c3873e3d0b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:32.112843 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce3e64-12c8-4db4-969f-c3873e3d0b97 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:32.124678 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1403/2804] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:05:32.129075 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c17546-938f-4557-990c-47e0f1bf96fc admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:32.139697 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c17546-938f-4557-990c-47e0f1bf96fc admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:32.144643 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241615f2-665f-41ef-adf0-70d2963dba0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:32.145295 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241615f2-665f-41ef-adf0-70d2963dba0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:32.145570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241615f2-665f-41ef-adf0-70d2963dba0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:32.145838 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241615f2-665f-41ef-adf0-70d2963dba0b admin admin] PATH_INFO: `/v3/projects/a76ecb35629d47e9a7e4d87019ceed12/users/1d6f30e5adac43d68ded350039aa31e2/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:32.161895 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241615f2-665f-41ef-adf0-70d2963dba0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76ecb35629d47e9a7e4d87019ceed12, user_id=1d6f30e5adac43d68ded350039aa31e2, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:32.164627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241615f2-665f-41ef-adf0-70d2963dba0b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:32.179427 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1402/2805] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:05:32 2022] PUT /identity/v3/projects/a76ecb35629d47e9a7e4d87019ceed12/users/1d6f30e5adac43d68ded350039aa31e2/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:32.183660 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce3e64-12c8-4db4-969f-c3873e3d0b97 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:32.193784 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce3e64-12c8-4db4-969f-c3873e3d0b97 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:32.254997 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5971c-493b-4096-967b-29c1f27d1a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:32.255641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5971c-493b-4096-967b-29c1f27d1a1b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:32.255919 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5971c-493b-4096-967b-29c1f27d1a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:32.256184 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5971c-493b-4096-967b-29c1f27d1a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:32.256920 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5971c-493b-4096-967b-29c1f27d1a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:32.258518 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5971c-493b-4096-967b-29c1f27d1a1b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:32.268827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1404/2806] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 12:05:32.274539 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241615f2-665f-41ef-adf0-70d2963dba0b admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:32.285361 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241615f2-665f-41ef-adf0-70d2963dba0b admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:32.291398 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f1422-9419-470a-a22f-54f561b5f0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:32.292081 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f1422-9419-470a-a22f-54f561b5f0c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:32.292362 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f1422-9419-470a-a22f-54f561b5f0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:32.292630 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f1422-9419-470a-a22f-54f561b5f0c9 admin admin] PATH_INFO: `/v3/projects/a76ecb35629d47e9a7e4d87019ceed12/users/1d6f30e5adac43d68ded350039aa31e2/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:32.294659 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f1422-9419-470a-a22f-54f561b5f0c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76ecb35629d47e9a7e4d87019ceed12, user_id=1d6f30e5adac43d68ded350039aa31e2, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:32.297343 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f1422-9419-470a-a22f-54f561b5f0c9 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:32.308825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1403/2807] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:05:32 2022] PUT /identity/v3/projects/a76ecb35629d47e9a7e4d87019ceed12/users/1d6f30e5adac43d68ded350039aa31e2/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:05:32.319426 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5e01c-491f-4862-a48f-279c0b10cedf None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:32.319733 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5e01c-491f-4862-a48f-279c0b10cedf None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:32.319983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5e01c-491f-4862-a48f-279c0b10cedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:32.352615 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-dff5e01c-491f-4862-a48f-279c0b10cedf None None] MFA Rules not processed for user `1d6f30e5adac43d68ded350039aa31e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:32.353831 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dff5e01c-491f-4862-a48f-279c0b10cedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:32.397373 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:32.423649 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1405/2808] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:05:32 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:05:32.434883 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f1422-9419-470a-a22f-54f561b5f0c9 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:32.436593 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-228f1422-9419-470a-a22f-54f561b5f0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:32.460102 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:32.497001 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f1422-9419-470a-a22f-54f561b5f0c9 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:32.501675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f66e12-d584-4c25-8b42-39972ab5a1df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:32.502290 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f66e12-d584-4c25-8b42-39972ab5a1df service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:32.502565 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f66e12-d584-4c25-8b42-39972ab5a1df service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:32.502837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f66e12-d584-4c25-8b42-39972ab5a1df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:32.513093 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f66e12-d584-4c25-8b42-39972ab5a1df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:32.514592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f66e12-d584-4c25-8b42-39972ab5a1df service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:32.524832 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1404/2809] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:05:32 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:05:33.117991 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5e01c-491f-4862-a48f-279c0b10cedf None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:33.188252 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5e01c-491f-4862-a48f-279c0b10cedf None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:33.193599 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496645e9-c743-4f41-bda8-38623f77c0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:33.194270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496645e9-c743-4f41-bda8-38623f77c0c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:33.194537 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496645e9-c743-4f41-bda8-38623f77c0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:33.195007 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496645e9-c743-4f41-bda8-38623f77c0c6 admin admin] PATH_INFO: `/v3/users/67aa84451a4549a9962190d3617df157` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:33.196417 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496645e9-c743-4f41-bda8-38623f77c0c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67aa84451a4549a9962190d3617df157)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:33.198390 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496645e9-c743-4f41-bda8-38623f77c0c6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:33.251897 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-496645e9-c743-4f41-bda8-38623f77c0c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67aa84451a4549a9962190d3617df157'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:33.261172 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-496645e9-c743-4f41-bda8-38623f77c0c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67aa84451a4549a9962190d3617df157'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:33.271399 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-496645e9-c743-4f41-bda8-38623f77c0c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67aa84451a4549a9962190d3617df157'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:33.284230 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-496645e9-c743-4f41-bda8-38623f77c0c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67aa84451a4549a9962190d3617df157'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:33.284899 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-496645e9-c743-4f41-bda8-38623f77c0c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67aa84451a4549a9962190d3617df157'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:33.291709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1406/2810] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:05:33 2022] DELETE /identity/v3/users/67aa84451a4549a9962190d3617df157 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:05:33.296453 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573af12-c7b5-47db-9ef6-3b11513d7e88 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:33.297002 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573af12-c7b5-47db-9ef6-3b11513d7e88 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:33.297002 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573af12-c7b5-47db-9ef6-3b11513d7e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:33.317365 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-5573af12-c7b5-47db-9ef6-3b11513d7e88 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:33.320348 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5573af12-c7b5-47db-9ef6-3b11513d7e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:33.382825 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1405/2811] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:05:33.392741 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496645e9-c743-4f41-bda8-38623f77c0c6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:33.394166 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-496645e9-c743-4f41-bda8-38623f77c0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:33.456130 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496645e9-c743-4f41-bda8-38623f77c0c6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:33.459781 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccfe15-5e82-41f6-ae7d-b1871b3c2452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:33.460430 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccfe15-5e82-41f6-ae7d-b1871b3c2452 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:33.460691 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccfe15-5e82-41f6-ae7d-b1871b3c2452 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:33.461018 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccfe15-5e82-41f6-ae7d-b1871b3c2452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:33.470296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ccfe15-5e82-41f6-ae7d-b1871b3c2452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:33.471761 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ccfe15-5e82-41f6-ae7d-b1871b3c2452 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:33.481861 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1407/2812] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:05:33.752192 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573af12-c7b5-47db-9ef6-3b11513d7e88 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:33.753765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5573af12-c7b5-47db-9ef6-3b11513d7e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:33.767986 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573af12-c7b5-47db-9ef6-3b11513d7e88 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:33.774519 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f419ddf-a2ee-4b57-b697-6c0f6aca00dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:33.775168 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f419ddf-a2ee-4b57-b697-6c0f6aca00dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:33.775471 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f419ddf-a2ee-4b57-b697-6c0f6aca00dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:33.775739 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f419ddf-a2ee-4b57-b697-6c0f6aca00dc admin admin] PATH_INFO: `/v3/projects/dfb639ba1e654341a2a9e70f5b3cf112` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:33.776957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f419ddf-a2ee-4b57-b697-6c0f6aca00dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfb639ba1e654341a2a9e70f5b3cf112)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:33.778953 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f419ddf-a2ee-4b57-b697-6c0f6aca00dc admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:33.827706 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1f419ddf-a2ee-4b57-b697-6c0f6aca00dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfb639ba1e654341a2a9e70f5b3cf112', 'request_id': 'req-1f419ddf-a2ee-4b57-b697-6c0f6aca00dc'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:33.834697 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1f419ddf-a2ee-4b57-b697-6c0f6aca00dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfb639ba1e654341a2a9e70f5b3cf112', 'request_id': 'req-1f419ddf-a2ee-4b57-b697-6c0f6aca00dc'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:33.841640 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1f419ddf-a2ee-4b57-b697-6c0f6aca00dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfb639ba1e654341a2a9e70f5b3cf112', 'request_id': 'req-1f419ddf-a2ee-4b57-b697-6c0f6aca00dc'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:33.856017 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1f419ddf-a2ee-4b57-b697-6c0f6aca00dc admin admin] The token cache is being invalidate because project dfb639ba1e654341a2a9e70f5b3cf112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:05:33.856298 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1f419ddf-a2ee-4b57-b697-6c0f6aca00dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:33.856900 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1f419ddf-a2ee-4b57-b697-6c0f6aca00dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:33.858365 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1406/2813] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:05:33 2022] DELETE /identity/v3/projects/dfb639ba1e654341a2a9e70f5b3cf112 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:05:33.862619 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccfe15-5e82-41f6-ae7d-b1871b3c2452 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:33.869026 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:33.873000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccfe15-5e82-41f6-ae7d-b1871b3c2452 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:33.933662 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e75a8-52a3-4e06-b83e-9a98757abf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:33.934272 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e75a8-52a3-4e06-b83e-9a98757abf75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:33.934542 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e75a8-52a3-4e06-b83e-9a98757abf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:33.934828 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e75a8-52a3-4e06-b83e-9a98757abf75 admin admin] PATH_INFO: `/v3/users/1d6f30e5adac43d68ded350039aa31e2` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:33.935977 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e75a8-52a3-4e06-b83e-9a98757abf75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d6f30e5adac43d68ded350039aa31e2)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:33.937900 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e75a8-52a3-4e06-b83e-9a98757abf75 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:33.996304 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-897e75a8-52a3-4e06-b83e-9a98757abf75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d6f30e5adac43d68ded350039aa31e2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:34.003654 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-897e75a8-52a3-4e06-b83e-9a98757abf75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d6f30e5adac43d68ded350039aa31e2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:34.012316 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-897e75a8-52a3-4e06-b83e-9a98757abf75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d6f30e5adac43d68ded350039aa31e2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:34.025788 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-897e75a8-52a3-4e06-b83e-9a98757abf75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d6f30e5adac43d68ded350039aa31e2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:34.026469 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-897e75a8-52a3-4e06-b83e-9a98757abf75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d6f30e5adac43d68ded350039aa31e2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:34.032708 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1408/2814] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:05:33 2022] DELETE /identity/v3/users/1d6f30e5adac43d68ded350039aa31e2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:34.317922 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f419ddf-a2ee-4b57-b697-6c0f6aca00dc admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:34.319438 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1f419ddf-a2ee-4b57-b697-6c0f6aca00dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:34.332918 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f419ddf-a2ee-4b57-b697-6c0f6aca00dc admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:34.379572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:34.394641 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fb785-8909-44b8-9b7a-1f80b4120351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:34.395273 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fb785-8909-44b8-9b7a-1f80b4120351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:34.395580 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fb785-8909-44b8-9b7a-1f80b4120351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:34.395850 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fb785-8909-44b8-9b7a-1f80b4120351 admin admin] PATH_INFO: `/v3/projects/a76ecb35629d47e9a7e4d87019ceed12` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:34.396992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fb785-8909-44b8-9b7a-1f80b4120351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a76ecb35629d47e9a7e4d87019ceed12)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:34.399008 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fb785-8909-44b8-9b7a-1f80b4120351 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:34.446302 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-981fb785-8909-44b8-9b7a-1f80b4120351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a76ecb35629d47e9a7e4d87019ceed12', 'request_id': 'req-981fb785-8909-44b8-9b7a-1f80b4120351'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:34.452313 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-981fb785-8909-44b8-9b7a-1f80b4120351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a76ecb35629d47e9a7e4d87019ceed12', 'request_id': 'req-981fb785-8909-44b8-9b7a-1f80b4120351'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:34.458119 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-981fb785-8909-44b8-9b7a-1f80b4120351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a76ecb35629d47e9a7e4d87019ceed12', 'request_id': 'req-981fb785-8909-44b8-9b7a-1f80b4120351'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:34.471078 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-981fb785-8909-44b8-9b7a-1f80b4120351 admin admin] The token cache is being invalidate because project a76ecb35629d47e9a7e4d87019ceed12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:05:34.471374 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-981fb785-8909-44b8-9b7a-1f80b4120351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:34.472070 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-981fb785-8909-44b8-9b7a-1f80b4120351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:34.473630 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1407/2815] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:05:34 2022] DELETE /identity/v3/projects/a76ecb35629d47e9a7e4d87019ceed12 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:34.478677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02331b-f189-4ec8-9e9b-f8c8ffa8ea3c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:34.479216 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02331b-f189-4ec8-9e9b-f8c8ffa8ea3c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:34.479322 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02331b-f189-4ec8-9e9b-f8c8ffa8ea3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:34.499434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3f02331b-f189-4ec8-9e9b-f8c8ffa8ea3c None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:34.500245 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3f02331b-f189-4ec8-9e9b-f8c8ffa8ea3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:34.562589 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1409/2816] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:05:34.572116 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f649ef-f40e-45d5-8378-7f3d71a81bf1 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:34.572422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f649ef-f40e-45d5-8378-7f3d71a81bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:34.572705 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f649ef-f40e-45d5-8378-7f3d71a81bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:34.592595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-95f649ef-f40e-45d5-8378-7f3d71a81bf1 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:34.593844 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-95f649ef-f40e-45d5-8378-7f3d71a81bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:34.602912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1408/2817] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:05:34.607267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02331b-f189-4ec8-9e9b-f8c8ffa8ea3c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:34.619167 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02331b-f189-4ec8-9e9b-f8c8ffa8ea3c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:34.624478 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bc7af-71f9-4060-a42e-ed56a67db32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:34.625100 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bc7af-71f9-4060-a42e-ed56a67db32a admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:34.625377 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bc7af-71f9-4060-a42e-ed56a67db32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:34.625648 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bc7af-71f9-4060-a42e-ed56a67db32a admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:34.626295 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944bc7af-71f9-4060-a42e-ed56a67db32a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 12:05:34.626597 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944bc7af-71f9-4060-a42e-ed56a67db32a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:34.628248 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944bc7af-71f9-4060-a42e-ed56a67db32a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:34.641711 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1410/2818] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 12:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 12:05:34.646791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f649ef-f40e-45d5-8378-7f3d71a81bf1 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:34.656768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f649ef-f40e-45d5-8378-7f3d71a81bf1 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:34.662123 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139970b9-7daf-4687-8e3d-95469fa11362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:34.662814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139970b9-7daf-4687-8e3d-95469fa11362 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:34.663160 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139970b9-7daf-4687-8e3d-95469fa11362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:34.663572 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139970b9-7daf-4687-8e3d-95469fa11362 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:34.664360 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139970b9-7daf-4687-8e3d-95469fa11362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:34.666353 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139970b9-7daf-4687-8e3d-95469fa11362 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:34.705991 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1409/2819] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:05:34 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:05:34.710485 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bc7af-71f9-4060-a42e-ed56a67db32a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:34.723000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bc7af-71f9-4060-a42e-ed56a67db32a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:34.732002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:34.787713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c09abc-edae-452c-9ed3-44b48e691b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:34.788415 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c09abc-edae-452c-9ed3-44b48e691b40 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:34.788815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c09abc-edae-452c-9ed3-44b48e691b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:34.789045 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c09abc-edae-452c-9ed3-44b48e691b40 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:34.789685 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c09abc-edae-452c-9ed3-44b48e691b40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:34.791724 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c09abc-edae-452c-9ed3-44b48e691b40 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:34.815200 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1411/2820] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:05:34 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:05:34.819874 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139970b9-7daf-4687-8e3d-95469fa11362 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:34.830406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139970b9-7daf-4687-8e3d-95469fa11362 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:34.835317 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcc3b8-3a0e-4bb1-823f-7c179fdaf63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:34.836075 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcc3b8-3a0e-4bb1-823f-7c179fdaf63b admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:34.836357 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcc3b8-3a0e-4bb1-823f-7c179fdaf63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:34.836626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcc3b8-3a0e-4bb1-823f-7c179fdaf63b admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:34.837263 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcc3b8-3a0e-4bb1-823f-7c179fdaf63b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:34.838914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcc3b8-3a0e-4bb1-823f-7c179fdaf63b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:34.849911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1410/2821] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:05:34.854059 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c09abc-edae-452c-9ed3-44b48e691b40 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:34.864558 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c09abc-edae-452c-9ed3-44b48e691b40 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:34.869869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d1ae1-26fa-4dae-acf3-8a6b218a188e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:34.870552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d1ae1-26fa-4dae-acf3-8a6b218a188e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:34.870889 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d1ae1-26fa-4dae-acf3-8a6b218a188e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:34.871225 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d1ae1-26fa-4dae-acf3-8a6b218a188e admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:34.871965 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d1ae1-26fa-4dae-acf3-8a6b218a188e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:34.873614 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d1ae1-26fa-4dae-acf3-8a6b218a188e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:34.885010 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1412/2822] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:05:34.889430 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcc3b8-3a0e-4bb1-823f-7c179fdaf63b admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:34.899712 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcc3b8-3a0e-4bb1-823f-7c179fdaf63b admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:34.904131 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e2414-15c4-4cd0-8dd8-2063246720a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:34.904784 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e2414-15c4-4cd0-8dd8-2063246720a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:34.905062 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e2414-15c4-4cd0-8dd8-2063246720a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:34.905333 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e2414-15c4-4cd0-8dd8-2063246720a7 admin admin] PATH_INFO: `/v3/projects/3628106db36c460686bc10d26ffff8a3/users/4148f8972cf64462a5753ce684107923/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:34.921358 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e2414-15c4-4cd0-8dd8-2063246720a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3628106db36c460686bc10d26ffff8a3, user_id=4148f8972cf64462a5753ce684107923, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:34.924036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e2414-15c4-4cd0-8dd8-2063246720a7 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:34.937940 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1411/2823] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:05:34 2022] PUT /identity/v3/projects/3628106db36c460686bc10d26ffff8a3/users/4148f8972cf64462a5753ce684107923/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:34.948527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705de7e-8be6-481f-8638-9137dc320286 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:34.948832 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705de7e-8be6-481f-8638-9137dc320286 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:34.949074 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705de7e-8be6-481f-8638-9137dc320286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:34.976763 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5705de7e-8be6-481f-8638-9137dc320286 None None] MFA Rules not processed for user `4148f8972cf64462a5753ce684107923`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:34.978002 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5705de7e-8be6-481f-8638-9137dc320286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:35.048400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1413/2824] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:05:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:05:35.053487 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e2414-15c4-4cd0-8dd8-2063246720a7 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:35.120671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e2414-15c4-4cd0-8dd8-2063246720a7 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:35.125617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40057755-6ec5-42b3-9efe-99e7ab9e42ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:35.126230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40057755-6ec5-42b3-9efe-99e7ab9e42ca admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:35.126505 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40057755-6ec5-42b3-9efe-99e7ab9e42ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:35.126774 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40057755-6ec5-42b3-9efe-99e7ab9e42ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:35.127433 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40057755-6ec5-42b3-9efe-99e7ab9e42ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:35.129378 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40057755-6ec5-42b3-9efe-99e7ab9e42ca admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:35.150816 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:35.158334 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1412/2825] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:05:35 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:05:35.162792 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705de7e-8be6-481f-8638-9137dc320286 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:35.174234 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705de7e-8be6-481f-8638-9137dc320286 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:35.238411 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd67b27-f6d2-40b0-a13b-c92530e72bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:35.239206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd67b27-f6d2-40b0-a13b-c92530e72bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:35.239535 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd67b27-f6d2-40b0-a13b-c92530e72bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:35.239799 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd67b27-f6d2-40b0-a13b-c92530e72bf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:35.240510 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd67b27-f6d2-40b0-a13b-c92530e72bf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:35.242606 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd67b27-f6d2-40b0-a13b-c92530e72bf8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:35.266311 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1414/2826] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:05:35 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 12:05:35.270311 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40057755-6ec5-42b3-9efe-99e7ab9e42ca admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:35.280946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40057755-6ec5-42b3-9efe-99e7ab9e42ca admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:35.285514 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1e034-9ca7-4489-93ff-bd6b6734dfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:35.286491 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1e034-9ca7-4489-93ff-bd6b6734dfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:35.286757 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1e034-9ca7-4489-93ff-bd6b6734dfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:35.287028 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1e034-9ca7-4489-93ff-bd6b6734dfa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:35.287711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1e034-9ca7-4489-93ff-bd6b6734dfa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:35.289556 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1e034-9ca7-4489-93ff-bd6b6734dfa2 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:35.300309 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1413/2827] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:05:35.304981 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd67b27-f6d2-40b0-a13b-c92530e72bf8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:35.315267 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd67b27-f6d2-40b0-a13b-c92530e72bf8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:35.320475 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32824146-1094-4276-8102-449a63f891d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:35.321190 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32824146-1094-4276-8102-449a63f891d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:35.321472 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32824146-1094-4276-8102-449a63f891d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:35.321751 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32824146-1094-4276-8102-449a63f891d9 admin admin] PATH_INFO: `/v3/projects/f7ad3588b2cb4f55a3ab5abc2d661efc/users/9a72dd16676747718c6970b4cc8b4675/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:35.326381 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:35.341140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32824146-1094-4276-8102-449a63f891d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ad3588b2cb4f55a3ab5abc2d661efc, user_id=9a72dd16676747718c6970b4cc8b4675, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:35.343931 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32824146-1094-4276-8102-449a63f891d9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:35.360732 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1415/2828] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:05:35 2022] PUT /identity/v3/projects/f7ad3588b2cb4f55a3ab5abc2d661efc/users/9a72dd16676747718c6970b4cc8b4675/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:35.364939 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1e034-9ca7-4489-93ff-bd6b6734dfa2 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:35.376099 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1e034-9ca7-4489-93ff-bd6b6734dfa2 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:35.437860 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae184ad6-7764-4711-9e7b-e0b2cdc3ee70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:35.438388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae184ad6-7764-4711-9e7b-e0b2cdc3ee70 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:35.438670 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae184ad6-7764-4711-9e7b-e0b2cdc3ee70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:35.438919 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae184ad6-7764-4711-9e7b-e0b2cdc3ee70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:35.439586 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae184ad6-7764-4711-9e7b-e0b2cdc3ee70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:35.441226 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae184ad6-7764-4711-9e7b-e0b2cdc3ee70 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:35.452262 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1414/2829] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 12:05:35.456735 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32824146-1094-4276-8102-449a63f891d9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:35.468555 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32824146-1094-4276-8102-449a63f891d9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:35.473519 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b30067-beb7-435d-b8db-786414b50931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:35.474200 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b30067-beb7-435d-b8db-786414b50931 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:35.474476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b30067-beb7-435d-b8db-786414b50931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:35.474747 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b30067-beb7-435d-b8db-786414b50931 admin admin] PATH_INFO: `/v3/projects/f7ad3588b2cb4f55a3ab5abc2d661efc/users/9a72dd16676747718c6970b4cc8b4675/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:35.476857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b30067-beb7-435d-b8db-786414b50931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ad3588b2cb4f55a3ab5abc2d661efc, user_id=9a72dd16676747718c6970b4cc8b4675, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:35.479582 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b30067-beb7-435d-b8db-786414b50931 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:35.490945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1416/2830] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:05:35 2022] PUT /identity/v3/projects/f7ad3588b2cb4f55a3ab5abc2d661efc/users/9a72dd16676747718c6970b4cc8b4675/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:35.502655 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa54a5-7421-453f-81e7-3087b3f8c8c2 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:35.502874 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa54a5-7421-453f-81e7-3087b3f8c8c2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:35.503124 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa54a5-7421-453f-81e7-3087b3f8c8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:35.533404 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-3bfa54a5-7421-453f-81e7-3087b3f8c8c2 None None] MFA Rules not processed for user `9a72dd16676747718c6970b4cc8b4675`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:35.534642 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3bfa54a5-7421-453f-81e7-3087b3f8c8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:35.610027 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1415/2831] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:05:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:05:35.624155 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b30067-beb7-435d-b8db-786414b50931 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:35.626152 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-67b30067-beb7-435d-b8db-786414b50931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:35.697272 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b30067-beb7-435d-b8db-786414b50931 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:35.700999 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d921e-51ee-40e7-b5ec-db31746ebb57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:35.701621 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d921e-51ee-40e7-b5ec-db31746ebb57 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:35.701893 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d921e-51ee-40e7-b5ec-db31746ebb57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:35.702157 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d921e-51ee-40e7-b5ec-db31746ebb57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:35.784866 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d921e-51ee-40e7-b5ec-db31746ebb57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:35.786759 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d921e-51ee-40e7-b5ec-db31746ebb57 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:35.797365 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1417/2832] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:05:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:05:40.163067 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa54a5-7421-453f-81e7-3087b3f8c8c2 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:40.173266 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa54a5-7421-453f-81e7-3087b3f8c8c2 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:40.179672 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cf7b1-8e51-4a42-bdb4-6bdb22ca3213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:40.180571 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cf7b1-8e51-4a42-bdb4-6bdb22ca3213 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:40.180912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cf7b1-8e51-4a42-bdb4-6bdb22ca3213 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:40.181278 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cf7b1-8e51-4a42-bdb4-6bdb22ca3213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:40.191114 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cf7b1-8e51-4a42-bdb4-6bdb22ca3213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:40.192591 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cf7b1-8e51-4a42-bdb4-6bdb22ca3213 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:40.201931 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1416/2833] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:05:40 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:05:44.729975 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29545fc5-0aad-48d4-8cfa-5e57b1d6a8c9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:44.730489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29545fc5-0aad-48d4-8cfa-5e57b1d6a8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:44.730489 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29545fc5-0aad-48d4-8cfa-5e57b1d6a8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:44.759318 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-29545fc5-0aad-48d4-8cfa-5e57b1d6a8c9 None None] MFA Rules not processed for user `b7c2b1ed867340eaa82e319f528452b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:44.760530 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-29545fc5-0aad-48d4-8cfa-5e57b1d6a8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:44.841933 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1418/2834] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:05:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 12:05:45.224553 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cf7b1-8e51-4a42-bdb4-6bdb22ca3213 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:45.287301 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=100 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:45.338356 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cf7b1-8e51-4a42-bdb4-6bdb22ca3213 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:45.343225 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505bcd2-2987-4118-95a4-87c96cd9cb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:45.343901 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505bcd2-2987-4118-95a4-87c96cd9cb7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:45.344179 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505bcd2-2987-4118-95a4-87c96cd9cb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:45.344555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505bcd2-2987-4118-95a4-87c96cd9cb7a admin admin] PATH_INFO: `/v3/users/4148f8972cf64462a5753ce684107923` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:45.345589 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505bcd2-2987-4118-95a4-87c96cd9cb7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4148f8972cf64462a5753ce684107923)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:45.347676 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505bcd2-2987-4118-95a4-87c96cd9cb7a admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:45.395119 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1505bcd2-2987-4118-95a4-87c96cd9cb7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4148f8972cf64462a5753ce684107923'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:45.402838 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1505bcd2-2987-4118-95a4-87c96cd9cb7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4148f8972cf64462a5753ce684107923'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:45.412504 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1505bcd2-2987-4118-95a4-87c96cd9cb7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4148f8972cf64462a5753ce684107923'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:45.413500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1505bcd2-2987-4118-95a4-87c96cd9cb7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4148f8972cf64462a5753ce684107923'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:45.426159 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-1505bcd2-2987-4118-95a4-87c96cd9cb7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4148f8972cf64462a5753ce684107923'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:45.434008 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1417/2835] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:05:45 2022] DELETE /identity/v3/users/4148f8972cf64462a5753ce684107923 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:45.438765 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f6c7d-3ad7-49b4-8805-31787efd6efd None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:45.439195 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f6c7d-3ad7-49b4-8805-31787efd6efd None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:45.439589 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f6c7d-3ad7-49b4-8805-31787efd6efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:45.446406 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:45.501274 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1d5f6c7d-3ad7-49b4-8805-31787efd6efd None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:05:45.502748 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1d5f6c7d-3ad7-49b4-8805-31787efd6efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:45.571644 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1419/2836] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:05:45.582004 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505bcd2-2987-4118-95a4-87c96cd9cb7a admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:45.583711 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1505bcd2-2987-4118-95a4-87c96cd9cb7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:45.665632 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505bcd2-2987-4118-95a4-87c96cd9cb7a admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:45.669656 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51169f28-e005-47f4-8234-baf765ed4e69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:45.670342 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51169f28-e005-47f4-8234-baf765ed4e69 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:45.670622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51169f28-e005-47f4-8234-baf765ed4e69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:45.670895 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51169f28-e005-47f4-8234-baf765ed4e69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:45.680468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51169f28-e005-47f4-8234-baf765ed4e69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:45.682021 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51169f28-e005-47f4-8234-baf765ed4e69 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:45.692812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1418/2837] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:05:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:05:46.011970 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f6c7d-3ad7-49b4-8805-31787efd6efd None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:46.013641 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1d5f6c7d-3ad7-49b4-8805-31787efd6efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:46.029120 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f6c7d-3ad7-49b4-8805-31787efd6efd None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:46.038041 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b4b3b-daf0-4089-a04b-bee0cea3dfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:46.039039 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b4b3b-daf0-4089-a04b-bee0cea3dfe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:46.039620 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b4b3b-daf0-4089-a04b-bee0cea3dfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:46.040381 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b4b3b-daf0-4089-a04b-bee0cea3dfe2 admin admin] PATH_INFO: `/v3/projects/3628106db36c460686bc10d26ffff8a3` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:46.043193 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b4b3b-daf0-4089-a04b-bee0cea3dfe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3628106db36c460686bc10d26ffff8a3)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:46.045325 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b4b3b-daf0-4089-a04b-bee0cea3dfe2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:46.099091 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-163b4b3b-daf0-4089-a04b-bee0cea3dfe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3628106db36c460686bc10d26ffff8a3', 'request_id': 'req-163b4b3b-daf0-4089-a04b-bee0cea3dfe2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:46.113723 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-163b4b3b-daf0-4089-a04b-bee0cea3dfe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3628106db36c460686bc10d26ffff8a3', 'request_id': 'req-163b4b3b-daf0-4089-a04b-bee0cea3dfe2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:46.120426 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-163b4b3b-daf0-4089-a04b-bee0cea3dfe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3628106db36c460686bc10d26ffff8a3', 'request_id': 'req-163b4b3b-daf0-4089-a04b-bee0cea3dfe2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:46.132089 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-163b4b3b-daf0-4089-a04b-bee0cea3dfe2 admin admin] The token cache is being invalidate because project 3628106db36c460686bc10d26ffff8a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:05:46.132371 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-163b4b3b-daf0-4089-a04b-bee0cea3dfe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:46.133008 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-163b4b3b-daf0-4089-a04b-bee0cea3dfe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:46.134667 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1420/2838] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:05:46 2022] DELETE /identity/v3/projects/3628106db36c460686bc10d26ffff8a3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:05:46.138577 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51169f28-e005-47f4-8234-baf765ed4e69 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:46.148266 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51169f28-e005-47f4-8234-baf765ed4e69 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:46.165546 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:46.205489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4192bfd-9ad2-4ce5-8cdc-2779ac1e8fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:46.206049 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4192bfd-9ad2-4ce5-8cdc-2779ac1e8fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:46.206331 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4192bfd-9ad2-4ce5-8cdc-2779ac1e8fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:46.206596 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4192bfd-9ad2-4ce5-8cdc-2779ac1e8fc9 admin admin] PATH_INFO: `/v3/users/9a72dd16676747718c6970b4cc8b4675` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:46.207768 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4192bfd-9ad2-4ce5-8cdc-2779ac1e8fc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a72dd16676747718c6970b4cc8b4675)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:46.209691 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4192bfd-9ad2-4ce5-8cdc-2779ac1e8fc9 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:46.266614 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f4192bfd-9ad2-4ce5-8cdc-2779ac1e8fc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a72dd16676747718c6970b4cc8b4675'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:46.274533 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f4192bfd-9ad2-4ce5-8cdc-2779ac1e8fc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a72dd16676747718c6970b4cc8b4675'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:46.285594 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f4192bfd-9ad2-4ce5-8cdc-2779ac1e8fc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a72dd16676747718c6970b4cc8b4675'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:46.286191 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f4192bfd-9ad2-4ce5-8cdc-2779ac1e8fc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a72dd16676747718c6970b4cc8b4675'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:46.300418 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-f4192bfd-9ad2-4ce5-8cdc-2779ac1e8fc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a72dd16676747718c6970b4cc8b4675'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:46.306438 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1419/2839] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:05:46 2022] DELETE /identity/v3/users/9a72dd16676747718c6970b4cc8b4675 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:46.706159 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b4b3b-daf0-4089-a04b-bee0cea3dfe2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:05:46.708135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-163b4b3b-daf0-4089-a04b-bee0cea3dfe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:05:46.723587 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b4b3b-daf0-4089-a04b-bee0cea3dfe2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:05:46.807515 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39838aa4-00df-4ae6-bad2-2e3922c12afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:05:46.808212 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39838aa4-00df-4ae6-bad2-2e3922c12afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:05:46.808527 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39838aa4-00df-4ae6-bad2-2e3922c12afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:05:46.808769 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39838aa4-00df-4ae6-bad2-2e3922c12afc admin admin] PATH_INFO: `/v3/projects/f7ad3588b2cb4f55a3ab5abc2d661efc` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:05:46.809939 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39838aa4-00df-4ae6-bad2-2e3922c12afc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7ad3588b2cb4f55a3ab5abc2d661efc)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:05:46.811963 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39838aa4-00df-4ae6-bad2-2e3922c12afc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:05:46.824672 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:46.870229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-39838aa4-00df-4ae6-bad2-2e3922c12afc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7ad3588b2cb4f55a3ab5abc2d661efc', 'request_id': 'req-39838aa4-00df-4ae6-bad2-2e3922c12afc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:46.878450 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-39838aa4-00df-4ae6-bad2-2e3922c12afc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7ad3588b2cb4f55a3ab5abc2d661efc', 'request_id': 'req-39838aa4-00df-4ae6-bad2-2e3922c12afc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:46.886698 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-39838aa4-00df-4ae6-bad2-2e3922c12afc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7ad3588b2cb4f55a3ab5abc2d661efc', 'request_id': 'req-39838aa4-00df-4ae6-bad2-2e3922c12afc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:46.900964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-39838aa4-00df-4ae6-bad2-2e3922c12afc admin admin] The token cache is being invalidate because project f7ad3588b2cb4f55a3ab5abc2d661efc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:05:46.901387 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-39838aa4-00df-4ae6-bad2-2e3922c12afc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:46.902137 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-39838aa4-00df-4ae6-bad2-2e3922c12afc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:05:46.913470 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1421/2840] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:05:46 2022] DELETE /identity/v3/projects/f7ad3588b2cb4f55a3ab5abc2d661efc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:05:56.303132 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=44,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:56.896690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:06:35.185308 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4192bfd-9ad2-4ce5-8cdc-2779ac1e8fc9 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:06:35.187543 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f4192bfd-9ad2-4ce5-8cdc-2779ac1e8fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:06:35.309832 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4192bfd-9ad2-4ce5-8cdc-2779ac1e8fc9 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:06:35.371070 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf8b6f-c23e-4001-97af-45fa448315a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9efd2ac7fc4a42558e8dc48c408ce525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:06:35.371616 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf8b6f-c23e-4001-97af-45fa448315a3 service placement] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:06:35.371914 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf8b6f-c23e-4001-97af-45fa448315a3 service placement] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:06:35.372186 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf8b6f-c23e-4001-97af-45fa448315a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:06:35.373894 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e2bf8b6f-c23e-4001-97af-45fa448315a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:06:35.385296 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf8b6f-c23e-4001-97af-45fa448315a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:06:35.386957 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf8b6f-c23e-4001-97af-45fa448315a3 service placement] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:06:35.397427 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1420/2841] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:06:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:06:38.219051 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b5858-f7a1-44f2-8d8f-b6643af56ace None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:06:38.219605 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b5858-f7a1-44f2-8d8f-b6643af56ace None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:06:38.219734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b5858-f7a1-44f2-8d8f-b6643af56ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:06:38.239658 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b59b5858-f7a1-44f2-8d8f-b6643af56ace None None] MFA Rules not processed for user `b7c2b1ed867340eaa82e319f528452b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:06:38.240854 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b59b5858-f7a1-44f2-8d8f-b6643af56ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:06:38.299927 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1422/2842] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:06:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:06:45.393071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=67 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:06:48.292890 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=25 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:38.015512 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf8b6f-c23e-4001-97af-45fa448315a3 service placement] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:38.017856 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e2bf8b6f-c23e-4001-97af-45fa448315a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:38.093515 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf8b6f-c23e-4001-97af-45fa448315a3 service placement] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:38.097953 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c668b72-0501-4ab3-90eb-0175233e7314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:38.098585 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c668b72-0501-4ab3-90eb-0175233e7314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:38.098859 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c668b72-0501-4ab3-90eb-0175233e7314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:38.099128 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c668b72-0501-4ab3-90eb-0175233e7314 admin admin] PATH_INFO: `/v3/users/b7c2b1ed867340eaa82e319f528452b3` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:38.100268 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c668b72-0501-4ab3-90eb-0175233e7314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7c2b1ed867340eaa82e319f528452b3)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:38.102204 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c668b72-0501-4ab3-90eb-0175233e7314 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:38.157153 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8c668b72-0501-4ab3-90eb-0175233e7314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7c2b1ed867340eaa82e319f528452b3'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:38.164204 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8c668b72-0501-4ab3-90eb-0175233e7314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7c2b1ed867340eaa82e319f528452b3'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:38.172507 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8c668b72-0501-4ab3-90eb-0175233e7314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7c2b1ed867340eaa82e319f528452b3'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:38.173196 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8c668b72-0501-4ab3-90eb-0175233e7314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7c2b1ed867340eaa82e319f528452b3'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:38.185538 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-8c668b72-0501-4ab3-90eb-0175233e7314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7c2b1ed867340eaa82e319f528452b3'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:38.191788 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1421/2843] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:07:38 2022] DELETE /identity/v3/users/b7c2b1ed867340eaa82e319f528452b3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:07:38.399798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b5858-f7a1-44f2-8d8f-b6643af56ace None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:38.422807 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b5858-f7a1-44f2-8d8f-b6643af56ace None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:38.489329 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67d537-cfc7-4a86-b410-94ce7745df8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:38.489329 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67d537-cfc7-4a86-b410-94ce7745df8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:38.489329 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67d537-cfc7-4a86-b410-94ce7745df8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:38.489329 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67d537-cfc7-4a86-b410-94ce7745df8c admin admin] PATH_INFO: `/v3/projects/d3babbf0ce454415b96b5ada93fc9ddb` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:38.490332 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67d537-cfc7-4a86-b410-94ce7745df8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3babbf0ce454415b96b5ada93fc9ddb)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:38.492276 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67d537-cfc7-4a86-b410-94ce7745df8c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:38.547332 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6d67d537-cfc7-4a86-b410-94ce7745df8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3babbf0ce454415b96b5ada93fc9ddb', 'request_id': 'req-6d67d537-cfc7-4a86-b410-94ce7745df8c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:38.558827 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6d67d537-cfc7-4a86-b410-94ce7745df8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3babbf0ce454415b96b5ada93fc9ddb', 'request_id': 'req-6d67d537-cfc7-4a86-b410-94ce7745df8c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:38.573334 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6d67d537-cfc7-4a86-b410-94ce7745df8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3babbf0ce454415b96b5ada93fc9ddb', 'request_id': 'req-6d67d537-cfc7-4a86-b410-94ce7745df8c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:38.587862 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6d67d537-cfc7-4a86-b410-94ce7745df8c admin admin] The token cache is being invalidate because project d3babbf0ce454415b96b5ada93fc9ddb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:07:38.588187 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6d67d537-cfc7-4a86-b410-94ce7745df8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:38.588961 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6d67d537-cfc7-4a86-b410-94ce7745df8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:38.590604 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1423/2844] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:07:38 2022] DELETE /identity/v3/projects/d3babbf0ce454415b96b5ada93fc9ddb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:07:38.597039 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa190c-a720-4bc7-8100-577e5be58b1d None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:38.597698 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa190c-a720-4bc7-8100-577e5be58b1d None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:38.598148 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa190c-a720-4bc7-8100-577e5be58b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:38.670219 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-2eaa190c-a720-4bc7-8100-577e5be58b1d None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:07:38.671891 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2eaa190c-a720-4bc7-8100-577e5be58b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:38.741637 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:38.760429 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1422/2845] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:07:38.772016 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b3bac-8096-46ec-bafd-511824d6a54c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:38.772332 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b3bac-8096-46ec-bafd-511824d6a54c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:38.772602 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b3bac-8096-46ec-bafd-511824d6a54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:38.797928 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-258b3bac-8096-46ec-bafd-511824d6a54c None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:07:38.799174 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-258b3bac-8096-46ec-bafd-511824d6a54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:38.809235 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1424/2846] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:07:38.814285 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa190c-a720-4bc7-8100-577e5be58b1d None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:38.825389 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa190c-a720-4bc7-8100-577e5be58b1d None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:38.832013 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d0d29-ed73-4be9-9e55-6b8b17f30cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:38.832626 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d0d29-ed73-4be9-9e55-6b8b17f30cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:38.832904 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d0d29-ed73-4be9-9e55-6b8b17f30cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:38.833182 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d0d29-ed73-4be9-9e55-6b8b17f30cd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:38.833834 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d0d29-ed73-4be9-9e55-6b8b17f30cd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 12:07:38.834136 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d0d29-ed73-4be9-9e55-6b8b17f30cd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:38.836442 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d0d29-ed73-4be9-9e55-6b8b17f30cd3 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:38.851518 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1423/2847] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 12:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 12:07:38.857738 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b3bac-8096-46ec-bafd-511824d6a54c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:38.868798 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b3bac-8096-46ec-bafd-511824d6a54c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:38.875395 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ab45d-376f-467d-a587-44304db775f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:38.876014 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ab45d-376f-467d-a587-44304db775f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:38.876293 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ab45d-376f-467d-a587-44304db775f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:38.876556 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ab45d-376f-467d-a587-44304db775f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:38.877187 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ab45d-376f-467d-a587-44304db775f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:38.881446 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ab45d-376f-467d-a587-44304db775f2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:38.929548 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1425/2848] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:07:38 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:07:38.936395 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d0d29-ed73-4be9-9e55-6b8b17f30cd3 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:38.953203 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d0d29-ed73-4be9-9e55-6b8b17f30cd3 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:39.027340 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecc27e-035b-479e-a2b9-4a1865662974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:39.028111 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecc27e-035b-479e-a2b9-4a1865662974 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:39.028223 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecc27e-035b-479e-a2b9-4a1865662974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:39.028551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecc27e-035b-479e-a2b9-4a1865662974 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:39.029206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecc27e-035b-479e-a2b9-4a1865662974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:39.031388 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecc27e-035b-479e-a2b9-4a1865662974 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:39.057336 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1424/2849] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:07:38 2022] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:07:39.061706 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ab45d-376f-467d-a587-44304db775f2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:39.073742 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ab45d-376f-467d-a587-44304db775f2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:39.080432 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65130300-d2ee-48d5-8e63-c21d18d64711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:39.081045 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65130300-d2ee-48d5-8e63-c21d18d64711 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:39.081319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65130300-d2ee-48d5-8e63-c21d18d64711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:39.081586 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65130300-d2ee-48d5-8e63-c21d18d64711 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:39.082221 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65130300-d2ee-48d5-8e63-c21d18d64711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:39.083932 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65130300-d2ee-48d5-8e63-c21d18d64711 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:39.096015 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1426/2850] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 12:07:39.101380 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecc27e-035b-479e-a2b9-4a1865662974 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:39.113728 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecc27e-035b-479e-a2b9-4a1865662974 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:39.118678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36713863-5320-4128-832e-ece077676338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:39.119262 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36713863-5320-4128-832e-ece077676338 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:39.119612 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36713863-5320-4128-832e-ece077676338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:39.119881 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36713863-5320-4128-832e-ece077676338 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:39.120519 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36713863-5320-4128-832e-ece077676338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:39.122136 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36713863-5320-4128-832e-ece077676338 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:39.134214 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1425/2851] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:07:39.141122 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65130300-d2ee-48d5-8e63-c21d18d64711 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:39.152234 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65130300-d2ee-48d5-8e63-c21d18d64711 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:39.158405 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03532c39-f397-40e0-998a-f87b71e2cb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:39.159069 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03532c39-f397-40e0-998a-f87b71e2cb2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:39.159386 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03532c39-f397-40e0-998a-f87b71e2cb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:39.159659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03532c39-f397-40e0-998a-f87b71e2cb2d admin admin] PATH_INFO: `/v3/projects/fe47e0d81ba64abaa88a82e34f5a3e89/users/7ae8d9771036405f815217909d9fe115/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:39.183039 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03532c39-f397-40e0-998a-f87b71e2cb2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe47e0d81ba64abaa88a82e34f5a3e89, user_id=7ae8d9771036405f815217909d9fe115, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:39.185815 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03532c39-f397-40e0-998a-f87b71e2cb2d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:39.203541 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1427/2852] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:07:39 2022] PUT /identity/v3/projects/fe47e0d81ba64abaa88a82e34f5a3e89/users/7ae8d9771036405f815217909d9fe115/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:07:39.214132 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ed24a-e686-4efc-8cd9-33a1eaf964f3 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:39.214422 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ed24a-e686-4efc-8cd9-33a1eaf964f3 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:39.214694 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ed24a-e686-4efc-8cd9-33a1eaf964f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:39.246840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d70ed24a-e686-4efc-8cd9-33a1eaf964f3 None None] MFA Rules not processed for user `7ae8d9771036405f815217909d9fe115`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:07:39.248164 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d70ed24a-e686-4efc-8cd9-33a1eaf964f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:39.322429 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1426/2853] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:07:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:07:39.328065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03532c39-f397-40e0-998a-f87b71e2cb2d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:39.350597 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:39.400299 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03532c39-f397-40e0-998a-f87b71e2cb2d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:39.406233 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967e82f-3ae3-4a1a-81d1-19091b6f1c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:39.406926 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967e82f-3ae3-4a1a-81d1-19091b6f1c08 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:39.407274 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967e82f-3ae3-4a1a-81d1-19091b6f1c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:39.407642 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967e82f-3ae3-4a1a-81d1-19091b6f1c08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:39.408347 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967e82f-3ae3-4a1a-81d1-19091b6f1c08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:39.410346 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967e82f-3ae3-4a1a-81d1-19091b6f1c08 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:39.447577 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1428/2854] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:07:39 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:07:39.451724 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ed24a-e686-4efc-8cd9-33a1eaf964f3 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:39.463734 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ed24a-e686-4efc-8cd9-33a1eaf964f3 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:39.518908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:39.530704 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854cc69-9dd8-405c-b10d-2309f0bdcf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:39.531325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854cc69-9dd8-405c-b10d-2309f0bdcf47 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:39.531635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854cc69-9dd8-405c-b10d-2309f0bdcf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:39.531909 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854cc69-9dd8-405c-b10d-2309f0bdcf47 admin admin] PATH_INFO: `/v3/users` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:39.532611 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854cc69-9dd8-405c-b10d-2309f0bdcf47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:39.534583 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854cc69-9dd8-405c-b10d-2309f0bdcf47 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:39.558948 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1427/2855] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:07:39 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:07:39.564024 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967e82f-3ae3-4a1a-81d1-19091b6f1c08 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:39.575614 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967e82f-3ae3-4a1a-81d1-19091b6f1c08 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:39.581557 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3accc4e-d655-428f-9ef5-f8de9cdba431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:39.582403 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3accc4e-d655-428f-9ef5-f8de9cdba431 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:39.582845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3accc4e-d655-428f-9ef5-f8de9cdba431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:39.583116 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3accc4e-d655-428f-9ef5-f8de9cdba431 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:39.583873 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3accc4e-d655-428f-9ef5-f8de9cdba431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:39.585445 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3accc4e-d655-428f-9ef5-f8de9cdba431 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:39.597887 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1429/2856] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:07:39.602815 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854cc69-9dd8-405c-b10d-2309f0bdcf47 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:39.613409 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854cc69-9dd8-405c-b10d-2309f0bdcf47 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:39.618496 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581b3d7-63a5-4805-a4a7-a41b6df6aa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:39.619163 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581b3d7-63a5-4805-a4a7-a41b6df6aa36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:39.619474 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581b3d7-63a5-4805-a4a7-a41b6df6aa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:39.619747 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581b3d7-63a5-4805-a4a7-a41b6df6aa36 admin admin] PATH_INFO: `/v3/projects/a8104f9346934ccebbb1f4c790142a6f/users/b4d0c95dd7c4418ead9ab39aca4e805d/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:39.636758 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581b3d7-63a5-4805-a4a7-a41b6df6aa36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8104f9346934ccebbb1f4c790142a6f, user_id=b4d0c95dd7c4418ead9ab39aca4e805d, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:39.639474 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581b3d7-63a5-4805-a4a7-a41b6df6aa36 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:39.653648 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1428/2857] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:07:39 2022] PUT /identity/v3/projects/a8104f9346934ccebbb1f4c790142a6f/users/b4d0c95dd7c4418ead9ab39aca4e805d/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:07:39.658005 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3accc4e-d655-428f-9ef5-f8de9cdba431 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:39.668421 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3accc4e-d655-428f-9ef5-f8de9cdba431 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:39.728163 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715fb57-f2a3-4066-a036-9d260feb1d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:39.728675 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715fb57-f2a3-4066-a036-9d260feb1d86 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:39.728959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715fb57-f2a3-4066-a036-9d260feb1d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:39.729234 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715fb57-f2a3-4066-a036-9d260feb1d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:39.729869 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715fb57-f2a3-4066-a036-9d260feb1d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:39.731514 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715fb57-f2a3-4066-a036-9d260feb1d86 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:39.741698 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1430/2858] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:07:39.746069 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581b3d7-63a5-4805-a4a7-a41b6df6aa36 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:39.757463 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581b3d7-63a5-4805-a4a7-a41b6df6aa36 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:39.763224 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa243ed-031d-4c90-a54e-c1f8f885b0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:39.763920 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa243ed-031d-4c90-a54e-c1f8f885b0ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:39.764187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa243ed-031d-4c90-a54e-c1f8f885b0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:39.764463 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa243ed-031d-4c90-a54e-c1f8f885b0ce admin admin] PATH_INFO: `/v3/projects/a8104f9346934ccebbb1f4c790142a6f/users/b4d0c95dd7c4418ead9ab39aca4e805d/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:39.766494 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa243ed-031d-4c90-a54e-c1f8f885b0ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8104f9346934ccebbb1f4c790142a6f, user_id=b4d0c95dd7c4418ead9ab39aca4e805d, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:39.769205 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa243ed-031d-4c90-a54e-c1f8f885b0ce admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:39.780115 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1429/2859] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:07:39 2022] PUT /identity/v3/projects/a8104f9346934ccebbb1f4c790142a6f/users/b4d0c95dd7c4418ead9ab39aca4e805d/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:07:39.791657 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4f8cc-d35c-4013-a63c-afc36b4c9cdd None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:39.791950 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4f8cc-d35c-4013-a63c-afc36b4c9cdd None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:39.792223 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4f8cc-d35c-4013-a63c-afc36b4c9cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:39.821826 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-27b4f8cc-d35c-4013-a63c-afc36b4c9cdd None None] MFA Rules not processed for user `b4d0c95dd7c4418ead9ab39aca4e805d`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:07:39.823083 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-27b4f8cc-d35c-4013-a63c-afc36b4c9cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:39.908144 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1431/2860] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:07:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:07:39.921037 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa243ed-031d-4c90-a54e-c1f8f885b0ce admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:39.923069 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9fa243ed-031d-4c90-a54e-c1f8f885b0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:40.012881 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa243ed-031d-4c90-a54e-c1f8f885b0ce admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:40.017622 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321c7d2-0aae-405b-8e33-065d22f50c67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:40.018270 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321c7d2-0aae-405b-8e33-065d22f50c67 service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:40.018547 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321c7d2-0aae-405b-8e33-065d22f50c67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:40.018817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321c7d2-0aae-405b-8e33-065d22f50c67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:40.028837 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321c7d2-0aae-405b-8e33-065d22f50c67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:40.030314 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321c7d2-0aae-405b-8e33-065d22f50c67 service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:40.041250 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1430/2861] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:07:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:07:40.377503 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4f8cc-d35c-4013-a63c-afc36b4c9cdd None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:40.387066 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4f8cc-d35c-4013-a63c-afc36b4c9cdd None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:40.392993 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819082a-fe5b-4346-a579-d86291d6df72 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d0c95dd7c4418ead9ab39aca4e805d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8104f9346934ccebbb1f4c790142a6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:40.393650 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819082a-fe5b-4346-a579-d86291d6df72 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:40.393956 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819082a-fe5b-4346-a579-d86291d6df72 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:40.394229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819082a-fe5b-4346-a579-d86291d6df72 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:40.394880 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819082a-fe5b-4346-a579-d86291d6df72 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 12:07:40.395186 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819082a-fe5b-4346-a579-d86291d6df72 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:40.396837 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819082a-fe5b-4346-a579-d86291d6df72 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:40.407229 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:40.413849 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1432/2862] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 12:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 12:07:40.415004 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321c7d2-0aae-405b-8e33-065d22f50c67 service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:40.424468 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321c7d2-0aae-405b-8e33-065d22f50c67 service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:40.429749 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca1b31-726e-442b-b457-fb917d435a00 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d0c95dd7c4418ead9ab39aca4e805d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8104f9346934ccebbb1f4c790142a6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:40.430344 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca1b31-726e-442b-b457-fb917d435a00 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:40.430631 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca1b31-726e-442b-b457-fb917d435a00 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:40.430900 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca1b31-726e-442b-b457-fb917d435a00 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:40.431579 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca1b31-726e-442b-b457-fb917d435a00 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:40.433504 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca1b31-726e-442b-b457-fb917d435a00 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:40.464547 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1431/2863] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:07:40 2022] POST /identity/v3/projects => generated 355 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 12:07:40.470358 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819082a-fe5b-4346-a579-d86291d6df72 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:40.480639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819082a-fe5b-4346-a579-d86291d6df72 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:40.546189 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b228a24-692b-4677-9f02-81eb5fb91ac0 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d0c95dd7c4418ead9ab39aca4e805d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8104f9346934ccebbb1f4c790142a6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:40.546712 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b228a24-692b-4677-9f02-81eb5fb91ac0 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:40.546987 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b228a24-692b-4677-9f02-81eb5fb91ac0 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:40.547262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b228a24-692b-4677-9f02-81eb5fb91ac0 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:40.547933 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b228a24-692b-4677-9f02-81eb5fb91ac0 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 12:07:40.548238 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b228a24-692b-4677-9f02-81eb5fb91ac0 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:40.549838 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b228a24-692b-4677-9f02-81eb5fb91ac0 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:40.562038 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1433/2864] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 12:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 12:07:40.600745 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca1b31-726e-442b-b457-fb917d435a00 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:40.611875 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca1b31-726e-442b-b457-fb917d435a00 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:40.617710 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f833279-c710-4684-b0a1-5acb9cab00e1 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d0c95dd7c4418ead9ab39aca4e805d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8104f9346934ccebbb1f4c790142a6f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:40.618337 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f833279-c710-4684-b0a1-5acb9cab00e1 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:40.618616 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f833279-c710-4684-b0a1-5acb9cab00e1 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:40.618870 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f833279-c710-4684-b0a1-5acb9cab00e1 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] PATH_INFO: `/v3/projects/03dfbe6ea8f7432d9b11c93ea9a46b8e` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:40.620151 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f833279-c710-4684-b0a1-5acb9cab00e1 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] RBAC: Authorizing `identity:delete_project(project_id=03dfbe6ea8f7432d9b11c93ea9a46b8e)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:40.622075 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f833279-c710-4684-b0a1-5acb9cab00e1 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:40.681144 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7f833279-c710-4684-b0a1-5acb9cab00e1 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03dfbe6ea8f7432d9b11c93ea9a46b8e', 'request_id': 'req-7f833279-c710-4684-b0a1-5acb9cab00e1'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:40.691230 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7f833279-c710-4684-b0a1-5acb9cab00e1 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03dfbe6ea8f7432d9b11c93ea9a46b8e', 'request_id': 'req-7f833279-c710-4684-b0a1-5acb9cab00e1'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:40.696720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:40.699755 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7f833279-c710-4684-b0a1-5acb9cab00e1 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03dfbe6ea8f7432d9b11c93ea9a46b8e', 'request_id': 'req-7f833279-c710-4684-b0a1-5acb9cab00e1'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:40.720049 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7f833279-c710-4684-b0a1-5acb9cab00e1 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] The token cache is being invalidate because project 03dfbe6ea8f7432d9b11c93ea9a46b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:07:40.720425 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7f833279-c710-4684-b0a1-5acb9cab00e1 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:40.721263 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-7f833279-c710-4684-b0a1-5acb9cab00e1 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:40.723655 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1432/2865] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:07:40 2022] DELETE /identity/v3/projects/03dfbe6ea8f7432d9b11c93ea9a46b8e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:07:40.924130 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b228a24-692b-4677-9f02-81eb5fb91ac0 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:40.926023 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6b228a24-692b-4677-9f02-81eb5fb91ac0 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:40.993056 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b228a24-692b-4677-9f02-81eb5fb91ac0 tempest-VolumeQuotaClassesTest-1378744459 tempest-VolumeQuotaClassesTest-1378744459-project-admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:41.051722 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34a33f-9da6-4949-b815-7c8d1222abbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:41.052353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34a33f-9da6-4949-b815-7c8d1222abbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:41.052626 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34a33f-9da6-4949-b815-7c8d1222abbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:41.052893 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34a33f-9da6-4949-b815-7c8d1222abbc admin admin] PATH_INFO: `/v3/users/7ae8d9771036405f815217909d9fe115` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:41.054058 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34a33f-9da6-4949-b815-7c8d1222abbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ae8d9771036405f815217909d9fe115)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:41.055996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34a33f-9da6-4949-b815-7c8d1222abbc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:41.106964 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:41.109599 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ec34a33f-9da6-4949-b815-7c8d1222abbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ae8d9771036405f815217909d9fe115'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:41.117878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ec34a33f-9da6-4949-b815-7c8d1222abbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ae8d9771036405f815217909d9fe115'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:41.127127 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ec34a33f-9da6-4949-b815-7c8d1222abbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ae8d9771036405f815217909d9fe115'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:41.144059 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ec34a33f-9da6-4949-b815-7c8d1222abbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ae8d9771036405f815217909d9fe115'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:41.145163 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ec34a33f-9da6-4949-b815-7c8d1222abbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ae8d9771036405f815217909d9fe115'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:41.155090 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1434/2866] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:07:40 2022] DELETE /identity/v3/users/7ae8d9771036405f815217909d9fe115 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:07:41.159851 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82594a-8a54-4ab5-bba0-6e01926b0152 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:41.160335 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82594a-8a54-4ab5-bba0-6e01926b0152 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:41.160433 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82594a-8a54-4ab5-bba0-6e01926b0152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:41.180465 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-cd82594a-8a54-4ab5-bba0-6e01926b0152 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:07:41.181654 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-cd82594a-8a54-4ab5-bba0-6e01926b0152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:41.243777 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1433/2867] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:07:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:07:41.254235 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34a33f-9da6-4949-b815-7c8d1222abbc admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:41.255899 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ec34a33f-9da6-4949-b815-7c8d1222abbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:41.347893 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34a33f-9da6-4949-b815-7c8d1222abbc admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:41.355136 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcba45-81cb-415a-98df-ca2f55e99367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:41.356095 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcba45-81cb-415a-98df-ca2f55e99367 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:41.356451 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcba45-81cb-415a-98df-ca2f55e99367 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:41.356766 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcba45-81cb-415a-98df-ca2f55e99367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:41.367759 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcba45-81cb-415a-98df-ca2f55e99367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:41.369125 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcba45-81cb-415a-98df-ca2f55e99367 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:41.379165 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1435/2868] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:07:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:07:41.658190 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82594a-8a54-4ab5-bba0-6e01926b0152 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:41.659847 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-cd82594a-8a54-4ab5-bba0-6e01926b0152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:41.672447 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82594a-8a54-4ab5-bba0-6e01926b0152 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:41.677595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee76d20-29d9-419c-b793-47bcccf95c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:41.678312 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76d20-29d9-419c-b793-47bcccf95c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:41.678627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76d20-29d9-419c-b793-47bcccf95c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:41.678962 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76d20-29d9-419c-b793-47bcccf95c4c admin admin] PATH_INFO: `/v3/projects/fe47e0d81ba64abaa88a82e34f5a3e89` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:41.680349 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee76d20-29d9-419c-b793-47bcccf95c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe47e0d81ba64abaa88a82e34f5a3e89)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:41.682424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee76d20-29d9-419c-b793-47bcccf95c4c admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:41.732587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3ee76d20-29d9-419c-b793-47bcccf95c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe47e0d81ba64abaa88a82e34f5a3e89', 'request_id': 'req-3ee76d20-29d9-419c-b793-47bcccf95c4c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:41.738639 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3ee76d20-29d9-419c-b793-47bcccf95c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe47e0d81ba64abaa88a82e34f5a3e89', 'request_id': 'req-3ee76d20-29d9-419c-b793-47bcccf95c4c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:41.744738 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3ee76d20-29d9-419c-b793-47bcccf95c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe47e0d81ba64abaa88a82e34f5a3e89', 'request_id': 'req-3ee76d20-29d9-419c-b793-47bcccf95c4c'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:41.759055 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3ee76d20-29d9-419c-b793-47bcccf95c4c admin admin] The token cache is being invalidate because project fe47e0d81ba64abaa88a82e34f5a3e89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:07:41.759387 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3ee76d20-29d9-419c-b793-47bcccf95c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:41.760032 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3ee76d20-29d9-419c-b793-47bcccf95c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:41.761510 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1434/2869] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:07:41 2022] DELETE /identity/v3/projects/fe47e0d81ba64abaa88a82e34f5a3e89 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:07:41.765814 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcba45-81cb-415a-98df-ca2f55e99367 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:41.775600 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcba45-81cb-415a-98df-ca2f55e99367 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:41.834848 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e64399-b025-4091-bdfe-29aa90d73768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:41.835533 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e64399-b025-4091-bdfe-29aa90d73768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:41.835813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e64399-b025-4091-bdfe-29aa90d73768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:41.836087 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e64399-b025-4091-bdfe-29aa90d73768 admin admin] PATH_INFO: `/v3/users/b4d0c95dd7c4418ead9ab39aca4e805d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:41.837261 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e64399-b025-4091-bdfe-29aa90d73768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4d0c95dd7c4418ead9ab39aca4e805d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:41.839198 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e64399-b025-4091-bdfe-29aa90d73768 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:41.892204 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:41.894118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-85e64399-b025-4091-bdfe-29aa90d73768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d0c95dd7c4418ead9ab39aca4e805d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:41.903063 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-85e64399-b025-4091-bdfe-29aa90d73768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d0c95dd7c4418ead9ab39aca4e805d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:41.911396 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-85e64399-b025-4091-bdfe-29aa90d73768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d0c95dd7c4418ead9ab39aca4e805d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:41.923452 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-85e64399-b025-4091-bdfe-29aa90d73768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d0c95dd7c4418ead9ab39aca4e805d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:41.924103 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-85e64399-b025-4091-bdfe-29aa90d73768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d0c95dd7c4418ead9ab39aca4e805d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:41.929907 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1436/2870] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:07:41 2022] DELETE /identity/v3/users/b4d0c95dd7c4418ead9ab39aca4e805d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:07:42.221731 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee76d20-29d9-419c-b793-47bcccf95c4c admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:42.223277 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3ee76d20-29d9-419c-b793-47bcccf95c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:42.236483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee76d20-29d9-419c-b793-47bcccf95c4c admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:42.296434 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86604914-e95f-4ac5-b866-76b11566fc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:42.297072 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86604914-e95f-4ac5-b866-76b11566fc1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:42.297346 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86604914-e95f-4ac5-b866-76b11566fc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:42.297627 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86604914-e95f-4ac5-b866-76b11566fc1f admin admin] PATH_INFO: `/v3/projects/a8104f9346934ccebbb1f4c790142a6f` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:42.298842 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86604914-e95f-4ac5-b866-76b11566fc1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8104f9346934ccebbb1f4c790142a6f)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:42.300860 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86604914-e95f-4ac5-b866-76b11566fc1f admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:42.313117 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:42.354324 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-86604914-e95f-4ac5-b866-76b11566fc1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8104f9346934ccebbb1f4c790142a6f', 'request_id': 'req-86604914-e95f-4ac5-b866-76b11566fc1f'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:42.364217 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-86604914-e95f-4ac5-b866-76b11566fc1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8104f9346934ccebbb1f4c790142a6f', 'request_id': 'req-86604914-e95f-4ac5-b866-76b11566fc1f'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:42.373496 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-86604914-e95f-4ac5-b866-76b11566fc1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8104f9346934ccebbb1f4c790142a6f', 'request_id': 'req-86604914-e95f-4ac5-b866-76b11566fc1f'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:42.388732 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-86604914-e95f-4ac5-b866-76b11566fc1f admin admin] The token cache is being invalidate because project a8104f9346934ccebbb1f4c790142a6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:07:42.389016 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-86604914-e95f-4ac5-b866-76b11566fc1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:42.389635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-86604914-e95f-4ac5-b866-76b11566fc1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:42.391212 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1435/2871] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:07:42 2022] DELETE /identity/v3/projects/a8104f9346934ccebbb1f4c790142a6f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:07:42.396380 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1d123-4f62-47bc-a8a6-4ca71a6d95ac None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:42.396747 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1d123-4f62-47bc-a8a6-4ca71a6d95ac None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:42.397025 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1d123-4f62-47bc-a8a6-4ca71a6d95ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:42.417932 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-eec1d123-4f62-47bc-a8a6-4ca71a6d95ac None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:07:42.419135 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-eec1d123-4f62-47bc-a8a6-4ca71a6d95ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:42.480278 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1437/2872] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:07:42.488282 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796cf5e-8b45-4129-8118-4c3cb75a6473 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:42.488567 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796cf5e-8b45-4129-8118-4c3cb75a6473 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:42.488843 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796cf5e-8b45-4129-8118-4c3cb75a6473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:42.509535 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-d796cf5e-8b45-4129-8118-4c3cb75a6473 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:07:42.510730 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-d796cf5e-8b45-4129-8118-4c3cb75a6473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:42.519244 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1436/2873] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:07:42.524117 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1d123-4f62-47bc-a8a6-4ca71a6d95ac None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:42.537447 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1d123-4f62-47bc-a8a6-4ca71a6d95ac None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:42.543024 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d9e5e-a3a1-43c2-ad4d-562a12ae185e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:42.543665 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d9e5e-a3a1-43c2-ad4d-562a12ae185e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:42.543945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d9e5e-a3a1-43c2-ad4d-562a12ae185e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:42.544208 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d9e5e-a3a1-43c2-ad4d-562a12ae185e admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:42.544857 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d9e5e-a3a1-43c2-ad4d-562a12ae185e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 12:07:42.545162 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d9e5e-a3a1-43c2-ad4d-562a12ae185e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:42.546807 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d9e5e-a3a1-43c2-ad4d-562a12ae185e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:42.559319 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1438/2874] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 12:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 12:07:42.564360 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796cf5e-8b45-4129-8118-4c3cb75a6473 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:42.576815 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796cf5e-8b45-4129-8118-4c3cb75a6473 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:42.582720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4f888-ba5d-42f2-89ce-08447b98f676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:42.583312 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4f888-ba5d-42f2-89ce-08447b98f676 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:42.583636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4f888-ba5d-42f2-89ce-08447b98f676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:42.583902 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4f888-ba5d-42f2-89ce-08447b98f676 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:42.584539 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4f888-ba5d-42f2-89ce-08447b98f676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:42.586439 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4f888-ba5d-42f2-89ce-08447b98f676 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:42.617265 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1437/2875] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:07:42 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:07:42.621821 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d9e5e-a3a1-43c2-ad4d-562a12ae185e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:42.633672 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d9e5e-a3a1-43c2-ad4d-562a12ae185e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:42.697051 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef854bf-9d21-43bf-94d4-f4dd23cf8be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:42.697863 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef854bf-9d21-43bf-94d4-f4dd23cf8be5 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:42.698329 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef854bf-9d21-43bf-94d4-f4dd23cf8be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:42.698709 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef854bf-9d21-43bf-94d4-f4dd23cf8be5 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:42.699753 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef854bf-9d21-43bf-94d4-f4dd23cf8be5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:42.702622 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef854bf-9d21-43bf-94d4-f4dd23cf8be5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:42.728634 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1439/2876] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:07:42 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:07:42.734992 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4f888-ba5d-42f2-89ce-08447b98f676 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:42.745717 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4f888-ba5d-42f2-89ce-08447b98f676 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:42.751630 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72ca76-d8bf-49c4-b0ad-afbd34722dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:42.752246 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72ca76-d8bf-49c4-b0ad-afbd34722dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:42.752513 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72ca76-d8bf-49c4-b0ad-afbd34722dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:42.752780 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72ca76-d8bf-49c4-b0ad-afbd34722dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:42.753424 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72ca76-d8bf-49c4-b0ad-afbd34722dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:42.755028 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72ca76-d8bf-49c4-b0ad-afbd34722dc0 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:42.767014 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1438/2877] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:07:42.770201 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef854bf-9d21-43bf-94d4-f4dd23cf8be5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:42.781352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef854bf-9d21-43bf-94d4-f4dd23cf8be5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:42.786241 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5a9fd-56f7-41a5-a838-5b0a74a74245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:42.786841 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5a9fd-56f7-41a5-a838-5b0a74a74245 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:42.787141 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5a9fd-56f7-41a5-a838-5b0a74a74245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:42.787429 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5a9fd-56f7-41a5-a838-5b0a74a74245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:42.788068 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5a9fd-56f7-41a5-a838-5b0a74a74245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:42.789652 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5a9fd-56f7-41a5-a838-5b0a74a74245 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:42.800474 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1440/2878] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:07:42.805105 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72ca76-d8bf-49c4-b0ad-afbd34722dc0 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:42.816186 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72ca76-d8bf-49c4-b0ad-afbd34722dc0 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:42.821937 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88174a28-5806-4b92-af30-0c54eabcc8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:42.822610 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88174a28-5806-4b92-af30-0c54eabcc8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:42.822889 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88174a28-5806-4b92-af30-0c54eabcc8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:42.823152 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88174a28-5806-4b92-af30-0c54eabcc8ec admin admin] PATH_INFO: `/v3/projects/66d6c89446a34512b7fef93fb8e03587/users/f7dc8e57e2314a958c479fa7d8e9ddbc/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:42.840574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88174a28-5806-4b92-af30-0c54eabcc8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d6c89446a34512b7fef93fb8e03587, user_id=f7dc8e57e2314a958c479fa7d8e9ddbc, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:42.843289 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88174a28-5806-4b92-af30-0c54eabcc8ec admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:42.860743 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1439/2879] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:07:42 2022] PUT /identity/v3/projects/66d6c89446a34512b7fef93fb8e03587/users/f7dc8e57e2314a958c479fa7d8e9ddbc/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:07:42.872434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af734e4-439c-4a73-a8be-2ec9a198aa61 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:42.872719 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af734e4-439c-4a73-a8be-2ec9a198aa61 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:42.872992 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af734e4-439c-4a73-a8be-2ec9a198aa61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:42.903001 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3af734e4-439c-4a73-a8be-2ec9a198aa61 None None] MFA Rules not processed for user `f7dc8e57e2314a958c479fa7d8e9ddbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:07:42.904256 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3af734e4-439c-4a73-a8be-2ec9a198aa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:42.922379 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:42.980755 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1441/2880] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:07:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:07:42.986561 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88174a28-5806-4b92-af30-0c54eabcc8ec admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:43.072154 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88174a28-5806-4b92-af30-0c54eabcc8ec admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:43.078046 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c4d29-e3d4-4a18-a406-bf35293b5142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:43.078635 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c4d29-e3d4-4a18-a406-bf35293b5142 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:43.078912 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c4d29-e3d4-4a18-a406-bf35293b5142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:43.079201 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c4d29-e3d4-4a18-a406-bf35293b5142 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:43.079904 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c4d29-e3d4-4a18-a406-bf35293b5142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:43.081860 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c4d29-e3d4-4a18-a406-bf35293b5142 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:43.112674 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1440/2881] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:07:42 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:07:43.116983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af734e4-439c-4a73-a8be-2ec9a198aa61 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:43.128393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af734e4-439c-4a73-a8be-2ec9a198aa61 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:43.186764 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2d0d5-4b21-4ba8-9e16-08c96e2556d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:43.187392 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2d0d5-4b21-4ba8-9e16-08c96e2556d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:43.187718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2d0d5-4b21-4ba8-9e16-08c96e2556d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:43.187985 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2d0d5-4b21-4ba8-9e16-08c96e2556d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:43.188610 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2d0d5-4b21-4ba8-9e16-08c96e2556d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:43.190533 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2d0d5-4b21-4ba8-9e16-08c96e2556d2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:43.213615 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1442/2882] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:07:43 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:07:43.218028 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c4d29-e3d4-4a18-a406-bf35293b5142 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:43.228474 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c4d29-e3d4-4a18-a406-bf35293b5142 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:43.234010 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0c5c8-40c6-459a-b550-2345df39d620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:43.234617 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0c5c8-40c6-459a-b550-2345df39d620 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:43.234892 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0c5c8-40c6-459a-b550-2345df39d620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:43.235159 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0c5c8-40c6-459a-b550-2345df39d620 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:43.235840 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0c5c8-40c6-459a-b550-2345df39d620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:43.237536 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0c5c8-40c6-459a-b550-2345df39d620 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:43.249645 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1441/2883] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:07:43.255848 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2d0d5-4b21-4ba8-9e16-08c96e2556d2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:43.271088 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2d0d5-4b21-4ba8-9e16-08c96e2556d2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:43.280374 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429dc63-9013-4f66-9365-b5211d9e024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:43.281059 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429dc63-9013-4f66-9365-b5211d9e024a admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:43.281332 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429dc63-9013-4f66-9365-b5211d9e024a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:43.281597 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429dc63-9013-4f66-9365-b5211d9e024a admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:43.282262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429dc63-9013-4f66-9365-b5211d9e024a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:43.283904 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429dc63-9013-4f66-9365-b5211d9e024a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:43.294638 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1443/2884] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:07:43.299051 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0c5c8-40c6-459a-b550-2345df39d620 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:43.309798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0c5c8-40c6-459a-b550-2345df39d620 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:43.315762 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a19bc6-5542-4119-b126-a8652082c0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:43.316411 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a19bc6-5542-4119-b126-a8652082c0e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:43.316687 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a19bc6-5542-4119-b126-a8652082c0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:43.316955 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a19bc6-5542-4119-b126-a8652082c0e3 admin admin] PATH_INFO: `/v3/projects/8f2fa8ef93bb443db08f5c197329d3e2/users/412226ee11f246098c38e52798626751/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:43.325149 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:43.332880 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a19bc6-5542-4119-b126-a8652082c0e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f2fa8ef93bb443db08f5c197329d3e2, user_id=412226ee11f246098c38e52798626751, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:43.336556 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a19bc6-5542-4119-b126-a8652082c0e3 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:43.350316 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1442/2885] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:07:43 2022] PUT /identity/v3/projects/8f2fa8ef93bb443db08f5c197329d3e2/users/412226ee11f246098c38e52798626751/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:07:43.360932 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830f795-3351-4145-ba34-7c5cad2f91df None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:43.361220 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830f795-3351-4145-ba34-7c5cad2f91df None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:43.361494 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830f795-3351-4145-ba34-7c5cad2f91df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:43.390146 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4830f795-3351-4145-ba34-7c5cad2f91df None None] MFA Rules not processed for user `412226ee11f246098c38e52798626751`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:07:43.391345 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4830f795-3351-4145-ba34-7c5cad2f91df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:43.459910 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1444/2886] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:07:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:07:43.465212 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a19bc6-5542-4119-b126-a8652082c0e3 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:43.536115 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a19bc6-5542-4119-b126-a8652082c0e3 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:43.541121 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813fceb-6ea6-48cb-9a7e-3389ddaf3079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:43.541723 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813fceb-6ea6-48cb-9a7e-3389ddaf3079 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:43.541994 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813fceb-6ea6-48cb-9a7e-3389ddaf3079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:43.542261 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813fceb-6ea6-48cb-9a7e-3389ddaf3079 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:43.542865 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813fceb-6ea6-48cb-9a7e-3389ddaf3079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:43.544810 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813fceb-6ea6-48cb-9a7e-3389ddaf3079 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:43.580325 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1443/2887] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:07:43 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:07:43.584580 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830f795-3351-4145-ba34-7c5cad2f91df None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:43.596137 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830f795-3351-4145-ba34-7c5cad2f91df None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:43.621806 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:43.658444 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b029f-de94-4a9a-b34e-bb6171b4dcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:43.659050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b029f-de94-4a9a-b34e-bb6171b4dcbe admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:43.659321 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b029f-de94-4a9a-b34e-bb6171b4dcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:43.659622 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b029f-de94-4a9a-b34e-bb6171b4dcbe admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:43.660230 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b029f-de94-4a9a-b34e-bb6171b4dcbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:43.662288 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b029f-de94-4a9a-b34e-bb6171b4dcbe admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:43.685552 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1445/2888] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:07:43 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:07:43.689859 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813fceb-6ea6-48cb-9a7e-3389ddaf3079 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:43.700570 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813fceb-6ea6-48cb-9a7e-3389ddaf3079 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:43.705881 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67105ffc-b67f-40f0-954f-313f73f25acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:43.706489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67105ffc-b67f-40f0-954f-313f73f25acd admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:43.706765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67105ffc-b67f-40f0-954f-313f73f25acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:43.707036 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67105ffc-b67f-40f0-954f-313f73f25acd admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:43.707716 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67105ffc-b67f-40f0-954f-313f73f25acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:43.709403 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67105ffc-b67f-40f0-954f-313f73f25acd admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:43.720475 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1444/2889] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:07:43.724878 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b029f-de94-4a9a-b34e-bb6171b4dcbe admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:43.735794 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b029f-de94-4a9a-b34e-bb6171b4dcbe admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:43.741895 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c55fe-23c2-486e-b1ac-efff5e566dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:43.742545 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c55fe-23c2-486e-b1ac-efff5e566dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:43.742824 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c55fe-23c2-486e-b1ac-efff5e566dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:43.743092 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c55fe-23c2-486e-b1ac-efff5e566dcf admin admin] PATH_INFO: `/v3/projects/90a23a301993442f9d9114f28011cf44/users/8bdf73adf9fc4f4d9a79a975349463c5/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:43.760413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c55fe-23c2-486e-b1ac-efff5e566dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a23a301993442f9d9114f28011cf44, user_id=8bdf73adf9fc4f4d9a79a975349463c5, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:43.763057 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c55fe-23c2-486e-b1ac-efff5e566dcf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:43.778141 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1446/2890] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:07:43 2022] PUT /identity/v3/projects/90a23a301993442f9d9114f28011cf44/users/8bdf73adf9fc4f4d9a79a975349463c5/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:07:43.784343 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67105ffc-b67f-40f0-954f-313f73f25acd admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:43.796074 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67105ffc-b67f-40f0-954f-313f73f25acd admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:43.855464 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c163d54-4e37-4f95-bb8a-935115ba81e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:43.856062 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c163d54-4e37-4f95-bb8a-935115ba81e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:43.856338 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c163d54-4e37-4f95-bb8a-935115ba81e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:43.856606 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c163d54-4e37-4f95-bb8a-935115ba81e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:43.857229 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c163d54-4e37-4f95-bb8a-935115ba81e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:43.858828 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c163d54-4e37-4f95-bb8a-935115ba81e0 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:43.868650 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1445/2891] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:07:43.873000 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c55fe-23c2-486e-b1ac-efff5e566dcf admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:43.883676 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c55fe-23c2-486e-b1ac-efff5e566dcf admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:43.888680 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6f2b8-12a0-42f9-be5a-cf98b72279e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:43.889391 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6f2b8-12a0-42f9-be5a-cf98b72279e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:43.889672 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6f2b8-12a0-42f9-be5a-cf98b72279e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:43.889945 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6f2b8-12a0-42f9-be5a-cf98b72279e0 admin admin] PATH_INFO: `/v3/projects/90a23a301993442f9d9114f28011cf44/users/8bdf73adf9fc4f4d9a79a975349463c5/roles/4f4d8a6881ca496bb2d4845a6592fea8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:43.891985 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef6f2b8-12a0-42f9-be5a-cf98b72279e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a23a301993442f9d9114f28011cf44, user_id=8bdf73adf9fc4f4d9a79a975349463c5, role_id=4f4d8a6881ca496bb2d4845a6592fea8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:43.894598 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef6f2b8-12a0-42f9-be5a-cf98b72279e0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:43.905206 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1447/2892] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:07:43 2022] PUT /identity/v3/projects/90a23a301993442f9d9114f28011cf44/users/8bdf73adf9fc4f4d9a79a975349463c5/roles/4f4d8a6881ca496bb2d4845a6592fea8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:07:43.915489 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60abc5e-5b7c-4675-b473-fb449db7f7cc None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:43.915771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60abc5e-5b7c-4675-b473-fb449db7f7cc None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:43.916048 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60abc5e-5b7c-4675-b473-fb449db7f7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:43.948010 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-e60abc5e-5b7c-4675-b473-fb449db7f7cc None None] MFA Rules not processed for user `8bdf73adf9fc4f4d9a79a975349463c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:07:43.949209 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e60abc5e-5b7c-4675-b473-fb449db7f7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:43.995618 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:44.022595 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1446/2893] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:07:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 12:07:44.034690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6f2b8-12a0-42f9-be5a-cf98b72279e0 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:44.036664 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7ef6f2b8-12a0-42f9-be5a-cf98b72279e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:44.095716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6f2b8-12a0-42f9-be5a-cf98b72279e0 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:44.099845 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c34b0f-56df-4386-963f-cbb5952b5f27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:44.100452 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c34b0f-56df-4386-963f-cbb5952b5f27 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:44.100726 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c34b0f-56df-4386-963f-cbb5952b5f27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:44.100991 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c34b0f-56df-4386-963f-cbb5952b5f27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:44.113704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c34b0f-56df-4386-963f-cbb5952b5f27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:44.114794 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c34b0f-56df-4386-963f-cbb5952b5f27 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:44.125041 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1448/2894] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:07:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:07:44.170924 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60abc5e-5b7c-4675-b473-fb449db7f7cc None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:44.172526 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e60abc5e-5b7c-4675-b473-fb449db7f7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:44.191225 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60abc5e-5b7c-4675-b473-fb449db7f7cc None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:44.198476 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758a134-bb2f-45c2-aa12-e16622d7003b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:44.199426 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758a134-bb2f-45c2-aa12-e16622d7003b service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:44.199805 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758a134-bb2f-45c2-aa12-e16622d7003b service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:44.200206 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758a134-bb2f-45c2-aa12-e16622d7003b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:44.260798 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758a134-bb2f-45c2-aa12-e16622d7003b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:44.262247 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758a134-bb2f-45c2-aa12-e16622d7003b service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:44.271850 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1447/2895] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:07:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:07:47.214476 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c34b0f-56df-4386-963f-cbb5952b5f27 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:47.278496 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c34b0f-56df-4386-963f-cbb5952b5f27 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:47.284520 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0ecaa-8f43-4998-ad24-563a1cd9f837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:47.285174 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0ecaa-8f43-4998-ad24-563a1cd9f837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:47.285478 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0ecaa-8f43-4998-ad24-563a1cd9f837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:47.285740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0ecaa-8f43-4998-ad24-563a1cd9f837 admin admin] PATH_INFO: `/v3/users/f7dc8e57e2314a958c479fa7d8e9ddbc` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:47.286997 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0ecaa-8f43-4998-ad24-563a1cd9f837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7dc8e57e2314a958c479fa7d8e9ddbc)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:47.289014 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0ecaa-8f43-4998-ad24-563a1cd9f837 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:47.316227 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:47.343813 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f9c0ecaa-8f43-4998-ad24-563a1cd9f837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7dc8e57e2314a958c479fa7d8e9ddbc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:47.352167 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f9c0ecaa-8f43-4998-ad24-563a1cd9f837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7dc8e57e2314a958c479fa7d8e9ddbc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:47.360445 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f9c0ecaa-8f43-4998-ad24-563a1cd9f837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7dc8e57e2314a958c479fa7d8e9ddbc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:47.372335 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f9c0ecaa-8f43-4998-ad24-563a1cd9f837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7dc8e57e2314a958c479fa7d8e9ddbc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:47.372901 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f9c0ecaa-8f43-4998-ad24-563a1cd9f837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7dc8e57e2314a958c479fa7d8e9ddbc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:47.378663 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1449/2896] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:07:47 2022] DELETE /identity/v3/users/f7dc8e57e2314a958c479fa7d8e9ddbc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:07:47.383318 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a63bc-af8d-4d50-85c4-9bbe091f64a3 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:47.383811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a63bc-af8d-4d50-85c4-9bbe091f64a3 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:47.383928 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a63bc-af8d-4d50-85c4-9bbe091f64a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:47.405985 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-9d5a63bc-af8d-4d50-85c4-9bbe091f64a3 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:07:47.407508 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9d5a63bc-af8d-4d50-85c4-9bbe091f64a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:47.474897 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1448/2897] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:07:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:07:47.485988 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0ecaa-8f43-4998-ad24-563a1cd9f837 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:47.487341 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f9c0ecaa-8f43-4998-ad24-563a1cd9f837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:47.554734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0ecaa-8f43-4998-ad24-563a1cd9f837 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:47.560730 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad13bb-99ba-4452-af6a-b7fd9fdc1e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:47.561655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad13bb-99ba-4452-af6a-b7fd9fdc1e6b service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:47.561998 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad13bb-99ba-4452-af6a-b7fd9fdc1e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:47.562336 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad13bb-99ba-4452-af6a-b7fd9fdc1e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:47.572322 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad13bb-99ba-4452-af6a-b7fd9fdc1e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:47.573749 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad13bb-99ba-4452-af6a-b7fd9fdc1e6b service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:47.583022 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1450/2898] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:07:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:07:47.857067 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a63bc-af8d-4d50-85c4-9bbe091f64a3 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:47.858671 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-9d5a63bc-af8d-4d50-85c4-9bbe091f64a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:47.877018 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a63bc-af8d-4d50-85c4-9bbe091f64a3 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:47.884408 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe343c-3540-4356-8afc-3973f688cd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:47.885187 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe343c-3540-4356-8afc-3973f688cd6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:47.885500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe343c-3540-4356-8afc-3973f688cd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:47.885878 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe343c-3540-4356-8afc-3973f688cd6b admin admin] PATH_INFO: `/v3/projects/66d6c89446a34512b7fef93fb8e03587` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:47.887087 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe343c-3540-4356-8afc-3973f688cd6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=66d6c89446a34512b7fef93fb8e03587)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:47.889284 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe343c-3540-4356-8afc-3973f688cd6b admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:47.939841 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3ebe343c-3540-4356-8afc-3973f688cd6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66d6c89446a34512b7fef93fb8e03587', 'request_id': 'req-3ebe343c-3540-4356-8afc-3973f688cd6b'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:47.946184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3ebe343c-3540-4356-8afc-3973f688cd6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66d6c89446a34512b7fef93fb8e03587', 'request_id': 'req-3ebe343c-3540-4356-8afc-3973f688cd6b'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:47.952359 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3ebe343c-3540-4356-8afc-3973f688cd6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66d6c89446a34512b7fef93fb8e03587', 'request_id': 'req-3ebe343c-3540-4356-8afc-3973f688cd6b'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:47.970939 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3ebe343c-3540-4356-8afc-3973f688cd6b admin admin] The token cache is being invalidate because project 66d6c89446a34512b7fef93fb8e03587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:07:47.971246 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3ebe343c-3540-4356-8afc-3973f688cd6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:47.972211 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-3ebe343c-3540-4356-8afc-3973f688cd6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:47.974578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1449/2899] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:07:47 2022] DELETE /identity/v3/projects/66d6c89446a34512b7fef93fb8e03587 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:07:47.978734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad13bb-99ba-4452-af6a-b7fd9fdc1e6b service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:47.989083 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad13bb-99ba-4452-af6a-b7fd9fdc1e6b service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:48.055353 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b014e-74c7-41ea-90c6-d2ac0691ecb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:48.056014 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b014e-74c7-41ea-90c6-d2ac0691ecb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:48.056296 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b014e-74c7-41ea-90c6-d2ac0691ecb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:48.056572 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b014e-74c7-41ea-90c6-d2ac0691ecb2 admin admin] PATH_INFO: `/v3/users/412226ee11f246098c38e52798626751` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:48.057777 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b014e-74c7-41ea-90c6-d2ac0691ecb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=412226ee11f246098c38e52798626751)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:48.059763 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b014e-74c7-41ea-90c6-d2ac0691ecb2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:48.114161 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:48.117020 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c07b014e-74c7-41ea-90c6-d2ac0691ecb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '412226ee11f246098c38e52798626751'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:48.126769 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c07b014e-74c7-41ea-90c6-d2ac0691ecb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '412226ee11f246098c38e52798626751'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:48.136152 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c07b014e-74c7-41ea-90c6-d2ac0691ecb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '412226ee11f246098c38e52798626751'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:48.151599 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c07b014e-74c7-41ea-90c6-d2ac0691ecb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '412226ee11f246098c38e52798626751'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:48.152252 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c07b014e-74c7-41ea-90c6-d2ac0691ecb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '412226ee11f246098c38e52798626751'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:48.158313 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1451/2900] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:07:47 2022] DELETE /identity/v3/users/412226ee11f246098c38e52798626751 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:07:48.457686 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe343c-3540-4356-8afc-3973f688cd6b admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:48.459184 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-3ebe343c-3540-4356-8afc-3973f688cd6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:48.470687 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:48.487287 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe343c-3540-4356-8afc-3973f688cd6b admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:48.547817 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54572a-7b93-4c73-be9d-d2356296056d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:48.548373 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54572a-7b93-4c73-be9d-d2356296056d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:48.548647 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54572a-7b93-4c73-be9d-d2356296056d admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:48.548916 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54572a-7b93-4c73-be9d-d2356296056d admin admin] PATH_INFO: `/v3/projects/8f2fa8ef93bb443db08f5c197329d3e2` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:48.550062 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54572a-7b93-4c73-be9d-d2356296056d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f2fa8ef93bb443db08f5c197329d3e2)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:48.552001 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54572a-7b93-4c73-be9d-d2356296056d admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:48.605011 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5f54572a-7b93-4c73-be9d-d2356296056d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f2fa8ef93bb443db08f5c197329d3e2', 'request_id': 'req-5f54572a-7b93-4c73-be9d-d2356296056d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:48.611675 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5f54572a-7b93-4c73-be9d-d2356296056d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f2fa8ef93bb443db08f5c197329d3e2', 'request_id': 'req-5f54572a-7b93-4c73-be9d-d2356296056d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:48.617281 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5f54572a-7b93-4c73-be9d-d2356296056d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f2fa8ef93bb443db08f5c197329d3e2', 'request_id': 'req-5f54572a-7b93-4c73-be9d-d2356296056d'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:48.631242 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5f54572a-7b93-4c73-be9d-d2356296056d admin admin] The token cache is being invalidate because project 8f2fa8ef93bb443db08f5c197329d3e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:07:48.631585 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5f54572a-7b93-4c73-be9d-d2356296056d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:48.632385 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-5f54572a-7b93-4c73-be9d-d2356296056d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:48.634071 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1450/2901] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:07:48 2022] DELETE /identity/v3/projects/8f2fa8ef93bb443db08f5c197329d3e2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:07:48.638169 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b014e-74c7-41ea-90c6-d2ac0691ecb2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:48.639673 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c07b014e-74c7-41ea-90c6-d2ac0691ecb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:48.653856 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b014e-74c7-41ea-90c6-d2ac0691ecb2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:48.715036 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079ff59-670a-45ca-94bc-7503b587ef7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:48.715713 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079ff59-670a-45ca-94bc-7503b587ef7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:48.715996 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079ff59-670a-45ca-94bc-7503b587ef7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:48.716269 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079ff59-670a-45ca-94bc-7503b587ef7d admin admin] PATH_INFO: `/v3/users/8bdf73adf9fc4f4d9a79a975349463c5` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:48.717402 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079ff59-670a-45ca-94bc-7503b587ef7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bdf73adf9fc4f4d9a79a975349463c5)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:48.719400 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079ff59-670a-45ca-94bc-7503b587ef7d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:48.773127 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0079ff59-670a-45ca-94bc-7503b587ef7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bdf73adf9fc4f4d9a79a975349463c5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:48.780770 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0079ff59-670a-45ca-94bc-7503b587ef7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bdf73adf9fc4f4d9a79a975349463c5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:48.790120 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0079ff59-670a-45ca-94bc-7503b587ef7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bdf73adf9fc4f4d9a79a975349463c5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:48.803187 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0079ff59-670a-45ca-94bc-7503b587ef7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bdf73adf9fc4f4d9a79a975349463c5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:48.803873 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0079ff59-670a-45ca-94bc-7503b587ef7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bdf73adf9fc4f4d9a79a975349463c5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:48.809659 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1452/2902] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:07:48 2022] DELETE /identity/v3/users/8bdf73adf9fc4f4d9a79a975349463c5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:07:49.101360 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54572a-7b93-4c73-be9d-d2356296056d admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:49.102807 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-5f54572a-7b93-4c73-be9d-d2356296056d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:49.118827 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54572a-7b93-4c73-be9d-d2356296056d admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:49.178364 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01c987-c496-4888-a70c-fb1c3a108f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:49.178997 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01c987-c496-4888-a70c-fb1c3a108f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:49.179270 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01c987-c496-4888-a70c-fb1c3a108f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:49.179569 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01c987-c496-4888-a70c-fb1c3a108f77 admin admin] PATH_INFO: `/v3/projects/90a23a301993442f9d9114f28011cf44` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:49.180681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01c987-c496-4888-a70c-fb1c3a108f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a23a301993442f9d9114f28011cf44)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:49.182587 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01c987-c496-4888-a70c-fb1c3a108f77 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:49.224068 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:49.234946 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ff01c987-c496-4888-a70c-fb1c3a108f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a23a301993442f9d9114f28011cf44', 'request_id': 'req-ff01c987-c496-4888-a70c-fb1c3a108f77'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:49.241496 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ff01c987-c496-4888-a70c-fb1c3a108f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a23a301993442f9d9114f28011cf44', 'request_id': 'req-ff01c987-c496-4888-a70c-fb1c3a108f77'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:49.247470 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ff01c987-c496-4888-a70c-fb1c3a108f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a23a301993442f9d9114f28011cf44', 'request_id': 'req-ff01c987-c496-4888-a70c-fb1c3a108f77'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:49.261961 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ff01c987-c496-4888-a70c-fb1c3a108f77 admin admin] The token cache is being invalidate because project 90a23a301993442f9d9114f28011cf44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:07:49.262250 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ff01c987-c496-4888-a70c-fb1c3a108f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:49.262872 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-ff01c987-c496-4888-a70c-fb1c3a108f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:49.264423 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1451/2903] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:07:49 2022] DELETE /identity/v3/projects/90a23a301993442f9d9114f28011cf44 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 12:07:49.271315 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66885ed5-9e1e-4e32-b1ad-4b26af802738 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:49.271624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66885ed5-9e1e-4e32-b1ad-4b26af802738 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:49.271891 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66885ed5-9e1e-4e32-b1ad-4b26af802738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:49.292647 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-66885ed5-9e1e-4e32-b1ad-4b26af802738 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:07:49.294193 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-66885ed5-9e1e-4e32-b1ad-4b26af802738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:49.335262 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:49.363729 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1453/2904] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:07:49.377151 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076d417-1741-4a09-832d-3f34b404de1a None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:49.377502 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076d417-1741-4a09-832d-3f34b404de1a None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:49.377722 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076d417-1741-4a09-832d-3f34b404de1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:49.403300 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-1076d417-1741-4a09-832d-3f34b404de1a None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:07:49.404547 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-1076d417-1741-4a09-832d-3f34b404de1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:49.412983 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1452/2905] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:07:49.417983 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66885ed5-9e1e-4e32-b1ad-4b26af802738 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:49.427949 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66885ed5-9e1e-4e32-b1ad-4b26af802738 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:49.434788 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3c9e6-93e5-4561-9273-cc4249d21071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:49.435413 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c9e6-93e5-4561-9273-cc4249d21071 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:49.435701 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c9e6-93e5-4561-9273-cc4249d21071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:49.435968 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c9e6-93e5-4561-9273-cc4249d21071 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:49.436643 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3c9e6-93e5-4561-9273-cc4249d21071 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 12:07:49.436959 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3c9e6-93e5-4561-9273-cc4249d21071 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:49.438993 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3c9e6-93e5-4561-9273-cc4249d21071 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:49.451412 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1454/2906] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 12:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 12:07:49.456123 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076d417-1741-4a09-832d-3f34b404de1a None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:49.467696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076d417-1741-4a09-832d-3f34b404de1a None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:49.473696 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7c346-b39e-4b91-83f4-1e1d001240d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:49.474276 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7c346-b39e-4b91-83f4-1e1d001240d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:49.474547 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7c346-b39e-4b91-83f4-1e1d001240d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:49.474812 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7c346-b39e-4b91-83f4-1e1d001240d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:49.475533 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7c346-b39e-4b91-83f4-1e1d001240d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:49.477500 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7c346-b39e-4b91-83f4-1e1d001240d4 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:49.511348 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1453/2907] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:07:49 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:07:49.516549 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3c9e6-93e5-4561-9273-cc4249d21071 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:49.528147 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3c9e6-93e5-4561-9273-cc4249d21071 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:49.592870 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da489f6b-202f-461c-b031-016d38c4aac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:49.593470 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da489f6b-202f-461c-b031-016d38c4aac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:49.593761 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da489f6b-202f-461c-b031-016d38c4aac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:49.594033 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da489f6b-202f-461c-b031-016d38c4aac1 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:49.594667 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da489f6b-202f-461c-b031-016d38c4aac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:49.597196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da489f6b-202f-461c-b031-016d38c4aac1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:49.620606 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1455/2908] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:07:49 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:07:49.624816 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7c346-b39e-4b91-83f4-1e1d001240d4 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:49.636143 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7c346-b39e-4b91-83f4-1e1d001240d4 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:49.640749 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3b161-f302-47ca-be59-b3d6ed428295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:49.641354 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3b161-f302-47ca-be59-b3d6ed428295 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:49.641636 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3b161-f302-47ca-be59-b3d6ed428295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:49.641908 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3b161-f302-47ca-be59-b3d6ed428295 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:49.642677 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3b161-f302-47ca-be59-b3d6ed428295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:49.644315 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3b161-f302-47ca-be59-b3d6ed428295 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:49.655013 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1454/2909] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:07:49.659270 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da489f6b-202f-461c-b031-016d38c4aac1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:49.669829 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da489f6b-202f-461c-b031-016d38c4aac1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:49.675048 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b70e3-88b2-4cfd-adde-7ae2c4498bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:49.675696 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b70e3-88b2-4cfd-adde-7ae2c4498bcb admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:49.675977 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b70e3-88b2-4cfd-adde-7ae2c4498bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:49.676248 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b70e3-88b2-4cfd-adde-7ae2c4498bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:49.676884 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b70e3-88b2-4cfd-adde-7ae2c4498bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:49.678481 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b70e3-88b2-4cfd-adde-7ae2c4498bcb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:49.689308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1456/2910] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:07:49.694104 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3b161-f302-47ca-be59-b3d6ed428295 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:49.708067 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3b161-f302-47ca-be59-b3d6ed428295 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:49.713737 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb5314-9179-499b-9560-396ec75bfbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:49.714385 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb5314-9179-499b-9560-396ec75bfbd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:49.714659 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb5314-9179-499b-9560-396ec75bfbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:49.714911 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb5314-9179-499b-9560-396ec75bfbd0 admin admin] PATH_INFO: `/v3/projects/03e064e9ed3f4bcfa7b94b3e9df2d00e/users/ab959fa5664b4933b7bd41a604b4f794/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:49.730609 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb5314-9179-499b-9560-396ec75bfbd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e064e9ed3f4bcfa7b94b3e9df2d00e, user_id=ab959fa5664b4933b7bd41a604b4f794, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:49.733303 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb5314-9179-499b-9560-396ec75bfbd0 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:49.752555 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1455/2911] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:07:49 2022] PUT /identity/v3/projects/03e064e9ed3f4bcfa7b94b3e9df2d00e/users/ab959fa5664b4933b7bd41a604b4f794/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:07:49.763973 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed4b47-bb55-4397-b93a-1226325613f0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:49.764291 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed4b47-bb55-4397-b93a-1226325613f0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:49.764594 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed4b47-bb55-4397-b93a-1226325613f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:49.802599 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a6ed4b47-bb55-4397-b93a-1226325613f0 None None] MFA Rules not processed for user `ab959fa5664b4933b7bd41a604b4f794`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:07:49.804143 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a6ed4b47-bb55-4397-b93a-1226325613f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:49.883410 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1457/2912] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:07:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:07:49.895887 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb5314-9179-499b-9560-396ec75bfbd0 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:49.897752 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-43cb5314-9179-499b-9560-396ec75bfbd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:49.954601 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb5314-9179-499b-9560-396ec75bfbd0 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:49.958861 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039355f-aa23-44d6-9ff8-e2c38a1f525b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:49.959492 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039355f-aa23-44d6-9ff8-e2c38a1f525b service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:49.959767 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039355f-aa23-44d6-9ff8-e2c38a1f525b service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:49.960027 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039355f-aa23-44d6-9ff8-e2c38a1f525b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:49.968799 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039355f-aa23-44d6-9ff8-e2c38a1f525b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:49.970229 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039355f-aa23-44d6-9ff8-e2c38a1f525b service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:49.980141 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1456/2913] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:07:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:07:50.002673 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed4b47-bb55-4397-b93a-1226325613f0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:50.047734 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:50.071716 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed4b47-bb55-4397-b93a-1226325613f0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:50.077529 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afa673-a8db-47b5-9509-fca638580362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:50.078224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afa673-a8db-47b5-9509-fca638580362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:50.078500 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afa673-a8db-47b5-9509-fca638580362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:50.078765 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afa673-a8db-47b5-9509-fca638580362 admin admin] PATH_INFO: `/v3/users/ab959fa5664b4933b7bd41a604b4f794` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:50.080128 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afa673-a8db-47b5-9509-fca638580362 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab959fa5664b4933b7bd41a604b4f794)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:50.082086 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afa673-a8db-47b5-9509-fca638580362 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:50.133368 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-57afa673-a8db-47b5-9509-fca638580362 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab959fa5664b4933b7bd41a604b4f794'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:50.140301 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-57afa673-a8db-47b5-9509-fca638580362 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab959fa5664b4933b7bd41a604b4f794'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:50.148603 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-57afa673-a8db-47b5-9509-fca638580362 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab959fa5664b4933b7bd41a604b4f794'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:50.161754 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-57afa673-a8db-47b5-9509-fca638580362 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab959fa5664b4933b7bd41a604b4f794'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:50.162434 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-57afa673-a8db-47b5-9509-fca638580362 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab959fa5664b4933b7bd41a604b4f794'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:50.168260 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1458/2914] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:07:50 2022] DELETE /identity/v3/users/ab959fa5664b4933b7bd41a604b4f794 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:07:50.173022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e18447-0d73-47bd-beab-6a904695bced None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:50.173335 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e18447-0d73-47bd-beab-6a904695bced None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:50.173613 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e18447-0d73-47bd-beab-6a904695bced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:50.194663 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-97e18447-0d73-47bd-beab-6a904695bced None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:07:50.195916 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-97e18447-0d73-47bd-beab-6a904695bced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:50.277678 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1457/2915] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:07:50.290738 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afa673-a8db-47b5-9509-fca638580362 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:50.292557 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-57afa673-a8db-47b5-9509-fca638580362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:50.355210 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afa673-a8db-47b5-9509-fca638580362 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:50.360052 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b897f-3eb5-4e46-9695-cd6796be81fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:50.360655 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b897f-3eb5-4e46-9695-cd6796be81fa service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:50.360941 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b897f-3eb5-4e46-9695-cd6796be81fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:50.361269 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b897f-3eb5-4e46-9695-cd6796be81fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:50.370891 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b897f-3eb5-4e46-9695-cd6796be81fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:50.372367 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b897f-3eb5-4e46-9695-cd6796be81fa service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:50.381750 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1459/2916] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:07:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:07:50.691975 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e18447-0d73-47bd-beab-6a904695bced None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:50.693525 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-97e18447-0d73-47bd-beab-6a904695bced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:50.702747 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:50.707126 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e18447-0d73-47bd-beab-6a904695bced None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:50.713610 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446b836-3a0d-4290-9308-294b169500a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:50.714278 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446b836-3a0d-4290-9308-294b169500a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:50.714732 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446b836-3a0d-4290-9308-294b169500a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:50.715166 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446b836-3a0d-4290-9308-294b169500a2 admin admin] PATH_INFO: `/v3/projects/03e064e9ed3f4bcfa7b94b3e9df2d00e` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:50.716511 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446b836-3a0d-4290-9308-294b169500a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e064e9ed3f4bcfa7b94b3e9df2d00e)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:50.718471 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446b836-3a0d-4290-9308-294b169500a2 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:50.766169 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d446b836-3a0d-4290-9308-294b169500a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e064e9ed3f4bcfa7b94b3e9df2d00e', 'request_id': 'req-d446b836-3a0d-4290-9308-294b169500a2'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:50.772263 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d446b836-3a0d-4290-9308-294b169500a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e064e9ed3f4bcfa7b94b3e9df2d00e', 'request_id': 'req-d446b836-3a0d-4290-9308-294b169500a2'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:50.778242 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d446b836-3a0d-4290-9308-294b169500a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e064e9ed3f4bcfa7b94b3e9df2d00e', 'request_id': 'req-d446b836-3a0d-4290-9308-294b169500a2'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:50.792275 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d446b836-3a0d-4290-9308-294b169500a2 admin admin] The token cache is being invalidate because project 03e064e9ed3f4bcfa7b94b3e9df2d00e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:07:50.792562 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d446b836-3a0d-4290-9308-294b169500a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:50.793182 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-d446b836-3a0d-4290-9308-294b169500a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:07:50.794664 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1458/2917] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:07:50 2022] DELETE /identity/v3/projects/03e064e9ed3f4bcfa7b94b3e9df2d00e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:07:50.800196 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dda49-fd08-41ca-a7af-6ecdcfb2da35 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:50.800711 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dda49-fd08-41ca-a7af-6ecdcfb2da35 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:50.800820 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dda49-fd08-41ca-a7af-6ecdcfb2da35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:50.824639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3d9dda49-fd08-41ca-a7af-6ecdcfb2da35 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:07:50.826448 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3d9dda49-fd08-41ca-a7af-6ecdcfb2da35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:50.882182 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:50.894511 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1460/2918] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:07:50.904869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2068e-a50e-4566-864f-f76307f650c0 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:50.905153 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2068e-a50e-4566-864f-f76307f650c0 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:50.905428 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2068e-a50e-4566-864f-f76307f650c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:50.929681 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-f4b2068e-a50e-4566-864f-f76307f650c0 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:07:50.930892 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-f4b2068e-a50e-4566-864f-f76307f650c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:50.939791 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1459/2919] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:07:50.944171 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dda49-fd08-41ca-a7af-6ecdcfb2da35 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:50.954393 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dda49-fd08-41ca-a7af-6ecdcfb2da35 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:50.959704 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f7dfe-d35a-437c-8b6f-3cc6aa246982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:50.960308 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f7dfe-d35a-437c-8b6f-3cc6aa246982 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:50.960624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f7dfe-d35a-437c-8b6f-3cc6aa246982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:50.960888 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f7dfe-d35a-437c-8b6f-3cc6aa246982 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:50.961538 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f7dfe-d35a-437c-8b6f-3cc6aa246982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 12:07:50.961837 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f7dfe-d35a-437c-8b6f-3cc6aa246982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:50.963471 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f7dfe-d35a-437c-8b6f-3cc6aa246982 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:50.975681 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1461/2920] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Aug 30 12:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 12:07:50.980108 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2068e-a50e-4566-864f-f76307f650c0 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:50.990002 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2068e-a50e-4566-864f-f76307f650c0 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:50.995431 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8e9d8-a9a0-48eb-aac6-c53cc7178608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:50.996038 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8e9d8-a9a0-48eb-aac6-c53cc7178608 admin admin] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:50.996311 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8e9d8-a9a0-48eb-aac6-c53cc7178608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:50.996580 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8e9d8-a9a0-48eb-aac6-c53cc7178608 admin admin] PATH_INFO: `/v3/projects` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:50.997207 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8e9d8-a9a0-48eb-aac6-c53cc7178608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:50.999123 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8e9d8-a9a0-48eb-aac6-c53cc7178608 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:51.029592 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1460/2921] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Aug 30 12:07:50 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:07:51.033919 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f7dfe-d35a-437c-8b6f-3cc6aa246982 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:51.044466 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f7dfe-d35a-437c-8b6f-3cc6aa246982 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:51.102031 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9d0d9-9de8-4b71-a8a6-a50a07ec22ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:51.102703 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9d0d9-9de8-4b71-a8a6-a50a07ec22ba admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:51.102974 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9d0d9-9de8-4b71-a8a6-a50a07ec22ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:51.103219 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9d0d9-9de8-4b71-a8a6-a50a07ec22ba admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:51.103914 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9d0d9-9de8-4b71-a8a6-a50a07ec22ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:51.106029 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9d0d9-9de8-4b71-a8a6-a50a07ec22ba admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:51.129807 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1462/2922] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Aug 30 12:07:51 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 12:07:51.134077 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8e9d8-a9a0-48eb-aac6-c53cc7178608 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:51.145040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8e9d8-a9a0-48eb-aac6-c53cc7178608 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:51.150579 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e5ae6-4865-44f2-906d-29d0438cf649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:51.151575 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e5ae6-4865-44f2-906d-29d0438cf649 admin admin] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:51.151851 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e5ae6-4865-44f2-906d-29d0438cf649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:51.152114 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e5ae6-4865-44f2-906d-29d0438cf649 admin admin] PATH_INFO: `/v3/roles` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:51.152750 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e5ae6-4865-44f2-906d-29d0438cf649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:51.154493 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e5ae6-4865-44f2-906d-29d0438cf649 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:51.165218 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1461/2923] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:07:51.169102 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9d0d9-9de8-4b71-a8a6-a50a07ec22ba admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:51.179740 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9d0d9-9de8-4b71-a8a6-a50a07ec22ba admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:51.184763 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6b288-153c-49e9-b96c-d366a1ced075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:51.185350 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6b288-153c-49e9-b96c-d366a1ced075 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:51.185624 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6b288-153c-49e9-b96c-d366a1ced075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:51.185892 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6b288-153c-49e9-b96c-d366a1ced075 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:51.186550 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6b288-153c-49e9-b96c-d366a1ced075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:51.188158 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6b288-153c-49e9-b96c-d366a1ced075 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:51.199524 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1463/2924] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 12:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 12:07:51.204198 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e5ae6-4865-44f2-906d-29d0438cf649 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:51.214718 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e5ae6-4865-44f2-906d-29d0438cf649 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:51.219551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9678f-c340-4c92-9027-ece33299ca52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:51.220189 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9678f-c340-4c92-9027-ece33299ca52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:51.220607 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9678f-c340-4c92-9027-ece33299ca52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:51.220927 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9678f-c340-4c92-9027-ece33299ca52 admin admin] PATH_INFO: `/v3/projects/76288af4f83249099c12ee738213fa8a/users/92e720ef68764526b829293334d35b0e/roles/7f855c6f817f4a64a1e635407de8bfb0` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:51.237483 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9678f-c340-4c92-9027-ece33299ca52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76288af4f83249099c12ee738213fa8a, user_id=92e720ef68764526b829293334d35b0e, role_id=7f855c6f817f4a64a1e635407de8bfb0)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:51.240144 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9678f-c340-4c92-9027-ece33299ca52 admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:51.256208 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1462/2925] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Aug 30 12:07:51 2022] PUT /identity/v3/projects/76288af4f83249099c12ee738213fa8a/users/92e720ef68764526b829293334d35b0e/roles/7f855c6f817f4a64a1e635407de8bfb0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:07:51.261557 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36baf08-c582-4dbb-b28d-51fdab298609 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:51.261837 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36baf08-c582-4dbb-b28d-51fdab298609 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:51.262118 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36baf08-c582-4dbb-b28d-51fdab298609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:51.283673 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b36baf08-c582-4dbb-b28d-51fdab298609 None None] MFA Rules not processed for user `fcaa90c0553848528e601e03ebda1656`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:07:51.284873 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b36baf08-c582-4dbb-b28d-51fdab298609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:51.350382 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1464/2926] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:07:51.360811 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9678f-c340-4c92-9027-ece33299ca52 admin admin] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:51.363989 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-bca9678f-c340-4c92-9027-ece33299ca52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:51.439247 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9678f-c340-4c92-9027-ece33299ca52 admin admin] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:51.444007 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbe20c-d306-4874-b89b-929ae09cfae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:51.444608 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbe20c-d306-4874-b89b-929ae09cfae9 service neutron] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:51.444880 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbe20c-d306-4874-b89b-929ae09cfae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:51.445139 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbe20c-d306-4874-b89b-929ae09cfae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:51.455472 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbe20c-d306-4874-b89b-929ae09cfae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:51.456869 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbe20c-d306-4874-b89b-929ae09cfae9 service neutron] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:51.466540 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1463/2927] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:07:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:07:52.176050 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9cfec-d095-4460-96cd-d460d758fd18 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:52.176654 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9cfec-d095-4460-96cd-d460d758fd18 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:52.176654 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9cfec-d095-4460-96cd-d460d758fd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:52.205479 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-01e9cfec-d095-4460-96cd-d460d758fd18 None None] MFA Rules not processed for user `92e720ef68764526b829293334d35b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:07:52.206714 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-01e9cfec-d095-4460-96cd-d460d758fd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:52.264904 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:52.277532 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1465/2928] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:07:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:07:52.289603 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbe20c-d306-4874-b89b-929ae09cfae9 service neutron] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:52.291204 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-e3fbe20c-d306-4874-b89b-929ae09cfae9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:52.329574 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:52.357881 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbe20c-d306-4874-b89b-929ae09cfae9 service neutron] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:52.362017 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52293c-b588-415c-a1df-0c0163315c2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9bbec99965e4444bcf88a32502b3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:52.362619 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52293c-b588-415c-a1df-0c0163315c2a service cinder] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:52.362893 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52293c-b588-415c-a1df-0c0163315c2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:52.363159 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52293c-b588-415c-a1df-0c0163315c2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:52.371345 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52293c-b588-415c-a1df-0c0163315c2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:52.372818 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52293c-b588-415c-a1df-0c0163315c2a service cinder] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:52.381677 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1464/2929] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:07:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:07:53.771074 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42e854-7657-423a-8dbf-4a76b45c7c8c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:53.771639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42e854-7657-423a-8dbf-4a76b45c7c8c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:53.771639 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42e854-7657-423a-8dbf-4a76b45c7c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:53.792154 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ba42e854-7657-423a-8dbf-4a76b45c7c8c None None] MFA Rules not processed for user `92e720ef68764526b829293334d35b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:07:53.793339 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ba42e854-7657-423a-8dbf-4a76b45c7c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:53.801175 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1466/2930] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:07:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:07:53.840715 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52293c-b588-415c-a1df-0c0163315c2a service cinder] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:53.842162 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-2f52293c-b588-415c-a1df-0c0163315c2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:53.900022 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52293c-b588-415c-a1df-0c0163315c2a service cinder] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:53.904656 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3909f-017e-40f0-a2d0-fcaa8d51f89f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6682c22be8c4bdca4be33a93e802409', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:53.905263 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3909f-017e-40f0-a2d0-fcaa8d51f89f service glance] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:53.905537 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3909f-017e-40f0-a2d0-fcaa8d51f89f service glance] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:53.905771 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3909f-017e-40f0-a2d0-fcaa8d51f89f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:53.908004 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-13f3909f-017e-40f0-a2d0-fcaa8d51f89f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:54.002378 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3909f-017e-40f0-a2d0-fcaa8d51f89f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:54.003765 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3909f-017e-40f0-a2d0-fcaa8d51f89f service glance] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:54.024411 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1465/2931] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:07:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:07:54.584006 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42e854-7657-423a-8dbf-4a76b45c7c8c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:07:54.595533 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42e854-7657-423a-8dbf-4a76b45c7c8c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:07:54.599438 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fb446-57f9-418d-b367-c36fc4fdc55a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3be96d37b4e4dd889be755b004bfe52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:07:54.600075 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fb446-57f9-418d-b367-c36fc4fdc55a service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:07:54.600513 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fb446-57f9-418d-b367-c36fc4fdc55a service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:07:54.600670 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fb446-57f9-418d-b367-c36fc4fdc55a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:07:54.603143 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d24fb446-57f9-418d-b367-c36fc4fdc55a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:07:54.617408 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fb446-57f9-418d-b367-c36fc4fdc55a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:07:54.618854 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fb446-57f9-418d-b367-c36fc4fdc55a service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:07:54.629838 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1467/2932] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:07:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:08:04.022072 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=80 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:08:04.624885 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=11 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:08:07.140823 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ce4e0-15c2-4376-88b3-2be03810c6f2 None None] REQUEST_METHOD: `POST` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:08:07.141345 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ce4e0-15c2-4376-88b3-2be03810c6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:08:07.141463 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ce4e0-15c2-4376-88b3-2be03810c6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:08:07.161578 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.auth.core [None req-770ce4e0-15c2-4376-88b3-2be03810c6f2 None None] MFA Rules not processed for user `92e720ef68764526b829293334d35b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:08:07.162982 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-770ce4e0-15c2-4376-88b3-2be03810c6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:08:07.170291 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1466/2933] 10.222.0.27 () {58 vars in 958 bytes} [Tue Aug 30 12:08:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:08:17.155819 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=3 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:08:20.792140 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af127fb2-b640-41d4-8d96-c5cb310c2e93 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:08:20.792634 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af127fb2-b640-41d4-8d96-c5cb310c2e93 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:08:20.792756 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af127fb2-b640-41d4-8d96-c5cb310c2e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:08:20.852633 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-af127fb2-b640-41d4-8d96-c5cb310c2e93 None None] MFA Rules not processed for user `58c86110ce97463e9b3d53691ae3e12c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:08:20.853891 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-af127fb2-b640-41d4-8d96-c5cb310c2e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:08:20.928555 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1468/2934] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Aug 30 12:08:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:08:20.976881 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ce4e0-15c2-4376-88b3-2be03810c6f2 None None] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:08:20.978272 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.fernet_utils [None req-770ce4e0-15c2-4376-88b3-2be03810c6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:08:21.079093 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ce4e0-15c2-4376-88b3-2be03810c6f2 None None] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:08:21.084699 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a34c89-8630-40b3-849c-f785aafa3ff6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d27bfb8c0b64763b7db7cffa5f230f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:08:21.085311 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a34c89-8630-40b3-849c-f785aafa3ff6 service swift] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:08:21.085590 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a34c89-8630-40b3-849c-f785aafa3ff6 service swift] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:08:21.085865 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a34c89-8630-40b3-849c-f785aafa3ff6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:08:21.094405 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a34c89-8630-40b3-849c-f785aafa3ff6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:08:21.096066 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a34c89-8630-40b3-849c-f785aafa3ff6 service swift] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:08:21.107406 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1467/2935] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Aug 30 12:08:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 12:08:30.923858 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=44 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:08:31.101469 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=41 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:08:35.528797 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc86c08-d078-42a3-8de3-9f504e55cf6b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:08:35.529323 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc86c08-d078-42a3-8de3-9f504e55cf6b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:08:35.529323 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc86c08-d078-42a3-8de3-9f504e55cf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:08:35.549065 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-fcc86c08-d078-42a3-8de3-9f504e55cf6b None None] MFA Rules not processed for user `58c86110ce97463e9b3d53691ae3e12c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 12:08:35.550264 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fcc86c08-d078-42a3-8de3-9f504e55cf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:08:35.557792 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1469/2936] 10.222.0.27 () {58 vars in 967 bytes} [Tue Aug 30 12:08:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 12:08:35.570466 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a34c89-8630-40b3-849c-f785aafa3ff6 service swift] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:08:35.581569 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a34c89-8630-40b3-849c-f785aafa3ff6 service swift] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:08:35.588118 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449d7a2-c945-4c7c-821f-5333db76c8a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d27bfb8c0b64763b7db7cffa5f230f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:08:35.588717 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449d7a2-c945-4c7c-821f-5333db76c8a8 service swift] REQUEST_METHOD: `GET` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:08:35.588990 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449d7a2-c945-4c7c-821f-5333db76c8a8 service swift] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:08:35.589256 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449d7a2-c945-4c7c-821f-5333db76c8a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:08:35.597905 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4449d7a2-c945-4c7c-821f-5333db76c8a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:08:35.599720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4449d7a2-c945-4c7c-821f-5333db76c8a8 service swift] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:08:35.608234 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1468/2937] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Aug 30 12:08:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 12:08:37.585677 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc86c08-d078-42a3-8de3-9f504e55cf6b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:08:37.598971 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc86c08-d078-42a3-8de3-9f504e55cf6b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:08:37.604787 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8636adc-2d09-4677-b537-3093f5c2f66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:08:37.605441 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8636adc-2d09-4677-b537-3093f5c2f66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:08:37.605690 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8636adc-2d09-4677-b537-3093f5c2f66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:08:37.606108 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8636adc-2d09-4677-b537-3093f5c2f66a admin admin] PATH_INFO: `/v3/users/92e720ef68764526b829293334d35b0e` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:08:37.607479 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8636adc-2d09-4677-b537-3093f5c2f66a admin admin] RBAC: Authorizing `identity:delete_user(user_id=92e720ef68764526b829293334d35b0e)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:08:37.609422 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8636adc-2d09-4677-b537-3093f5c2f66a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:08:37.662872 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d8636adc-2d09-4677-b537-3093f5c2f66a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92e720ef68764526b829293334d35b0e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:08:37.670718 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d8636adc-2d09-4677-b537-3093f5c2f66a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92e720ef68764526b829293334d35b0e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:08:37.679224 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d8636adc-2d09-4677-b537-3093f5c2f66a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92e720ef68764526b829293334d35b0e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:08:37.691625 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d8636adc-2d09-4677-b537-3093f5c2f66a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92e720ef68764526b829293334d35b0e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:08:37.692497 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d8636adc-2d09-4677-b537-3093f5c2f66a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92e720ef68764526b829293334d35b0e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:08:37.698565 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1470/2938] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 12:08:37 2022] DELETE /identity/v3/users/92e720ef68764526b829293334d35b0e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:08:37.884381 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449d7a2-c945-4c7c-821f-5333db76c8a8 service swift] Authenticating user token {{(pid=81553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:08:37.897720 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449d7a2-c945-4c7c-821f-5333db76c8a8 service swift] Validating token access rules against request {{(pid=81553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:08:37.966953 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3354e-b1e5-4046-be1f-e27662bf94dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcaa90c0553848528e601e03ebda1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '801a00d9234a4360978c5c3ff97e0dc2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:08:37.967658 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3354e-b1e5-4046-be1f-e27662bf94dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:08:37.967936 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3354e-b1e5-4046-be1f-e27662bf94dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:08:37.968204 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3354e-b1e5-4046-be1f-e27662bf94dc admin admin] PATH_INFO: `/v3/projects/76288af4f83249099c12ee738213fa8a` {{(pid=81553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:08:37.969551 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3354e-b1e5-4046-be1f-e27662bf94dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=76288af4f83249099c12ee738213fa8a)` {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:08:37.971549 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3354e-b1e5-4046-be1f-e27662bf94dc admin admin] RBAC: Authorization granted {{(pid=81553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:08:38.022982 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-48c3354e-b1e5-4046-be1f-e27662bf94dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76288af4f83249099c12ee738213fa8a', 'request_id': 'req-48c3354e-b1e5-4046-be1f-e27662bf94dc'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:08:38.029814 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-48c3354e-b1e5-4046-be1f-e27662bf94dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76288af4f83249099c12ee738213fa8a', 'request_id': 'req-48c3354e-b1e5-4046-be1f-e27662bf94dc'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:08:38.036856 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-48c3354e-b1e5-4046-be1f-e27662bf94dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76288af4f83249099c12ee738213fa8a', 'request_id': 'req-48c3354e-b1e5-4046-be1f-e27662bf94dc'} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:08:38.055728 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-48c3354e-b1e5-4046-be1f-e27662bf94dc admin admin] The token cache is being invalidate because project 76288af4f83249099c12ee738213fa8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 12:08:38.056040 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-48c3354e-b1e5-4046-be1f-e27662bf94dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:08:38.057134 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG keystone.notifications [None req-48c3354e-b1e5-4046-be1f-e27662bf94dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 12:08:38.059469 dv-cinder-839768-2-smb devstack@keystone.service[81553]: [pid: 81553|app: 0|req: 1469/2939] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 12:08:37 2022] DELETE /identity/v3/projects/76288af4f83249099c12ee738213fa8a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 12:08:47.695283 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:08:48.051315 dv-cinder-839768-2-smb devstack@keystone.service[81553]: DEBUG dbcounter [-] [81553] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:12:02.584437 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8636adc-2d09-4677-b537-3093f5c2f66a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 12:12:02.586125 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d8636adc-2d09-4677-b537-3093f5c2f66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:12:02.667715 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8636adc-2d09-4677-b537-3093f5c2f66a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 12:12:02.742143 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bc782-2f78-4b93-bcb3-0e3bb625d6a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9efd2ac7fc4a42558e8dc48c408ce525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba4dff9d637c4afcadfd3cd92b065a41', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 12:12:02.742756 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bc782-2f78-4b93-bcb3-0e3bb625d6a4 service placement] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 12:12:02.743025 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bc782-2f78-4b93-bcb3-0e3bb625d6a4 service placement] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 12:12:02.743290 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bc782-2f78-4b93-bcb3-0e3bb625d6a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 12:12:02.745184 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f14bc782-2f78-4b93-bcb3-0e3bb625d6a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 12:12:02.756987 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bc782-2f78-4b93-bcb3-0e3bb625d6a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 12:12:02.758565 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bc782-2f78-4b93-bcb3-0e3bb625d6a4 service placement] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 12:12:02.768363 dv-cinder-839768-2-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1471/2940] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Aug 30 12:12:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 12:12:12.764352 dv-cinder-839768-2-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=58 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}